00:00:00.001 Started by upstream project "autotest-nightly" build number 3627 00:00:00.001 originally caused by: 00:00:00.002 Started by upstream project "nightly-trigger" build number 3009 00:00:00.002 originally caused by: 00:00:00.002 Started by timer 00:00:00.049 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-cvl-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.049 The recommended git tool is: git 00:00:00.050 using credential 00000000-0000-0000-0000-000000000002 00:00:00.051 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-cvl-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.066 Fetching changes from the remote Git repository 00:00:00.068 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.088 Using shallow fetch with depth 1 00:00:00.088 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.088 > git --version # timeout=10 00:00:00.120 > git --version # 'git version 2.39.2' 00:00:00.120 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.120 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.120 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:02.110 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:02.121 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:02.133 Checking out Revision 6e1fadd1eee50389429f9abb33dde5face8ca717 (FETCH_HEAD) 00:00:02.133 > git config core.sparsecheckout # timeout=10 00:00:02.143 > git read-tree -mu HEAD # timeout=10 00:00:02.158 > git checkout -f 6e1fadd1eee50389429f9abb33dde5face8ca717 # timeout=5 00:00:02.177 Commit message: "pool: attach build logs for failed merge builds" 00:00:02.177 > git rev-list --no-walk 6e1fadd1eee50389429f9abb33dde5face8ca717 # timeout=10 00:00:02.382 [Pipeline] Start of Pipeline 00:00:02.398 [Pipeline] library 00:00:02.400 Loading library shm_lib@master 00:00:02.400 Library shm_lib@master is cached. Copying from home. 00:00:02.417 [Pipeline] node 00:00:02.423 Running on WFP3 in /var/jenkins/workspace/nvmf-cvl-phy-autotest 00:00:02.424 [Pipeline] { 00:00:02.432 [Pipeline] catchError 00:00:02.433 [Pipeline] { 00:00:02.443 [Pipeline] wrap 00:00:02.450 [Pipeline] { 00:00:02.454 [Pipeline] stage 00:00:02.456 [Pipeline] { (Prologue) 00:00:02.620 [Pipeline] sh 00:00:02.902 + logger -p user.info -t JENKINS-CI 00:00:02.920 [Pipeline] echo 00:00:02.922 Node: WFP3 00:00:02.929 [Pipeline] sh 00:00:03.217 [Pipeline] setCustomBuildProperty 00:00:03.226 [Pipeline] echo 00:00:03.228 Cleanup processes 00:00:03.233 [Pipeline] sh 00:00:03.517 + sudo pgrep -af /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:00:03.517 3784498 sudo pgrep -af /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:00:03.530 [Pipeline] sh 00:00:03.809 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:00:03.809 ++ grep -v 'sudo pgrep' 00:00:03.809 ++ awk '{print $1}' 00:00:03.809 + sudo kill -9 00:00:03.809 + true 00:00:03.820 [Pipeline] cleanWs 00:00:03.827 [WS-CLEANUP] Deleting project workspace... 00:00:03.827 [WS-CLEANUP] Deferred wipeout is used... 00:00:03.833 [WS-CLEANUP] done 00:00:03.837 [Pipeline] setCustomBuildProperty 00:00:03.846 [Pipeline] sh 00:00:04.120 + sudo git config --global --replace-all safe.directory '*' 00:00:04.188 [Pipeline] nodesByLabel 00:00:04.190 Found a total of 1 nodes with the 'sorcerer' label 00:00:04.197 [Pipeline] httpRequest 00:00:04.201 HttpMethod: GET 00:00:04.202 URL: http://10.211.164.96/packages/jbp_6e1fadd1eee50389429f9abb33dde5face8ca717.tar.gz 00:00:04.205 Sending request to url: http://10.211.164.96/packages/jbp_6e1fadd1eee50389429f9abb33dde5face8ca717.tar.gz 00:00:04.208 Response Code: HTTP/1.1 200 OK 00:00:04.209 Success: Status code 200 is in the accepted range: 200,404 00:00:04.209 Saving response body to /var/jenkins/workspace/nvmf-cvl-phy-autotest/jbp_6e1fadd1eee50389429f9abb33dde5face8ca717.tar.gz 00:00:04.479 [Pipeline] sh 00:00:04.767 + tar --no-same-owner -xf jbp_6e1fadd1eee50389429f9abb33dde5face8ca717.tar.gz 00:00:04.783 [Pipeline] httpRequest 00:00:04.788 HttpMethod: GET 00:00:04.788 URL: http://10.211.164.96/packages/spdk_abd932d6f95cedabe6e56e5390ec197c8d7806e9.tar.gz 00:00:04.789 Sending request to url: http://10.211.164.96/packages/spdk_abd932d6f95cedabe6e56e5390ec197c8d7806e9.tar.gz 00:00:04.792 Response Code: HTTP/1.1 200 OK 00:00:04.792 Success: Status code 200 is in the accepted range: 200,404 00:00:04.792 Saving response body to /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk_abd932d6f95cedabe6e56e5390ec197c8d7806e9.tar.gz 00:00:27.885 [Pipeline] sh 00:00:28.167 + tar --no-same-owner -xf spdk_abd932d6f95cedabe6e56e5390ec197c8d7806e9.tar.gz 00:00:30.711 [Pipeline] sh 00:00:31.037 + git -C spdk log --oneline -n5 00:00:31.037 abd932d6f Revert "event: switch reactors to poll mode before stopping" 00:00:31.037 3f2c89791 event: switch reactors to poll mode before stopping 00:00:31.038 443e1ea31 setup.sh: emit command line to /dev/kmsg on Linux 00:00:31.038 a1264177c pkgdep/git: Adjust ICE driver to kernel >= 6.8.x 00:00:31.038 af95268b1 pkgdep/git: Adjust QAT driver to kernel >= 6.8.x 00:00:31.049 [Pipeline] } 00:00:31.065 [Pipeline] // stage 00:00:31.073 [Pipeline] stage 00:00:31.074 [Pipeline] { (Prepare) 00:00:31.090 [Pipeline] writeFile 00:00:31.106 [Pipeline] sh 00:00:31.385 + logger -p user.info -t JENKINS-CI 00:00:31.397 [Pipeline] sh 00:00:31.677 + logger -p user.info -t JENKINS-CI 00:00:31.691 [Pipeline] sh 00:00:31.975 + cat autorun-spdk.conf 00:00:31.975 SPDK_RUN_FUNCTIONAL_TEST=1 00:00:31.975 SPDK_TEST_NVMF=1 00:00:31.975 SPDK_TEST_NVME_CLI=1 00:00:31.975 SPDK_TEST_NVMF_TRANSPORT=rdma 00:00:31.975 SPDK_TEST_NVMF_NICS=e810 00:00:31.975 SPDK_RUN_UBSAN=1 00:00:31.975 NET_TYPE=phy 00:00:31.981 RUN_NIGHTLY=1 00:00:31.988 [Pipeline] readFile 00:00:32.013 [Pipeline] withEnv 00:00:32.015 [Pipeline] { 00:00:32.031 [Pipeline] sh 00:00:32.316 + set -ex 00:00:32.316 + [[ -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/autorun-spdk.conf ]] 00:00:32.316 + source /var/jenkins/workspace/nvmf-cvl-phy-autotest/autorun-spdk.conf 00:00:32.316 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:00:32.316 ++ SPDK_TEST_NVMF=1 00:00:32.316 ++ SPDK_TEST_NVME_CLI=1 00:00:32.316 ++ SPDK_TEST_NVMF_TRANSPORT=rdma 00:00:32.316 ++ SPDK_TEST_NVMF_NICS=e810 00:00:32.316 ++ SPDK_RUN_UBSAN=1 00:00:32.316 ++ NET_TYPE=phy 00:00:32.316 ++ RUN_NIGHTLY=1 00:00:32.316 + case $SPDK_TEST_NVMF_NICS in 00:00:32.316 + DRIVERS=ice 00:00:32.316 + [[ rdma == \r\d\m\a ]] 00:00:32.316 + DRIVERS+=' irdma' 00:00:32.316 + [[ -n ice irdma ]] 00:00:32.316 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:00:32.316 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:00:32.316 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:00:32.316 rmmod: ERROR: Module i40iw is not currently loaded 00:00:32.316 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:00:32.316 + true 00:00:32.316 + for D in $DRIVERS 00:00:32.316 + sudo modprobe ice 00:00:32.316 + for D in $DRIVERS 00:00:32.316 + sudo modprobe irdma 00:00:32.574 + exit 0 00:00:32.584 [Pipeline] } 00:00:32.605 [Pipeline] // withEnv 00:00:32.611 [Pipeline] } 00:00:32.631 [Pipeline] // stage 00:00:32.641 [Pipeline] catchError 00:00:32.643 [Pipeline] { 00:00:32.661 [Pipeline] timeout 00:00:32.661 Timeout set to expire in 40 min 00:00:32.663 [Pipeline] { 00:00:32.682 [Pipeline] stage 00:00:32.685 [Pipeline] { (Tests) 00:00:32.704 [Pipeline] sh 00:00:32.986 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-cvl-phy-autotest 00:00:32.986 ++ readlink -f /var/jenkins/workspace/nvmf-cvl-phy-autotest 00:00:32.986 + DIR_ROOT=/var/jenkins/workspace/nvmf-cvl-phy-autotest 00:00:32.986 + [[ -n /var/jenkins/workspace/nvmf-cvl-phy-autotest ]] 00:00:32.986 + DIR_SPDK=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:00:32.986 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-cvl-phy-autotest/output 00:00:32.986 + [[ -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk ]] 00:00:32.986 + [[ ! -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/output ]] 00:00:32.986 + mkdir -p /var/jenkins/workspace/nvmf-cvl-phy-autotest/output 00:00:32.986 + [[ -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/output ]] 00:00:32.986 + cd /var/jenkins/workspace/nvmf-cvl-phy-autotest 00:00:32.986 + source /etc/os-release 00:00:32.986 ++ NAME='Fedora Linux' 00:00:32.986 ++ VERSION='38 (Cloud Edition)' 00:00:32.986 ++ ID=fedora 00:00:32.986 ++ VERSION_ID=38 00:00:32.986 ++ VERSION_CODENAME= 00:00:32.986 ++ PLATFORM_ID=platform:f38 00:00:32.986 ++ PRETTY_NAME='Fedora Linux 38 (Cloud Edition)' 00:00:32.986 ++ ANSI_COLOR='0;38;2;60;110;180' 00:00:32.986 ++ LOGO=fedora-logo-icon 00:00:32.986 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:38 00:00:32.986 ++ HOME_URL=https://fedoraproject.org/ 00:00:32.986 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f38/system-administrators-guide/ 00:00:32.986 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:00:32.986 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:00:32.986 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:00:32.986 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=38 00:00:32.986 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:00:32.986 ++ REDHAT_SUPPORT_PRODUCT_VERSION=38 00:00:32.986 ++ SUPPORT_END=2024-05-14 00:00:32.986 ++ VARIANT='Cloud Edition' 00:00:32.986 ++ VARIANT_ID=cloud 00:00:32.986 + uname -a 00:00:32.986 Linux spdk-wfp-03 6.7.0-68.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jan 15 02:47:10 UTC 2024 x86_64 GNU/Linux 00:00:32.986 + sudo /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh status 00:00:35.519 Hugepages 00:00:35.519 node hugesize free / total 00:00:35.519 node0 1048576kB 0 / 0 00:00:35.519 node0 2048kB 0 / 0 00:00:35.519 node1 1048576kB 0 / 0 00:00:35.520 node1 2048kB 0 / 0 00:00:35.520 00:00:35.520 Type BDF Vendor Device NUMA Driver Device Block devices 00:00:35.520 I/OAT 0000:00:04.0 8086 2021 0 ioatdma - - 00:00:35.778 I/OAT 0000:00:04.1 8086 2021 0 ioatdma - - 00:00:35.778 I/OAT 0000:00:04.2 8086 2021 0 ioatdma - - 00:00:35.778 I/OAT 0000:00:04.3 8086 2021 0 ioatdma - - 00:00:35.778 I/OAT 0000:00:04.4 8086 2021 0 ioatdma - - 00:00:35.778 I/OAT 0000:00:04.5 8086 2021 0 ioatdma - - 00:00:35.778 I/OAT 0000:00:04.6 8086 2021 0 ioatdma - - 00:00:35.778 I/OAT 0000:00:04.7 8086 2021 0 ioatdma - - 00:00:35.778 NVMe 0000:5e:00.0 8086 0a54 0 nvme nvme0 nvme0n1 00:00:35.778 NVMe 0000:5f:00.0 1b96 2600 0 nvme nvme1 nvme1n1 nvme1n2 00:00:35.778 I/OAT 0000:80:04.0 8086 2021 1 ioatdma - - 00:00:35.778 I/OAT 0000:80:04.1 8086 2021 1 ioatdma - - 00:00:35.778 I/OAT 0000:80:04.2 8086 2021 1 ioatdma - - 00:00:35.778 I/OAT 0000:80:04.3 8086 2021 1 ioatdma - - 00:00:35.778 I/OAT 0000:80:04.4 8086 2021 1 ioatdma - - 00:00:35.778 I/OAT 0000:80:04.5 8086 2021 1 ioatdma - - 00:00:35.778 I/OAT 0000:80:04.6 8086 2021 1 ioatdma - - 00:00:35.778 I/OAT 0000:80:04.7 8086 2021 1 ioatdma - - 00:00:35.778 + rm -f /tmp/spdk-ld-path 00:00:35.778 + source autorun-spdk.conf 00:00:35.778 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:00:35.778 ++ SPDK_TEST_NVMF=1 00:00:35.778 ++ SPDK_TEST_NVME_CLI=1 00:00:35.778 ++ SPDK_TEST_NVMF_TRANSPORT=rdma 00:00:35.778 ++ SPDK_TEST_NVMF_NICS=e810 00:00:35.778 ++ SPDK_RUN_UBSAN=1 00:00:35.778 ++ NET_TYPE=phy 00:00:35.778 ++ RUN_NIGHTLY=1 00:00:35.778 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:00:35.778 + [[ -n '' ]] 00:00:35.778 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:00:35.778 + for M in /var/spdk/build-*-manifest.txt 00:00:35.778 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:00:35.778 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-cvl-phy-autotest/output/ 00:00:35.778 + for M in /var/spdk/build-*-manifest.txt 00:00:35.778 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:00:35.778 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-cvl-phy-autotest/output/ 00:00:35.778 ++ uname 00:00:35.778 + [[ Linux == \L\i\n\u\x ]] 00:00:35.778 + sudo dmesg -T 00:00:36.036 + sudo dmesg --clear 00:00:36.036 + dmesg_pid=3785572 00:00:36.036 + [[ Fedora Linux == FreeBSD ]] 00:00:36.036 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:00:36.036 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:00:36.036 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:00:36.036 + [[ -x /usr/src/fio-static/fio ]] 00:00:36.036 + sudo dmesg -Tw 00:00:36.036 + export FIO_BIN=/usr/src/fio-static/fio 00:00:36.036 + FIO_BIN=/usr/src/fio-static/fio 00:00:36.036 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\c\v\l\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:00:36.036 + [[ ! -v VFIO_QEMU_BIN ]] 00:00:36.036 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:00:36.036 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:00:36.036 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:00:36.036 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:00:36.036 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:00:36.036 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:00:36.036 + spdk/autorun.sh /var/jenkins/workspace/nvmf-cvl-phy-autotest/autorun-spdk.conf 00:00:36.037 Test configuration: 00:00:36.037 SPDK_RUN_FUNCTIONAL_TEST=1 00:00:36.037 SPDK_TEST_NVMF=1 00:00:36.037 SPDK_TEST_NVME_CLI=1 00:00:36.037 SPDK_TEST_NVMF_TRANSPORT=rdma 00:00:36.037 SPDK_TEST_NVMF_NICS=e810 00:00:36.037 SPDK_RUN_UBSAN=1 00:00:36.037 NET_TYPE=phy 00:00:36.037 RUN_NIGHTLY=1 03:01:10 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:00:36.037 03:01:10 -- scripts/common.sh@508 -- $ [[ -e /bin/wpdk_common.sh ]] 00:00:36.037 03:01:10 -- scripts/common.sh@516 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:00:36.037 03:01:10 -- scripts/common.sh@517 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:00:36.037 03:01:10 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:36.037 03:01:10 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:36.037 03:01:10 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:36.037 03:01:10 -- paths/export.sh@5 -- $ export PATH 00:00:36.037 03:01:10 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:36.037 03:01:10 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output 00:00:36.037 03:01:10 -- common/autobuild_common.sh@435 -- $ date +%s 00:00:36.037 03:01:10 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1714006870.XXXXXX 00:00:36.037 03:01:10 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1714006870.nWJtUY 00:00:36.037 03:01:10 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:00:36.037 03:01:10 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:00:36.037 03:01:10 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/' 00:00:36.037 03:01:10 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/xnvme --exclude /tmp' 00:00:36.037 03:01:10 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:00:36.037 03:01:10 -- common/autobuild_common.sh@451 -- $ get_config_params 00:00:36.037 03:01:10 -- common/autotest_common.sh@385 -- $ xtrace_disable 00:00:36.037 03:01:10 -- common/autotest_common.sh@10 -- $ set +x 00:00:36.037 03:01:10 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:00:36.037 03:01:10 -- common/autobuild_common.sh@453 -- $ start_monitor_resources 00:00:36.037 03:01:10 -- pm/common@17 -- $ local monitor 00:00:36.037 03:01:10 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:00:36.037 03:01:10 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=3785606 00:00:36.037 03:01:10 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:00:36.037 03:01:10 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=3785608 00:00:36.037 03:01:10 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:00:36.037 03:01:10 -- pm/common@21 -- $ date +%s 00:00:36.037 03:01:10 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=3785610 00:00:36.037 03:01:10 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:00:36.037 03:01:10 -- pm/common@21 -- $ date +%s 00:00:36.037 03:01:10 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=3785613 00:00:36.037 03:01:10 -- pm/common@26 -- $ sleep 1 00:00:36.037 03:01:10 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1714006870 00:00:36.037 03:01:10 -- pm/common@21 -- $ date +%s 00:00:36.037 03:01:10 -- pm/common@21 -- $ date +%s 00:00:36.037 03:01:10 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1714006870 00:00:36.037 03:01:10 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1714006870 00:00:36.037 03:01:10 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1714006870 00:00:36.037 Redirecting to /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1714006870_collect-bmc-pm.bmc.pm.log 00:00:36.037 Redirecting to /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1714006870_collect-cpu-load.pm.log 00:00:36.037 Redirecting to /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1714006870_collect-vmstat.pm.log 00:00:36.037 Redirecting to /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1714006870_collect-cpu-temp.pm.log 00:00:36.973 03:01:11 -- common/autobuild_common.sh@454 -- $ trap stop_monitor_resources EXIT 00:00:36.973 03:01:11 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:00:36.973 03:01:11 -- spdk/autobuild.sh@12 -- $ umask 022 00:00:36.973 03:01:11 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:00:36.973 03:01:11 -- spdk/autobuild.sh@16 -- $ date -u 00:00:36.973 Thu Apr 25 01:01:11 AM UTC 2024 00:00:36.973 03:01:11 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:00:37.233 v24.05-pre-438-gabd932d6f 00:00:37.233 03:01:11 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:00:37.233 03:01:11 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:00:37.233 03:01:11 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:00:37.233 03:01:11 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:00:37.233 03:01:11 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:00:37.233 03:01:11 -- common/autotest_common.sh@10 -- $ set +x 00:00:37.233 ************************************ 00:00:37.233 START TEST ubsan 00:00:37.233 ************************************ 00:00:37.233 03:01:11 -- common/autotest_common.sh@1111 -- $ echo 'using ubsan' 00:00:37.233 using ubsan 00:00:37.233 00:00:37.233 real 0m0.001s 00:00:37.233 user 0m0.000s 00:00:37.233 sys 0m0.001s 00:00:37.233 03:01:11 -- common/autotest_common.sh@1112 -- $ xtrace_disable 00:00:37.233 03:01:11 -- common/autotest_common.sh@10 -- $ set +x 00:00:37.233 ************************************ 00:00:37.233 END TEST ubsan 00:00:37.233 ************************************ 00:00:37.233 03:01:11 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:00:37.233 03:01:11 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:00:37.233 03:01:11 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:00:37.233 03:01:11 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:00:37.233 03:01:11 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:00:37.233 03:01:11 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:00:37.233 03:01:11 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:00:37.233 03:01:11 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:00:37.233 03:01:11 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:00:37.492 Using default SPDK env in /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/env_dpdk 00:00:37.492 Using default DPDK in /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build 00:00:37.751 Using 'verbs' RDMA provider 00:00:50.527 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/.spdk-isal.log)...done. 00:01:02.802 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/.spdk-isal-crypto.log)...done. 00:01:02.802 Creating mk/config.mk...done. 00:01:02.802 Creating mk/cc.flags.mk...done. 00:01:02.802 Type 'make' to build. 00:01:02.802 03:01:35 -- spdk/autobuild.sh@69 -- $ run_test make make -j96 00:01:02.802 03:01:35 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:02.802 03:01:35 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:02.802 03:01:35 -- common/autotest_common.sh@10 -- $ set +x 00:01:02.802 ************************************ 00:01:02.802 START TEST make 00:01:02.802 ************************************ 00:01:02.802 03:01:35 -- common/autotest_common.sh@1111 -- $ make -j96 00:01:02.802 make[1]: Nothing to be done for 'all'. 00:01:09.377 The Meson build system 00:01:09.377 Version: 1.3.1 00:01:09.377 Source dir: /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk 00:01:09.377 Build dir: /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build-tmp 00:01:09.377 Build type: native build 00:01:09.377 Program cat found: YES (/usr/bin/cat) 00:01:09.377 Project name: DPDK 00:01:09.377 Project version: 23.11.0 00:01:09.377 C compiler for the host machine: cc (gcc 13.2.1 "cc (GCC) 13.2.1 20231011 (Red Hat 13.2.1-4)") 00:01:09.377 C linker for the host machine: cc ld.bfd 2.39-16 00:01:09.377 Host machine cpu family: x86_64 00:01:09.377 Host machine cpu: x86_64 00:01:09.377 Message: ## Building in Developer Mode ## 00:01:09.377 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:09.377 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:09.377 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:09.377 Program python3 found: YES (/usr/bin/python3) 00:01:09.377 Program cat found: YES (/usr/bin/cat) 00:01:09.377 Compiler for C supports arguments -march=native: YES 00:01:09.377 Checking for size of "void *" : 8 00:01:09.377 Checking for size of "void *" : 8 (cached) 00:01:09.377 Library m found: YES 00:01:09.377 Library numa found: YES 00:01:09.377 Has header "numaif.h" : YES 00:01:09.377 Library fdt found: NO 00:01:09.377 Library execinfo found: NO 00:01:09.377 Has header "execinfo.h" : YES 00:01:09.377 Found pkg-config: YES (/usr/bin/pkg-config) 1.8.0 00:01:09.377 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:09.377 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:09.377 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:09.377 Run-time dependency openssl found: YES 3.0.9 00:01:09.377 Run-time dependency libpcap found: YES 1.10.4 00:01:09.377 Has header "pcap.h" with dependency libpcap: YES 00:01:09.377 Compiler for C supports arguments -Wcast-qual: YES 00:01:09.377 Compiler for C supports arguments -Wdeprecated: YES 00:01:09.377 Compiler for C supports arguments -Wformat: YES 00:01:09.377 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:09.377 Compiler for C supports arguments -Wformat-security: NO 00:01:09.377 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:09.377 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:09.377 Compiler for C supports arguments -Wnested-externs: YES 00:01:09.377 Compiler for C supports arguments -Wold-style-definition: YES 00:01:09.377 Compiler for C supports arguments -Wpointer-arith: YES 00:01:09.377 Compiler for C supports arguments -Wsign-compare: YES 00:01:09.377 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:09.377 Compiler for C supports arguments -Wundef: YES 00:01:09.377 Compiler for C supports arguments -Wwrite-strings: YES 00:01:09.377 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:09.377 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:09.377 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:09.378 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:09.378 Program objdump found: YES (/usr/bin/objdump) 00:01:09.378 Compiler for C supports arguments -mavx512f: YES 00:01:09.378 Checking if "AVX512 checking" compiles: YES 00:01:09.378 Fetching value of define "__SSE4_2__" : 1 00:01:09.378 Fetching value of define "__AES__" : 1 00:01:09.378 Fetching value of define "__AVX__" : 1 00:01:09.378 Fetching value of define "__AVX2__" : 1 00:01:09.378 Fetching value of define "__AVX512BW__" : 1 00:01:09.378 Fetching value of define "__AVX512CD__" : 1 00:01:09.378 Fetching value of define "__AVX512DQ__" : 1 00:01:09.378 Fetching value of define "__AVX512F__" : 1 00:01:09.378 Fetching value of define "__AVX512VL__" : 1 00:01:09.378 Fetching value of define "__PCLMUL__" : 1 00:01:09.378 Fetching value of define "__RDRND__" : 1 00:01:09.378 Fetching value of define "__RDSEED__" : 1 00:01:09.378 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:09.378 Fetching value of define "__znver1__" : (undefined) 00:01:09.378 Fetching value of define "__znver2__" : (undefined) 00:01:09.378 Fetching value of define "__znver3__" : (undefined) 00:01:09.378 Fetching value of define "__znver4__" : (undefined) 00:01:09.378 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:09.378 Message: lib/log: Defining dependency "log" 00:01:09.378 Message: lib/kvargs: Defining dependency "kvargs" 00:01:09.378 Message: lib/telemetry: Defining dependency "telemetry" 00:01:09.378 Checking for function "getentropy" : NO 00:01:09.378 Message: lib/eal: Defining dependency "eal" 00:01:09.378 Message: lib/ring: Defining dependency "ring" 00:01:09.378 Message: lib/rcu: Defining dependency "rcu" 00:01:09.378 Message: lib/mempool: Defining dependency "mempool" 00:01:09.378 Message: lib/mbuf: Defining dependency "mbuf" 00:01:09.378 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:09.378 Fetching value of define "__AVX512F__" : 1 (cached) 00:01:09.378 Fetching value of define "__AVX512BW__" : 1 (cached) 00:01:09.378 Fetching value of define "__AVX512DQ__" : 1 (cached) 00:01:09.378 Fetching value of define "__AVX512VL__" : 1 (cached) 00:01:09.378 Fetching value of define "__VPCLMULQDQ__" : (undefined) (cached) 00:01:09.378 Compiler for C supports arguments -mpclmul: YES 00:01:09.378 Compiler for C supports arguments -maes: YES 00:01:09.378 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:09.378 Compiler for C supports arguments -mavx512bw: YES 00:01:09.378 Compiler for C supports arguments -mavx512dq: YES 00:01:09.378 Compiler for C supports arguments -mavx512vl: YES 00:01:09.378 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:09.378 Compiler for C supports arguments -mavx2: YES 00:01:09.378 Compiler for C supports arguments -mavx: YES 00:01:09.378 Message: lib/net: Defining dependency "net" 00:01:09.378 Message: lib/meter: Defining dependency "meter" 00:01:09.378 Message: lib/ethdev: Defining dependency "ethdev" 00:01:09.378 Message: lib/pci: Defining dependency "pci" 00:01:09.378 Message: lib/cmdline: Defining dependency "cmdline" 00:01:09.378 Message: lib/hash: Defining dependency "hash" 00:01:09.378 Message: lib/timer: Defining dependency "timer" 00:01:09.378 Message: lib/compressdev: Defining dependency "compressdev" 00:01:09.378 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:09.378 Message: lib/dmadev: Defining dependency "dmadev" 00:01:09.378 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:09.378 Message: lib/power: Defining dependency "power" 00:01:09.378 Message: lib/reorder: Defining dependency "reorder" 00:01:09.378 Message: lib/security: Defining dependency "security" 00:01:09.378 Has header "linux/userfaultfd.h" : YES 00:01:09.378 Has header "linux/vduse.h" : YES 00:01:09.378 Message: lib/vhost: Defining dependency "vhost" 00:01:09.378 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:09.378 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:09.378 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:09.378 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:09.378 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:09.378 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:09.378 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:09.378 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:09.378 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:09.378 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:09.378 Program doxygen found: YES (/usr/bin/doxygen) 00:01:09.378 Configuring doxy-api-html.conf using configuration 00:01:09.378 Configuring doxy-api-man.conf using configuration 00:01:09.378 Program mandb found: YES (/usr/bin/mandb) 00:01:09.378 Program sphinx-build found: NO 00:01:09.378 Configuring rte_build_config.h using configuration 00:01:09.378 Message: 00:01:09.378 ================= 00:01:09.378 Applications Enabled 00:01:09.378 ================= 00:01:09.378 00:01:09.378 apps: 00:01:09.378 00:01:09.378 00:01:09.378 Message: 00:01:09.378 ================= 00:01:09.378 Libraries Enabled 00:01:09.378 ================= 00:01:09.378 00:01:09.378 libs: 00:01:09.378 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:09.378 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:09.378 cryptodev, dmadev, power, reorder, security, vhost, 00:01:09.378 00:01:09.378 Message: 00:01:09.378 =============== 00:01:09.378 Drivers Enabled 00:01:09.378 =============== 00:01:09.378 00:01:09.378 common: 00:01:09.378 00:01:09.378 bus: 00:01:09.378 pci, vdev, 00:01:09.378 mempool: 00:01:09.378 ring, 00:01:09.378 dma: 00:01:09.378 00:01:09.378 net: 00:01:09.378 00:01:09.378 crypto: 00:01:09.378 00:01:09.378 compress: 00:01:09.378 00:01:09.378 vdpa: 00:01:09.378 00:01:09.378 00:01:09.378 Message: 00:01:09.378 ================= 00:01:09.378 Content Skipped 00:01:09.378 ================= 00:01:09.378 00:01:09.378 apps: 00:01:09.378 dumpcap: explicitly disabled via build config 00:01:09.378 graph: explicitly disabled via build config 00:01:09.378 pdump: explicitly disabled via build config 00:01:09.378 proc-info: explicitly disabled via build config 00:01:09.378 test-acl: explicitly disabled via build config 00:01:09.378 test-bbdev: explicitly disabled via build config 00:01:09.378 test-cmdline: explicitly disabled via build config 00:01:09.378 test-compress-perf: explicitly disabled via build config 00:01:09.378 test-crypto-perf: explicitly disabled via build config 00:01:09.378 test-dma-perf: explicitly disabled via build config 00:01:09.378 test-eventdev: explicitly disabled via build config 00:01:09.378 test-fib: explicitly disabled via build config 00:01:09.378 test-flow-perf: explicitly disabled via build config 00:01:09.378 test-gpudev: explicitly disabled via build config 00:01:09.378 test-mldev: explicitly disabled via build config 00:01:09.378 test-pipeline: explicitly disabled via build config 00:01:09.378 test-pmd: explicitly disabled via build config 00:01:09.378 test-regex: explicitly disabled via build config 00:01:09.378 test-sad: explicitly disabled via build config 00:01:09.378 test-security-perf: explicitly disabled via build config 00:01:09.378 00:01:09.378 libs: 00:01:09.378 metrics: explicitly disabled via build config 00:01:09.378 acl: explicitly disabled via build config 00:01:09.378 bbdev: explicitly disabled via build config 00:01:09.378 bitratestats: explicitly disabled via build config 00:01:09.378 bpf: explicitly disabled via build config 00:01:09.378 cfgfile: explicitly disabled via build config 00:01:09.378 distributor: explicitly disabled via build config 00:01:09.378 efd: explicitly disabled via build config 00:01:09.378 eventdev: explicitly disabled via build config 00:01:09.378 dispatcher: explicitly disabled via build config 00:01:09.378 gpudev: explicitly disabled via build config 00:01:09.378 gro: explicitly disabled via build config 00:01:09.378 gso: explicitly disabled via build config 00:01:09.378 ip_frag: explicitly disabled via build config 00:01:09.378 jobstats: explicitly disabled via build config 00:01:09.378 latencystats: explicitly disabled via build config 00:01:09.378 lpm: explicitly disabled via build config 00:01:09.378 member: explicitly disabled via build config 00:01:09.378 pcapng: explicitly disabled via build config 00:01:09.378 rawdev: explicitly disabled via build config 00:01:09.378 regexdev: explicitly disabled via build config 00:01:09.378 mldev: explicitly disabled via build config 00:01:09.378 rib: explicitly disabled via build config 00:01:09.378 sched: explicitly disabled via build config 00:01:09.378 stack: explicitly disabled via build config 00:01:09.378 ipsec: explicitly disabled via build config 00:01:09.378 pdcp: explicitly disabled via build config 00:01:09.378 fib: explicitly disabled via build config 00:01:09.378 port: explicitly disabled via build config 00:01:09.378 pdump: explicitly disabled via build config 00:01:09.378 table: explicitly disabled via build config 00:01:09.378 pipeline: explicitly disabled via build config 00:01:09.378 graph: explicitly disabled via build config 00:01:09.378 node: explicitly disabled via build config 00:01:09.378 00:01:09.378 drivers: 00:01:09.378 common/cpt: not in enabled drivers build config 00:01:09.378 common/dpaax: not in enabled drivers build config 00:01:09.378 common/iavf: not in enabled drivers build config 00:01:09.378 common/idpf: not in enabled drivers build config 00:01:09.378 common/mvep: not in enabled drivers build config 00:01:09.378 common/octeontx: not in enabled drivers build config 00:01:09.378 bus/auxiliary: not in enabled drivers build config 00:01:09.378 bus/cdx: not in enabled drivers build config 00:01:09.378 bus/dpaa: not in enabled drivers build config 00:01:09.378 bus/fslmc: not in enabled drivers build config 00:01:09.378 bus/ifpga: not in enabled drivers build config 00:01:09.379 bus/platform: not in enabled drivers build config 00:01:09.379 bus/vmbus: not in enabled drivers build config 00:01:09.379 common/cnxk: not in enabled drivers build config 00:01:09.379 common/mlx5: not in enabled drivers build config 00:01:09.379 common/nfp: not in enabled drivers build config 00:01:09.379 common/qat: not in enabled drivers build config 00:01:09.379 common/sfc_efx: not in enabled drivers build config 00:01:09.379 mempool/bucket: not in enabled drivers build config 00:01:09.379 mempool/cnxk: not in enabled drivers build config 00:01:09.379 mempool/dpaa: not in enabled drivers build config 00:01:09.379 mempool/dpaa2: not in enabled drivers build config 00:01:09.379 mempool/octeontx: not in enabled drivers build config 00:01:09.379 mempool/stack: not in enabled drivers build config 00:01:09.379 dma/cnxk: not in enabled drivers build config 00:01:09.379 dma/dpaa: not in enabled drivers build config 00:01:09.379 dma/dpaa2: not in enabled drivers build config 00:01:09.379 dma/hisilicon: not in enabled drivers build config 00:01:09.379 dma/idxd: not in enabled drivers build config 00:01:09.379 dma/ioat: not in enabled drivers build config 00:01:09.379 dma/skeleton: not in enabled drivers build config 00:01:09.379 net/af_packet: not in enabled drivers build config 00:01:09.379 net/af_xdp: not in enabled drivers build config 00:01:09.379 net/ark: not in enabled drivers build config 00:01:09.379 net/atlantic: not in enabled drivers build config 00:01:09.379 net/avp: not in enabled drivers build config 00:01:09.379 net/axgbe: not in enabled drivers build config 00:01:09.379 net/bnx2x: not in enabled drivers build config 00:01:09.379 net/bnxt: not in enabled drivers build config 00:01:09.379 net/bonding: not in enabled drivers build config 00:01:09.379 net/cnxk: not in enabled drivers build config 00:01:09.379 net/cpfl: not in enabled drivers build config 00:01:09.379 net/cxgbe: not in enabled drivers build config 00:01:09.379 net/dpaa: not in enabled drivers build config 00:01:09.379 net/dpaa2: not in enabled drivers build config 00:01:09.379 net/e1000: not in enabled drivers build config 00:01:09.379 net/ena: not in enabled drivers build config 00:01:09.379 net/enetc: not in enabled drivers build config 00:01:09.379 net/enetfec: not in enabled drivers build config 00:01:09.379 net/enic: not in enabled drivers build config 00:01:09.379 net/failsafe: not in enabled drivers build config 00:01:09.379 net/fm10k: not in enabled drivers build config 00:01:09.379 net/gve: not in enabled drivers build config 00:01:09.379 net/hinic: not in enabled drivers build config 00:01:09.379 net/hns3: not in enabled drivers build config 00:01:09.379 net/i40e: not in enabled drivers build config 00:01:09.379 net/iavf: not in enabled drivers build config 00:01:09.379 net/ice: not in enabled drivers build config 00:01:09.379 net/idpf: not in enabled drivers build config 00:01:09.379 net/igc: not in enabled drivers build config 00:01:09.379 net/ionic: not in enabled drivers build config 00:01:09.379 net/ipn3ke: not in enabled drivers build config 00:01:09.379 net/ixgbe: not in enabled drivers build config 00:01:09.379 net/mana: not in enabled drivers build config 00:01:09.379 net/memif: not in enabled drivers build config 00:01:09.379 net/mlx4: not in enabled drivers build config 00:01:09.379 net/mlx5: not in enabled drivers build config 00:01:09.379 net/mvneta: not in enabled drivers build config 00:01:09.379 net/mvpp2: not in enabled drivers build config 00:01:09.379 net/netvsc: not in enabled drivers build config 00:01:09.379 net/nfb: not in enabled drivers build config 00:01:09.379 net/nfp: not in enabled drivers build config 00:01:09.379 net/ngbe: not in enabled drivers build config 00:01:09.379 net/null: not in enabled drivers build config 00:01:09.379 net/octeontx: not in enabled drivers build config 00:01:09.379 net/octeon_ep: not in enabled drivers build config 00:01:09.379 net/pcap: not in enabled drivers build config 00:01:09.379 net/pfe: not in enabled drivers build config 00:01:09.379 net/qede: not in enabled drivers build config 00:01:09.379 net/ring: not in enabled drivers build config 00:01:09.379 net/sfc: not in enabled drivers build config 00:01:09.379 net/softnic: not in enabled drivers build config 00:01:09.379 net/tap: not in enabled drivers build config 00:01:09.379 net/thunderx: not in enabled drivers build config 00:01:09.379 net/txgbe: not in enabled drivers build config 00:01:09.379 net/vdev_netvsc: not in enabled drivers build config 00:01:09.379 net/vhost: not in enabled drivers build config 00:01:09.379 net/virtio: not in enabled drivers build config 00:01:09.379 net/vmxnet3: not in enabled drivers build config 00:01:09.379 raw/*: missing internal dependency, "rawdev" 00:01:09.379 crypto/armv8: not in enabled drivers build config 00:01:09.379 crypto/bcmfs: not in enabled drivers build config 00:01:09.379 crypto/caam_jr: not in enabled drivers build config 00:01:09.379 crypto/ccp: not in enabled drivers build config 00:01:09.379 crypto/cnxk: not in enabled drivers build config 00:01:09.379 crypto/dpaa_sec: not in enabled drivers build config 00:01:09.379 crypto/dpaa2_sec: not in enabled drivers build config 00:01:09.379 crypto/ipsec_mb: not in enabled drivers build config 00:01:09.379 crypto/mlx5: not in enabled drivers build config 00:01:09.379 crypto/mvsam: not in enabled drivers build config 00:01:09.379 crypto/nitrox: not in enabled drivers build config 00:01:09.379 crypto/null: not in enabled drivers build config 00:01:09.379 crypto/octeontx: not in enabled drivers build config 00:01:09.379 crypto/openssl: not in enabled drivers build config 00:01:09.379 crypto/scheduler: not in enabled drivers build config 00:01:09.379 crypto/uadk: not in enabled drivers build config 00:01:09.379 crypto/virtio: not in enabled drivers build config 00:01:09.379 compress/isal: not in enabled drivers build config 00:01:09.379 compress/mlx5: not in enabled drivers build config 00:01:09.379 compress/octeontx: not in enabled drivers build config 00:01:09.379 compress/zlib: not in enabled drivers build config 00:01:09.379 regex/*: missing internal dependency, "regexdev" 00:01:09.379 ml/*: missing internal dependency, "mldev" 00:01:09.379 vdpa/ifc: not in enabled drivers build config 00:01:09.379 vdpa/mlx5: not in enabled drivers build config 00:01:09.379 vdpa/nfp: not in enabled drivers build config 00:01:09.379 vdpa/sfc: not in enabled drivers build config 00:01:09.379 event/*: missing internal dependency, "eventdev" 00:01:09.379 baseband/*: missing internal dependency, "bbdev" 00:01:09.379 gpu/*: missing internal dependency, "gpudev" 00:01:09.379 00:01:09.379 00:01:09.638 Build targets in project: 85 00:01:09.638 00:01:09.638 DPDK 23.11.0 00:01:09.638 00:01:09.638 User defined options 00:01:09.638 buildtype : debug 00:01:09.638 default_library : shared 00:01:09.638 libdir : lib 00:01:09.638 prefix : /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build 00:01:09.638 c_args : -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds -fPIC -Werror 00:01:09.638 c_link_args : 00:01:09.638 cpu_instruction_set: native 00:01:09.638 disable_apps : test-acl,test-bbdev,test-crypto-perf,test-fib,test-pipeline,test-gpudev,test-flow-perf,pdump,dumpcap,test-sad,test-cmdline,test-eventdev,proc-info,test,test-dma-perf,test-pmd,test-mldev,test-compress-perf,test-security-perf,graph,test-regex 00:01:09.638 disable_libs : pipeline,member,eventdev,efd,bbdev,cfgfile,rib,sched,mldev,metrics,lpm,latencystats,pdump,pdcp,bpf,ipsec,fib,ip_frag,table,port,stack,gro,jobstats,regexdev,rawdev,pcapng,dispatcher,node,bitratestats,acl,gpudev,distributor,graph,gso 00:01:09.638 enable_docs : false 00:01:09.638 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:09.638 enable_kmods : false 00:01:09.638 tests : false 00:01:09.638 00:01:09.638 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:09.897 ninja: Entering directory `/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build-tmp' 00:01:10.163 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:10.163 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:10.163 [3/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:10.163 [4/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:10.163 [5/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:10.163 [6/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:10.163 [7/265] Linking static target lib/librte_kvargs.a 00:01:10.163 [8/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:10.163 [9/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:10.163 [10/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:10.163 [11/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:10.163 [12/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:10.163 [13/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:10.163 [14/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:10.163 [15/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:10.163 [16/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:10.163 [17/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:10.163 [18/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:10.163 [19/265] Linking static target lib/librte_log.a 00:01:10.163 [20/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:10.163 [21/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:10.163 [22/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:10.163 [23/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:10.163 [24/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:10.163 [25/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:10.421 [26/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:10.421 [27/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:10.421 [28/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:10.421 [29/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:10.421 [30/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:10.421 [31/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:10.421 [32/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:10.421 [33/265] Linking static target lib/librte_pci.a 00:01:10.421 [34/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:10.421 [35/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:10.421 [36/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:10.421 [37/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:10.681 [38/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:10.681 [39/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:10.681 [40/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:10.681 [41/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:10.681 [42/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:10.681 [43/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:10.681 [44/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:10.681 [45/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:10.681 [46/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:10.681 [47/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:10.681 [48/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:10.681 [49/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:10.681 [50/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:10.681 [51/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:10.681 [52/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:10.681 [53/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:10.681 [54/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:10.681 [55/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:10.681 [56/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:10.681 [57/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:10.681 [58/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:10.681 [59/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:10.681 [60/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:10.681 [61/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:10.681 [62/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:10.681 [63/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:10.681 [64/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:10.681 [65/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:10.681 [66/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:10.681 [67/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:10.681 [68/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:10.681 [69/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:10.681 [70/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:10.681 [71/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:10.681 [72/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:10.681 [73/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:10.681 [74/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:10.681 [75/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:10.681 [76/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:10.681 [77/265] Linking static target lib/librte_ring.a 00:01:10.681 [78/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:10.681 [79/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:10.681 [80/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:10.681 [81/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:10.681 [82/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:10.681 [83/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:10.681 [84/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:10.681 [85/265] Linking static target lib/librte_meter.a 00:01:10.681 [86/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:10.681 [87/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:10.681 [88/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:10.681 [89/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:10.681 [90/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:10.681 [91/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:10.681 [92/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:10.681 [93/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:10.681 [94/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:10.940 [95/265] Linking static target lib/librte_telemetry.a 00:01:10.940 [96/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:10.940 [97/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:10.940 [98/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:10.940 [99/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:10.940 [100/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:10.940 [101/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:10.940 [102/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:10.940 [103/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:10.940 [104/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:10.940 [105/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:10.940 [106/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:10.940 [107/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:10.940 [108/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:10.940 [109/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:10.940 [110/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:10.940 [111/265] Linking static target lib/librte_cmdline.a 00:01:10.940 [112/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:10.940 [113/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:10.940 [114/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:10.940 [115/265] Linking static target lib/librte_rcu.a 00:01:10.940 [116/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:10.940 [117/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:10.940 [118/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:10.940 [119/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:10.940 [120/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:10.940 [121/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:10.940 [122/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:10.940 [123/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:10.940 [124/265] Linking static target lib/librte_net.a 00:01:10.940 [125/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:10.940 [126/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:10.940 [127/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:10.940 [128/265] Linking static target lib/librte_mempool.a 00:01:10.940 [129/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:10.940 [130/265] Linking static target lib/librte_eal.a 00:01:10.940 [131/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:10.940 [132/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:10.940 [133/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:10.940 [134/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:10.940 [135/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:10.940 [136/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:10.940 [137/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:10.940 [138/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:10.940 [139/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:10.940 [140/265] Linking static target lib/librte_timer.a 00:01:10.940 [141/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:10.940 [142/265] Linking target lib/librte_log.so.24.0 00:01:10.940 [143/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:10.940 [144/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:10.940 [145/265] Linking static target lib/librte_compressdev.a 00:01:10.940 [146/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:11.199 [147/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:11.199 [148/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:11.199 [149/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:11.199 [150/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:11.199 [151/265] Linking static target lib/librte_mbuf.a 00:01:11.199 [152/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:11.199 [153/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:11.199 [154/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:11.199 [155/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:11.199 [156/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:11.199 [157/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:11.199 [158/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:11.199 [159/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:11.199 [160/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:11.199 [161/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:11.199 [162/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:11.199 [163/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:11.199 [164/265] Linking target lib/librte_kvargs.so.24.0 00:01:11.199 [165/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:11.199 [166/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:11.199 [167/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:11.199 [168/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:11.199 [169/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:11.199 [170/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:11.199 [171/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:11.199 [172/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:11.199 [173/265] Linking static target lib/librte_dmadev.a 00:01:11.199 [174/265] Linking target lib/librte_telemetry.so.24.0 00:01:11.199 [175/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:11.199 [176/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:11.199 [177/265] Linking static target lib/librte_reorder.a 00:01:11.199 [178/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:11.199 [179/265] Linking static target lib/librte_power.a 00:01:11.199 [180/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:11.199 [181/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:11.457 [182/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:11.457 [183/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:11.457 [184/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:11.457 [185/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:11.457 [186/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:11.458 [187/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:11.458 [188/265] Linking static target lib/librte_hash.a 00:01:11.458 [189/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:11.458 [190/265] Linking static target lib/librte_security.a 00:01:11.458 [191/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:11.458 [192/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:11.458 [193/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:11.458 [194/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:11.458 [195/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:11.458 [196/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:11.458 [197/265] Linking static target drivers/librte_bus_vdev.a 00:01:11.458 [198/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:11.458 [199/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:11.458 [200/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:11.458 [201/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:11.458 [202/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:11.458 [203/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:11.458 [204/265] Linking static target drivers/librte_bus_pci.a 00:01:11.715 [205/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:11.715 [206/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:11.715 [207/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:11.715 [208/265] Linking static target lib/librte_cryptodev.a 00:01:11.715 [209/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:11.715 [210/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:11.715 [211/265] Linking static target drivers/librte_mempool_ring.a 00:01:11.715 [212/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:11.715 [213/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:11.715 [214/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:11.715 [215/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:11.715 [216/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:11.715 [217/265] Linking static target lib/librte_ethdev.a 00:01:11.715 [218/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:11.715 [219/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:11.973 [220/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:12.231 [221/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:01:12.231 [222/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:12.232 [223/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:12.232 [224/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:13.166 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:01:13.166 [226/265] Linking static target lib/librte_vhost.a 00:01:13.424 [227/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:14.798 [228/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.063 [229/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.063 [230/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.321 [231/265] Linking target lib/librte_eal.so.24.0 00:01:20.321 [232/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:20.321 [233/265] Linking target lib/librte_timer.so.24.0 00:01:20.321 [234/265] Linking target lib/librte_ring.so.24.0 00:01:20.321 [235/265] Linking target lib/librte_meter.so.24.0 00:01:20.321 [236/265] Linking target lib/librte_pci.so.24.0 00:01:20.321 [237/265] Linking target lib/librte_dmadev.so.24.0 00:01:20.321 [238/265] Linking target drivers/librte_bus_vdev.so.24.0 00:01:20.579 [239/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:20.579 [240/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:20.579 [241/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:20.579 [242/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:20.579 [243/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:20.579 [244/265] Linking target lib/librte_rcu.so.24.0 00:01:20.579 [245/265] Linking target lib/librte_mempool.so.24.0 00:01:20.579 [246/265] Linking target drivers/librte_bus_pci.so.24.0 00:01:20.579 [247/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:20.579 [248/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:20.842 [249/265] Linking target drivers/librte_mempool_ring.so.24.0 00:01:20.843 [250/265] Linking target lib/librte_mbuf.so.24.0 00:01:20.843 [251/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:20.843 [252/265] Linking target lib/librte_compressdev.so.24.0 00:01:20.843 [253/265] Linking target lib/librte_net.so.24.0 00:01:20.843 [254/265] Linking target lib/librte_reorder.so.24.0 00:01:20.843 [255/265] Linking target lib/librte_cryptodev.so.24.0 00:01:21.102 [256/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:21.102 [257/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:21.102 [258/265] Linking target lib/librte_security.so.24.0 00:01:21.102 [259/265] Linking target lib/librte_hash.so.24.0 00:01:21.102 [260/265] Linking target lib/librte_cmdline.so.24.0 00:01:21.102 [261/265] Linking target lib/librte_ethdev.so.24.0 00:01:21.102 [262/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:21.359 [263/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:21.359 [264/265] Linking target lib/librte_power.so.24.0 00:01:21.359 [265/265] Linking target lib/librte_vhost.so.24.0 00:01:21.359 INFO: autodetecting backend as ninja 00:01:21.359 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build-tmp -j 96 00:01:22.293 CC lib/log/log.o 00:01:22.293 CC lib/log/log_flags.o 00:01:22.293 CC lib/log/log_deprecated.o 00:01:22.293 CC lib/ut_mock/mock.o 00:01:22.293 CC lib/ut/ut.o 00:01:22.293 LIB libspdk_ut_mock.a 00:01:22.293 LIB libspdk_log.a 00:01:22.293 SO libspdk_ut_mock.so.6.0 00:01:22.293 LIB libspdk_ut.a 00:01:22.293 SO libspdk_log.so.7.0 00:01:22.551 SYMLINK libspdk_ut_mock.so 00:01:22.551 SO libspdk_ut.so.2.0 00:01:22.551 SYMLINK libspdk_log.so 00:01:22.551 SYMLINK libspdk_ut.so 00:01:22.810 CC lib/util/bit_array.o 00:01:22.810 CC lib/util/base64.o 00:01:22.810 CC lib/util/cpuset.o 00:01:22.810 CC lib/util/crc16.o 00:01:22.810 CC lib/util/crc32.o 00:01:22.810 CC lib/util/crc32c.o 00:01:22.810 CC lib/util/crc32_ieee.o 00:01:22.810 CC lib/util/crc64.o 00:01:22.810 CC lib/util/dif.o 00:01:22.810 CC lib/util/fd.o 00:01:22.810 CC lib/util/file.o 00:01:22.810 CC lib/util/hexlify.o 00:01:22.810 CC lib/util/iov.o 00:01:22.810 CC lib/util/math.o 00:01:22.810 CC lib/util/string.o 00:01:22.810 CC lib/util/pipe.o 00:01:22.810 CC lib/util/strerror_tls.o 00:01:22.810 CC lib/util/uuid.o 00:01:22.810 CC lib/util/fd_group.o 00:01:22.810 CC lib/util/xor.o 00:01:22.810 CC lib/util/zipf.o 00:01:22.810 CC lib/dma/dma.o 00:01:22.810 CC lib/ioat/ioat.o 00:01:22.810 CXX lib/trace_parser/trace.o 00:01:22.810 CC lib/vfio_user/host/vfio_user_pci.o 00:01:22.810 CC lib/vfio_user/host/vfio_user.o 00:01:22.811 LIB libspdk_dma.a 00:01:23.069 SO libspdk_dma.so.4.0 00:01:23.069 LIB libspdk_ioat.a 00:01:23.069 SYMLINK libspdk_dma.so 00:01:23.069 SO libspdk_ioat.so.7.0 00:01:23.069 SYMLINK libspdk_ioat.so 00:01:23.069 LIB libspdk_vfio_user.a 00:01:23.069 LIB libspdk_util.a 00:01:23.069 SO libspdk_vfio_user.so.5.0 00:01:23.327 SO libspdk_util.so.9.0 00:01:23.327 SYMLINK libspdk_vfio_user.so 00:01:23.327 SYMLINK libspdk_util.so 00:01:23.327 LIB libspdk_trace_parser.a 00:01:23.584 SO libspdk_trace_parser.so.5.0 00:01:23.584 SYMLINK libspdk_trace_parser.so 00:01:23.584 CC lib/conf/conf.o 00:01:23.584 CC lib/json/json_parse.o 00:01:23.584 CC lib/json/json_util.o 00:01:23.584 CC lib/json/json_write.o 00:01:23.584 CC lib/vmd/led.o 00:01:23.584 CC lib/vmd/vmd.o 00:01:23.584 CC lib/env_dpdk/env.o 00:01:23.584 CC lib/env_dpdk/pci.o 00:01:23.584 CC lib/env_dpdk/memory.o 00:01:23.584 CC lib/idxd/idxd.o 00:01:23.584 CC lib/env_dpdk/init.o 00:01:23.584 CC lib/idxd/idxd_user.o 00:01:23.584 CC lib/env_dpdk/threads.o 00:01:23.584 CC lib/env_dpdk/pci_ioat.o 00:01:23.584 CC lib/env_dpdk/pci_virtio.o 00:01:23.584 CC lib/rdma/common.o 00:01:23.585 CC lib/env_dpdk/pci_vmd.o 00:01:23.585 CC lib/rdma/rdma_verbs.o 00:01:23.585 CC lib/env_dpdk/pci_idxd.o 00:01:23.585 CC lib/env_dpdk/pci_event.o 00:01:23.585 CC lib/env_dpdk/pci_dpdk_2211.o 00:01:23.585 CC lib/env_dpdk/sigbus_handler.o 00:01:23.585 CC lib/env_dpdk/pci_dpdk.o 00:01:23.585 CC lib/env_dpdk/pci_dpdk_2207.o 00:01:23.842 LIB libspdk_conf.a 00:01:23.842 SO libspdk_conf.so.6.0 00:01:23.842 LIB libspdk_json.a 00:01:23.842 LIB libspdk_rdma.a 00:01:23.842 SO libspdk_json.so.6.0 00:01:23.842 SYMLINK libspdk_conf.so 00:01:23.842 SO libspdk_rdma.so.6.0 00:01:23.842 SYMLINK libspdk_json.so 00:01:24.099 SYMLINK libspdk_rdma.so 00:01:24.099 LIB libspdk_idxd.a 00:01:24.099 SO libspdk_idxd.so.12.0 00:01:24.099 LIB libspdk_vmd.a 00:01:24.099 SYMLINK libspdk_idxd.so 00:01:24.099 SO libspdk_vmd.so.6.0 00:01:24.099 SYMLINK libspdk_vmd.so 00:01:24.357 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:01:24.357 CC lib/jsonrpc/jsonrpc_server.o 00:01:24.357 CC lib/jsonrpc/jsonrpc_client.o 00:01:24.357 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:01:24.357 LIB libspdk_jsonrpc.a 00:01:24.613 SO libspdk_jsonrpc.so.6.0 00:01:24.613 SYMLINK libspdk_jsonrpc.so 00:01:24.613 LIB libspdk_env_dpdk.a 00:01:24.613 SO libspdk_env_dpdk.so.14.0 00:01:24.870 SYMLINK libspdk_env_dpdk.so 00:01:24.870 CC lib/rpc/rpc.o 00:01:25.127 LIB libspdk_rpc.a 00:01:25.127 SO libspdk_rpc.so.6.0 00:01:25.127 SYMLINK libspdk_rpc.so 00:01:25.401 CC lib/trace/trace.o 00:01:25.401 CC lib/trace/trace_flags.o 00:01:25.401 CC lib/trace/trace_rpc.o 00:01:25.401 CC lib/notify/notify.o 00:01:25.401 CC lib/notify/notify_rpc.o 00:01:25.401 CC lib/keyring/keyring.o 00:01:25.401 CC lib/keyring/keyring_rpc.o 00:01:25.718 LIB libspdk_notify.a 00:01:25.718 LIB libspdk_trace.a 00:01:25.718 SO libspdk_notify.so.6.0 00:01:25.718 SO libspdk_trace.so.10.0 00:01:25.718 LIB libspdk_keyring.a 00:01:25.718 SO libspdk_keyring.so.1.0 00:01:25.718 SYMLINK libspdk_notify.so 00:01:25.718 SYMLINK libspdk_trace.so 00:01:25.718 SYMLINK libspdk_keyring.so 00:01:25.987 CC lib/thread/thread.o 00:01:25.987 CC lib/thread/iobuf.o 00:01:25.987 CC lib/sock/sock.o 00:01:25.987 CC lib/sock/sock_rpc.o 00:01:26.244 LIB libspdk_sock.a 00:01:26.244 SO libspdk_sock.so.9.0 00:01:26.244 SYMLINK libspdk_sock.so 00:01:26.809 CC lib/nvme/nvme_ctrlr_cmd.o 00:01:26.809 CC lib/nvme/nvme_ctrlr.o 00:01:26.809 CC lib/nvme/nvme_fabric.o 00:01:26.809 CC lib/nvme/nvme_ns_cmd.o 00:01:26.809 CC lib/nvme/nvme_ns.o 00:01:26.809 CC lib/nvme/nvme_pcie_common.o 00:01:26.809 CC lib/nvme/nvme_pcie.o 00:01:26.809 CC lib/nvme/nvme_qpair.o 00:01:26.809 CC lib/nvme/nvme.o 00:01:26.809 CC lib/nvme/nvme_quirks.o 00:01:26.810 CC lib/nvme/nvme_transport.o 00:01:26.810 CC lib/nvme/nvme_discovery.o 00:01:26.810 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:01:26.810 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:01:26.810 CC lib/nvme/nvme_tcp.o 00:01:26.810 CC lib/nvme/nvme_opal.o 00:01:26.810 CC lib/nvme/nvme_io_msg.o 00:01:26.810 CC lib/nvme/nvme_poll_group.o 00:01:26.810 CC lib/nvme/nvme_zns.o 00:01:26.810 CC lib/nvme/nvme_cuse.o 00:01:26.810 CC lib/nvme/nvme_stubs.o 00:01:26.810 CC lib/nvme/nvme_auth.o 00:01:26.810 CC lib/nvme/nvme_rdma.o 00:01:27.067 LIB libspdk_thread.a 00:01:27.067 SO libspdk_thread.so.10.0 00:01:27.067 SYMLINK libspdk_thread.so 00:01:27.325 CC lib/accel/accel.o 00:01:27.325 CC lib/accel/accel_rpc.o 00:01:27.325 CC lib/accel/accel_sw.o 00:01:27.325 CC lib/virtio/virtio_vhost_user.o 00:01:27.325 CC lib/virtio/virtio.o 00:01:27.325 CC lib/virtio/virtio_pci.o 00:01:27.325 CC lib/virtio/virtio_vfio_user.o 00:01:27.325 CC lib/blob/blob_bs_dev.o 00:01:27.325 CC lib/blob/blobstore.o 00:01:27.325 CC lib/blob/request.o 00:01:27.325 CC lib/blob/zeroes.o 00:01:27.325 CC lib/init/json_config.o 00:01:27.325 CC lib/init/subsystem.o 00:01:27.325 CC lib/init/subsystem_rpc.o 00:01:27.325 CC lib/init/rpc.o 00:01:27.582 LIB libspdk_init.a 00:01:27.582 SO libspdk_init.so.5.0 00:01:27.582 LIB libspdk_virtio.a 00:01:27.582 SO libspdk_virtio.so.7.0 00:01:27.582 SYMLINK libspdk_init.so 00:01:27.840 SYMLINK libspdk_virtio.so 00:01:28.097 CC lib/event/app.o 00:01:28.097 CC lib/event/log_rpc.o 00:01:28.098 CC lib/event/reactor.o 00:01:28.098 CC lib/event/app_rpc.o 00:01:28.098 CC lib/event/scheduler_static.o 00:01:28.098 LIB libspdk_accel.a 00:01:28.098 SO libspdk_accel.so.15.0 00:01:28.355 SYMLINK libspdk_accel.so 00:01:28.355 LIB libspdk_nvme.a 00:01:28.355 LIB libspdk_event.a 00:01:28.355 SO libspdk_event.so.13.0 00:01:28.355 SO libspdk_nvme.so.13.0 00:01:28.355 SYMLINK libspdk_event.so 00:01:28.355 CC lib/bdev/bdev_rpc.o 00:01:28.355 CC lib/bdev/bdev_zone.o 00:01:28.355 CC lib/bdev/bdev.o 00:01:28.355 CC lib/bdev/part.o 00:01:28.355 CC lib/bdev/scsi_nvme.o 00:01:28.621 SYMLINK libspdk_nvme.so 00:01:29.189 LIB libspdk_blob.a 00:01:29.446 SO libspdk_blob.so.11.0 00:01:29.446 SYMLINK libspdk_blob.so 00:01:29.704 CC lib/lvol/lvol.o 00:01:29.704 CC lib/blobfs/blobfs.o 00:01:29.704 CC lib/blobfs/tree.o 00:01:30.268 LIB libspdk_bdev.a 00:01:30.268 SO libspdk_bdev.so.15.0 00:01:30.268 LIB libspdk_blobfs.a 00:01:30.268 SO libspdk_blobfs.so.10.0 00:01:30.268 SYMLINK libspdk_bdev.so 00:01:30.268 LIB libspdk_lvol.a 00:01:30.268 SO libspdk_lvol.so.10.0 00:01:30.268 SYMLINK libspdk_blobfs.so 00:01:30.526 SYMLINK libspdk_lvol.so 00:01:30.526 CC lib/scsi/dev.o 00:01:30.526 CC lib/scsi/lun.o 00:01:30.526 CC lib/scsi/port.o 00:01:30.526 CC lib/scsi/scsi_rpc.o 00:01:30.526 CC lib/scsi/scsi.o 00:01:30.526 CC lib/scsi/scsi_bdev.o 00:01:30.526 CC lib/scsi/scsi_pr.o 00:01:30.526 CC lib/scsi/task.o 00:01:30.526 CC lib/nbd/nbd.o 00:01:30.526 CC lib/nbd/nbd_rpc.o 00:01:30.526 CC lib/ftl/ftl_core.o 00:01:30.526 CC lib/ftl/ftl_init.o 00:01:30.526 CC lib/ftl/ftl_layout.o 00:01:30.526 CC lib/ftl/ftl_debug.o 00:01:30.526 CC lib/ftl/ftl_io.o 00:01:30.526 CC lib/ftl/ftl_sb.o 00:01:30.526 CC lib/ftl/ftl_l2p.o 00:01:30.526 CC lib/ftl/ftl_l2p_flat.o 00:01:30.526 CC lib/ftl/ftl_nv_cache.o 00:01:30.526 CC lib/ftl/ftl_band_ops.o 00:01:30.526 CC lib/nvmf/ctrlr.o 00:01:30.526 CC lib/ftl/ftl_band.o 00:01:30.526 CC lib/ftl/ftl_rq.o 00:01:30.526 CC lib/nvmf/ctrlr_discovery.o 00:01:30.526 CC lib/ftl/ftl_writer.o 00:01:30.526 CC lib/nvmf/ctrlr_bdev.o 00:01:30.526 CC lib/nvmf/subsystem.o 00:01:30.526 CC lib/nvmf/nvmf.o 00:01:30.526 CC lib/ftl/ftl_reloc.o 00:01:30.526 CC lib/ftl/ftl_l2p_cache.o 00:01:30.526 CC lib/nvmf/nvmf_rpc.o 00:01:30.526 CC lib/ublk/ublk.o 00:01:30.526 CC lib/ftl/ftl_p2l.o 00:01:30.526 CC lib/ftl/mngt/ftl_mngt.o 00:01:30.526 CC lib/ublk/ublk_rpc.o 00:01:30.526 CC lib/nvmf/transport.o 00:01:30.526 CC lib/nvmf/tcp.o 00:01:30.526 CC lib/nvmf/rdma.o 00:01:30.526 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:01:30.526 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:01:30.526 CC lib/ftl/mngt/ftl_mngt_startup.o 00:01:30.526 CC lib/ftl/mngt/ftl_mngt_md.o 00:01:30.526 CC lib/ftl/mngt/ftl_mngt_misc.o 00:01:30.526 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:01:30.526 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:01:30.526 CC lib/ftl/mngt/ftl_mngt_band.o 00:01:30.526 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:01:30.526 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:01:30.526 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:01:30.526 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:01:30.526 CC lib/ftl/utils/ftl_conf.o 00:01:30.526 CC lib/ftl/utils/ftl_md.o 00:01:30.526 CC lib/ftl/utils/ftl_mempool.o 00:01:30.526 CC lib/ftl/utils/ftl_bitmap.o 00:01:30.526 CC lib/ftl/utils/ftl_property.o 00:01:30.526 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:01:30.526 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:01:30.526 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:01:30.526 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:01:30.526 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:01:30.526 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:01:30.526 CC lib/ftl/upgrade/ftl_sb_v5.o 00:01:30.526 CC lib/ftl/upgrade/ftl_sb_v3.o 00:01:30.526 CC lib/ftl/nvc/ftl_nvc_dev.o 00:01:30.526 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:01:30.526 CC lib/ftl/base/ftl_base_dev.o 00:01:30.526 CC lib/ftl/base/ftl_base_bdev.o 00:01:30.786 CC lib/ftl/ftl_trace.o 00:01:31.046 LIB libspdk_nbd.a 00:01:31.046 SO libspdk_nbd.so.7.0 00:01:31.304 SYMLINK libspdk_nbd.so 00:01:31.304 LIB libspdk_scsi.a 00:01:31.304 SO libspdk_scsi.so.9.0 00:01:31.304 SYMLINK libspdk_scsi.so 00:01:31.304 LIB libspdk_ublk.a 00:01:31.304 SO libspdk_ublk.so.3.0 00:01:31.563 LIB libspdk_ftl.a 00:01:31.563 SYMLINK libspdk_ublk.so 00:01:31.563 SO libspdk_ftl.so.9.0 00:01:31.563 CC lib/iscsi/conn.o 00:01:31.563 CC lib/iscsi/iscsi.o 00:01:31.563 CC lib/iscsi/init_grp.o 00:01:31.563 CC lib/iscsi/md5.o 00:01:31.563 CC lib/iscsi/param.o 00:01:31.563 CC lib/iscsi/portal_grp.o 00:01:31.563 CC lib/iscsi/iscsi_rpc.o 00:01:31.563 CC lib/iscsi/tgt_node.o 00:01:31.563 CC lib/iscsi/iscsi_subsystem.o 00:01:31.563 CC lib/iscsi/task.o 00:01:31.563 CC lib/vhost/vhost.o 00:01:31.563 CC lib/vhost/vhost_rpc.o 00:01:31.563 CC lib/vhost/vhost_scsi.o 00:01:31.563 CC lib/vhost/vhost_blk.o 00:01:31.563 CC lib/vhost/rte_vhost_user.o 00:01:31.820 SYMLINK libspdk_ftl.so 00:01:32.387 LIB libspdk_nvmf.a 00:01:32.387 SO libspdk_nvmf.so.18.0 00:01:32.387 LIB libspdk_vhost.a 00:01:32.387 SO libspdk_vhost.so.8.0 00:01:32.387 SYMLINK libspdk_nvmf.so 00:01:32.646 SYMLINK libspdk_vhost.so 00:01:32.646 LIB libspdk_iscsi.a 00:01:32.646 SO libspdk_iscsi.so.8.0 00:01:32.646 SYMLINK libspdk_iscsi.so 00:01:33.214 CC module/env_dpdk/env_dpdk_rpc.o 00:01:33.214 CC module/accel/error/accel_error.o 00:01:33.214 CC module/accel/error/accel_error_rpc.o 00:01:33.214 CC module/accel/ioat/accel_ioat.o 00:01:33.214 CC module/accel/ioat/accel_ioat_rpc.o 00:01:33.214 CC module/keyring/file/keyring.o 00:01:33.214 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:01:33.214 LIB libspdk_env_dpdk_rpc.a 00:01:33.214 CC module/keyring/file/keyring_rpc.o 00:01:33.214 CC module/scheduler/dynamic/scheduler_dynamic.o 00:01:33.214 CC module/accel/iaa/accel_iaa.o 00:01:33.214 CC module/accel/iaa/accel_iaa_rpc.o 00:01:33.214 CC module/blob/bdev/blob_bdev.o 00:01:33.214 CC module/scheduler/gscheduler/gscheduler.o 00:01:33.214 CC module/accel/dsa/accel_dsa.o 00:01:33.214 CC module/accel/dsa/accel_dsa_rpc.o 00:01:33.214 CC module/sock/posix/posix.o 00:01:33.472 SO libspdk_env_dpdk_rpc.so.6.0 00:01:33.472 SYMLINK libspdk_env_dpdk_rpc.so 00:01:33.472 LIB libspdk_keyring_file.a 00:01:33.472 SO libspdk_keyring_file.so.1.0 00:01:33.472 LIB libspdk_scheduler_gscheduler.a 00:01:33.472 LIB libspdk_scheduler_dpdk_governor.a 00:01:33.472 LIB libspdk_accel_error.a 00:01:33.472 LIB libspdk_accel_ioat.a 00:01:33.472 SO libspdk_scheduler_dpdk_governor.so.4.0 00:01:33.472 SO libspdk_scheduler_gscheduler.so.4.0 00:01:33.472 LIB libspdk_scheduler_dynamic.a 00:01:33.472 LIB libspdk_accel_iaa.a 00:01:33.472 SYMLINK libspdk_keyring_file.so 00:01:33.472 SO libspdk_accel_error.so.2.0 00:01:33.472 LIB libspdk_accel_dsa.a 00:01:33.472 SO libspdk_accel_ioat.so.6.0 00:01:33.472 SO libspdk_scheduler_dynamic.so.4.0 00:01:33.472 SO libspdk_accel_iaa.so.3.0 00:01:33.472 SYMLINK libspdk_scheduler_dpdk_governor.so 00:01:33.472 SYMLINK libspdk_scheduler_gscheduler.so 00:01:33.472 SO libspdk_accel_dsa.so.5.0 00:01:33.472 LIB libspdk_blob_bdev.a 00:01:33.472 SYMLINK libspdk_accel_error.so 00:01:33.730 SYMLINK libspdk_scheduler_dynamic.so 00:01:33.730 SYMLINK libspdk_accel_ioat.so 00:01:33.730 SO libspdk_blob_bdev.so.11.0 00:01:33.730 SYMLINK libspdk_accel_iaa.so 00:01:33.730 SYMLINK libspdk_accel_dsa.so 00:01:33.730 SYMLINK libspdk_blob_bdev.so 00:01:33.988 LIB libspdk_sock_posix.a 00:01:33.988 SO libspdk_sock_posix.so.6.0 00:01:33.988 SYMLINK libspdk_sock_posix.so 00:01:33.988 CC module/bdev/nvme/bdev_nvme.o 00:01:33.988 CC module/bdev/nvme/nvme_rpc.o 00:01:33.988 CC module/bdev/nvme/bdev_nvme_rpc.o 00:01:33.988 CC module/bdev/nvme/bdev_mdns_client.o 00:01:33.988 CC module/bdev/nvme/vbdev_opal.o 00:01:33.988 CC module/bdev/nvme/vbdev_opal_rpc.o 00:01:33.988 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:01:33.988 CC module/bdev/error/vbdev_error.o 00:01:33.988 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:01:33.988 CC module/bdev/zone_block/vbdev_zone_block.o 00:01:33.988 CC module/bdev/error/vbdev_error_rpc.o 00:01:33.988 CC module/blobfs/bdev/blobfs_bdev.o 00:01:33.988 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:01:33.988 CC module/bdev/lvol/vbdev_lvol.o 00:01:33.988 CC module/bdev/delay/vbdev_delay.o 00:01:33.989 CC module/bdev/delay/vbdev_delay_rpc.o 00:01:33.989 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:01:33.989 CC module/bdev/null/bdev_null.o 00:01:33.989 CC module/bdev/virtio/bdev_virtio_scsi.o 00:01:33.989 CC module/bdev/virtio/bdev_virtio_blk.o 00:01:33.989 CC module/bdev/null/bdev_null_rpc.o 00:01:33.989 CC module/bdev/virtio/bdev_virtio_rpc.o 00:01:33.989 CC module/bdev/gpt/gpt.o 00:01:33.989 CC module/bdev/split/vbdev_split.o 00:01:33.989 CC module/bdev/raid/bdev_raid_rpc.o 00:01:33.989 CC module/bdev/gpt/vbdev_gpt.o 00:01:33.989 CC module/bdev/aio/bdev_aio.o 00:01:33.989 CC module/bdev/split/vbdev_split_rpc.o 00:01:33.989 CC module/bdev/raid/bdev_raid_sb.o 00:01:33.989 CC module/bdev/raid/bdev_raid.o 00:01:33.989 CC module/bdev/aio/bdev_aio_rpc.o 00:01:33.989 CC module/bdev/iscsi/bdev_iscsi.o 00:01:33.989 CC module/bdev/raid/raid0.o 00:01:33.989 CC module/bdev/raid/raid1.o 00:01:33.989 CC module/bdev/passthru/vbdev_passthru.o 00:01:33.989 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:01:33.989 CC module/bdev/malloc/bdev_malloc.o 00:01:33.989 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:01:34.247 CC module/bdev/raid/concat.o 00:01:34.247 CC module/bdev/malloc/bdev_malloc_rpc.o 00:01:34.247 CC module/bdev/ftl/bdev_ftl.o 00:01:34.247 CC module/bdev/ftl/bdev_ftl_rpc.o 00:01:34.247 LIB libspdk_blobfs_bdev.a 00:01:34.247 SO libspdk_blobfs_bdev.so.6.0 00:01:34.505 LIB libspdk_bdev_error.a 00:01:34.505 LIB libspdk_bdev_split.a 00:01:34.505 LIB libspdk_bdev_gpt.a 00:01:34.505 LIB libspdk_bdev_null.a 00:01:34.505 SO libspdk_bdev_error.so.6.0 00:01:34.505 SYMLINK libspdk_blobfs_bdev.so 00:01:34.505 SO libspdk_bdev_split.so.6.0 00:01:34.505 LIB libspdk_bdev_ftl.a 00:01:34.505 LIB libspdk_bdev_passthru.a 00:01:34.505 LIB libspdk_bdev_zone_block.a 00:01:34.505 SO libspdk_bdev_gpt.so.6.0 00:01:34.505 SO libspdk_bdev_null.so.6.0 00:01:34.505 LIB libspdk_bdev_aio.a 00:01:34.505 SYMLINK libspdk_bdev_error.so 00:01:34.505 SO libspdk_bdev_ftl.so.6.0 00:01:34.505 SO libspdk_bdev_passthru.so.6.0 00:01:34.505 SO libspdk_bdev_zone_block.so.6.0 00:01:34.505 SYMLINK libspdk_bdev_split.so 00:01:34.505 LIB libspdk_bdev_malloc.a 00:01:34.505 LIB libspdk_bdev_iscsi.a 00:01:34.505 LIB libspdk_bdev_delay.a 00:01:34.505 SYMLINK libspdk_bdev_gpt.so 00:01:34.505 SO libspdk_bdev_aio.so.6.0 00:01:34.505 SYMLINK libspdk_bdev_null.so 00:01:34.505 SO libspdk_bdev_iscsi.so.6.0 00:01:34.505 SO libspdk_bdev_malloc.so.6.0 00:01:34.505 SYMLINK libspdk_bdev_passthru.so 00:01:34.505 SO libspdk_bdev_delay.so.6.0 00:01:34.505 SYMLINK libspdk_bdev_zone_block.so 00:01:34.505 SYMLINK libspdk_bdev_ftl.so 00:01:34.505 LIB libspdk_bdev_lvol.a 00:01:34.505 SYMLINK libspdk_bdev_aio.so 00:01:34.505 SYMLINK libspdk_bdev_iscsi.so 00:01:34.505 SYMLINK libspdk_bdev_delay.so 00:01:34.505 SO libspdk_bdev_lvol.so.6.0 00:01:34.505 SYMLINK libspdk_bdev_malloc.so 00:01:34.505 LIB libspdk_bdev_virtio.a 00:01:34.763 SYMLINK libspdk_bdev_lvol.so 00:01:34.763 SO libspdk_bdev_virtio.so.6.0 00:01:34.763 SYMLINK libspdk_bdev_virtio.so 00:01:35.021 LIB libspdk_bdev_raid.a 00:01:35.021 SO libspdk_bdev_raid.so.6.0 00:01:35.021 SYMLINK libspdk_bdev_raid.so 00:01:35.587 LIB libspdk_bdev_nvme.a 00:01:35.588 SO libspdk_bdev_nvme.so.7.0 00:01:35.854 SYMLINK libspdk_bdev_nvme.so 00:01:36.434 CC module/event/subsystems/sock/sock.o 00:01:36.434 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:01:36.434 CC module/event/subsystems/iobuf/iobuf.o 00:01:36.434 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:01:36.434 CC module/event/subsystems/scheduler/scheduler.o 00:01:36.434 CC module/event/subsystems/keyring/keyring.o 00:01:36.434 CC module/event/subsystems/vmd/vmd.o 00:01:36.434 CC module/event/subsystems/vmd/vmd_rpc.o 00:01:36.434 LIB libspdk_event_vhost_blk.a 00:01:36.434 LIB libspdk_event_sock.a 00:01:36.434 LIB libspdk_event_scheduler.a 00:01:36.434 SO libspdk_event_vhost_blk.so.3.0 00:01:36.434 SO libspdk_event_sock.so.5.0 00:01:36.434 LIB libspdk_event_iobuf.a 00:01:36.434 LIB libspdk_event_keyring.a 00:01:36.434 LIB libspdk_event_vmd.a 00:01:36.434 SO libspdk_event_scheduler.so.4.0 00:01:36.434 SO libspdk_event_keyring.so.1.0 00:01:36.434 SO libspdk_event_iobuf.so.3.0 00:01:36.693 SYMLINK libspdk_event_vhost_blk.so 00:01:36.693 SO libspdk_event_vmd.so.6.0 00:01:36.693 SYMLINK libspdk_event_sock.so 00:01:36.693 SYMLINK libspdk_event_scheduler.so 00:01:36.693 SYMLINK libspdk_event_keyring.so 00:01:36.693 SYMLINK libspdk_event_iobuf.so 00:01:36.693 SYMLINK libspdk_event_vmd.so 00:01:36.951 CC module/event/subsystems/accel/accel.o 00:01:36.951 LIB libspdk_event_accel.a 00:01:37.210 SO libspdk_event_accel.so.6.0 00:01:37.210 SYMLINK libspdk_event_accel.so 00:01:37.468 CC module/event/subsystems/bdev/bdev.o 00:01:37.468 LIB libspdk_event_bdev.a 00:01:37.726 SO libspdk_event_bdev.so.6.0 00:01:37.726 SYMLINK libspdk_event_bdev.so 00:01:37.984 CC module/event/subsystems/scsi/scsi.o 00:01:37.984 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:01:37.984 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:01:37.984 CC module/event/subsystems/nbd/nbd.o 00:01:37.984 CC module/event/subsystems/ublk/ublk.o 00:01:37.984 LIB libspdk_event_scsi.a 00:01:37.984 SO libspdk_event_scsi.so.6.0 00:01:38.243 LIB libspdk_event_nbd.a 00:01:38.243 LIB libspdk_event_ublk.a 00:01:38.243 SO libspdk_event_nbd.so.6.0 00:01:38.243 LIB libspdk_event_nvmf.a 00:01:38.243 SO libspdk_event_ublk.so.3.0 00:01:38.243 SYMLINK libspdk_event_scsi.so 00:01:38.243 SO libspdk_event_nvmf.so.6.0 00:01:38.243 SYMLINK libspdk_event_nbd.so 00:01:38.243 SYMLINK libspdk_event_ublk.so 00:01:38.243 SYMLINK libspdk_event_nvmf.so 00:01:38.501 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:01:38.501 CC module/event/subsystems/iscsi/iscsi.o 00:01:38.501 LIB libspdk_event_vhost_scsi.a 00:01:38.501 LIB libspdk_event_iscsi.a 00:01:38.501 SO libspdk_event_vhost_scsi.so.3.0 00:01:38.758 SO libspdk_event_iscsi.so.6.0 00:01:38.758 SYMLINK libspdk_event_vhost_scsi.so 00:01:38.758 SYMLINK libspdk_event_iscsi.so 00:01:38.758 SO libspdk.so.6.0 00:01:38.758 SYMLINK libspdk.so 00:01:39.326 CC app/spdk_nvme_perf/perf.o 00:01:39.326 CC app/trace_record/trace_record.o 00:01:39.326 CC app/spdk_lspci/spdk_lspci.o 00:01:39.326 CC app/spdk_nvme_identify/identify.o 00:01:39.326 TEST_HEADER include/spdk/accel.h 00:01:39.326 TEST_HEADER include/spdk/accel_module.h 00:01:39.326 CXX app/trace/trace.o 00:01:39.326 TEST_HEADER include/spdk/assert.h 00:01:39.326 TEST_HEADER include/spdk/base64.h 00:01:39.326 TEST_HEADER include/spdk/barrier.h 00:01:39.326 TEST_HEADER include/spdk/bdev.h 00:01:39.326 TEST_HEADER include/spdk/bdev_module.h 00:01:39.326 TEST_HEADER include/spdk/bdev_zone.h 00:01:39.326 TEST_HEADER include/spdk/bit_array.h 00:01:39.326 TEST_HEADER include/spdk/bit_pool.h 00:01:39.326 CC test/rpc_client/rpc_client_test.o 00:01:39.326 TEST_HEADER include/spdk/blob_bdev.h 00:01:39.326 CC app/spdk_nvme_discover/discovery_aer.o 00:01:39.326 TEST_HEADER include/spdk/blobfs.h 00:01:39.326 TEST_HEADER include/spdk/blobfs_bdev.h 00:01:39.326 TEST_HEADER include/spdk/blob.h 00:01:39.326 TEST_HEADER include/spdk/conf.h 00:01:39.326 TEST_HEADER include/spdk/config.h 00:01:39.326 TEST_HEADER include/spdk/crc16.h 00:01:39.326 TEST_HEADER include/spdk/cpuset.h 00:01:39.326 TEST_HEADER include/spdk/crc32.h 00:01:39.326 TEST_HEADER include/spdk/crc64.h 00:01:39.326 TEST_HEADER include/spdk/dif.h 00:01:39.326 CC app/spdk_top/spdk_top.o 00:01:39.326 TEST_HEADER include/spdk/endian.h 00:01:39.326 TEST_HEADER include/spdk/dma.h 00:01:39.326 TEST_HEADER include/spdk/env_dpdk.h 00:01:39.326 TEST_HEADER include/spdk/env.h 00:01:39.326 TEST_HEADER include/spdk/event.h 00:01:39.326 CC app/spdk_dd/spdk_dd.o 00:01:39.326 TEST_HEADER include/spdk/fd_group.h 00:01:39.326 TEST_HEADER include/spdk/fd.h 00:01:39.326 TEST_HEADER include/spdk/file.h 00:01:39.326 TEST_HEADER include/spdk/ftl.h 00:01:39.326 TEST_HEADER include/spdk/gpt_spec.h 00:01:39.326 TEST_HEADER include/spdk/idxd.h 00:01:39.326 TEST_HEADER include/spdk/hexlify.h 00:01:39.326 TEST_HEADER include/spdk/idxd_spec.h 00:01:39.326 TEST_HEADER include/spdk/histogram_data.h 00:01:39.326 TEST_HEADER include/spdk/ioat.h 00:01:39.326 TEST_HEADER include/spdk/init.h 00:01:39.326 TEST_HEADER include/spdk/iscsi_spec.h 00:01:39.326 TEST_HEADER include/spdk/ioat_spec.h 00:01:39.326 TEST_HEADER include/spdk/json.h 00:01:39.326 TEST_HEADER include/spdk/jsonrpc.h 00:01:39.326 TEST_HEADER include/spdk/keyring.h 00:01:39.326 CC examples/interrupt_tgt/interrupt_tgt.o 00:01:39.326 TEST_HEADER include/spdk/keyring_module.h 00:01:39.326 TEST_HEADER include/spdk/likely.h 00:01:39.326 TEST_HEADER include/spdk/lvol.h 00:01:39.326 TEST_HEADER include/spdk/log.h 00:01:39.326 TEST_HEADER include/spdk/nbd.h 00:01:39.326 TEST_HEADER include/spdk/mmio.h 00:01:39.326 TEST_HEADER include/spdk/memory.h 00:01:39.326 TEST_HEADER include/spdk/notify.h 00:01:39.326 CC app/nvmf_tgt/nvmf_main.o 00:01:39.326 TEST_HEADER include/spdk/nvme.h 00:01:39.326 TEST_HEADER include/spdk/nvme_intel.h 00:01:39.326 TEST_HEADER include/spdk/nvme_ocssd.h 00:01:39.326 CC app/vhost/vhost.o 00:01:39.326 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:01:39.326 TEST_HEADER include/spdk/nvme_spec.h 00:01:39.326 TEST_HEADER include/spdk/nvmf_cmd.h 00:01:39.326 TEST_HEADER include/spdk/nvme_zns.h 00:01:39.326 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:01:39.326 TEST_HEADER include/spdk/nvmf.h 00:01:39.326 TEST_HEADER include/spdk/nvmf_spec.h 00:01:39.326 TEST_HEADER include/spdk/nvmf_transport.h 00:01:39.326 TEST_HEADER include/spdk/opal.h 00:01:39.326 TEST_HEADER include/spdk/opal_spec.h 00:01:39.326 TEST_HEADER include/spdk/pci_ids.h 00:01:39.326 CC app/iscsi_tgt/iscsi_tgt.o 00:01:39.326 TEST_HEADER include/spdk/pipe.h 00:01:39.326 TEST_HEADER include/spdk/queue.h 00:01:39.326 TEST_HEADER include/spdk/reduce.h 00:01:39.326 TEST_HEADER include/spdk/rpc.h 00:01:39.326 CC app/spdk_tgt/spdk_tgt.o 00:01:39.326 TEST_HEADER include/spdk/scheduler.h 00:01:39.326 TEST_HEADER include/spdk/scsi.h 00:01:39.326 TEST_HEADER include/spdk/scsi_spec.h 00:01:39.326 TEST_HEADER include/spdk/sock.h 00:01:39.326 TEST_HEADER include/spdk/string.h 00:01:39.326 TEST_HEADER include/spdk/stdinc.h 00:01:39.326 TEST_HEADER include/spdk/thread.h 00:01:39.326 TEST_HEADER include/spdk/trace.h 00:01:39.326 TEST_HEADER include/spdk/trace_parser.h 00:01:39.326 TEST_HEADER include/spdk/tree.h 00:01:39.326 TEST_HEADER include/spdk/ublk.h 00:01:39.326 TEST_HEADER include/spdk/uuid.h 00:01:39.326 TEST_HEADER include/spdk/util.h 00:01:39.326 TEST_HEADER include/spdk/version.h 00:01:39.326 TEST_HEADER include/spdk/vfio_user_spec.h 00:01:39.326 TEST_HEADER include/spdk/vfio_user_pci.h 00:01:39.326 TEST_HEADER include/spdk/vhost.h 00:01:39.326 TEST_HEADER include/spdk/vmd.h 00:01:39.326 TEST_HEADER include/spdk/xor.h 00:01:39.326 TEST_HEADER include/spdk/zipf.h 00:01:39.326 CXX test/cpp_headers/accel.o 00:01:39.326 CXX test/cpp_headers/accel_module.o 00:01:39.326 CXX test/cpp_headers/assert.o 00:01:39.326 CXX test/cpp_headers/base64.o 00:01:39.326 CXX test/cpp_headers/barrier.o 00:01:39.326 CXX test/cpp_headers/bdev.o 00:01:39.326 CXX test/cpp_headers/bdev_zone.o 00:01:39.326 CXX test/cpp_headers/bdev_module.o 00:01:39.326 CXX test/cpp_headers/bit_array.o 00:01:39.326 CXX test/cpp_headers/bit_pool.o 00:01:39.326 CXX test/cpp_headers/blob_bdev.o 00:01:39.326 CXX test/cpp_headers/blobfs.o 00:01:39.326 CXX test/cpp_headers/blobfs_bdev.o 00:01:39.326 CXX test/cpp_headers/blob.o 00:01:39.326 CXX test/cpp_headers/conf.o 00:01:39.326 CXX test/cpp_headers/config.o 00:01:39.326 CXX test/cpp_headers/cpuset.o 00:01:39.326 CXX test/cpp_headers/crc16.o 00:01:39.326 CXX test/cpp_headers/dif.o 00:01:39.326 CXX test/cpp_headers/crc64.o 00:01:39.326 CXX test/cpp_headers/crc32.o 00:01:39.326 CXX test/cpp_headers/dma.o 00:01:39.326 CC examples/ioat/verify/verify.o 00:01:39.326 CC examples/ioat/perf/perf.o 00:01:39.326 CC examples/sock/hello_world/hello_sock.o 00:01:39.326 CC test/app/jsoncat/jsoncat.o 00:01:39.326 CC test/app/stub/stub.o 00:01:39.326 CC test/env/pci/pci_ut.o 00:01:39.326 CC examples/nvme/hello_world/hello_world.o 00:01:39.326 CC test/nvme/reserve/reserve.o 00:01:39.326 CC examples/vmd/led/led.o 00:01:39.326 CC test/event/reactor/reactor.o 00:01:39.326 CC test/nvme/simple_copy/simple_copy.o 00:01:39.326 CC test/event/reactor_perf/reactor_perf.o 00:01:39.326 CC app/fio/nvme/fio_plugin.o 00:01:39.326 CC test/nvme/overhead/overhead.o 00:01:39.326 CC test/nvme/aer/aer.o 00:01:39.326 CC examples/util/zipf/zipf.o 00:01:39.326 CC test/nvme/compliance/nvme_compliance.o 00:01:39.326 CC examples/idxd/perf/perf.o 00:01:39.326 CC examples/nvme/hotplug/hotplug.o 00:01:39.326 CC test/nvme/startup/startup.o 00:01:39.326 CC test/env/vtophys/vtophys.o 00:01:39.326 CC test/app/histogram_perf/histogram_perf.o 00:01:39.326 CC examples/nvme/arbitration/arbitration.o 00:01:39.326 CC examples/accel/perf/accel_perf.o 00:01:39.326 CC test/nvme/boot_partition/boot_partition.o 00:01:39.326 CC test/nvme/cuse/cuse.o 00:01:39.326 CC examples/nvme/abort/abort.o 00:01:39.326 CC examples/nvme/cmb_copy/cmb_copy.o 00:01:39.326 CC examples/nvme/reconnect/reconnect.o 00:01:39.326 CC test/nvme/fdp/fdp.o 00:01:39.326 CC examples/vmd/lsvmd/lsvmd.o 00:01:39.327 CC test/event/event_perf/event_perf.o 00:01:39.327 CC test/env/memory/memory_ut.o 00:01:39.327 CC test/nvme/sgl/sgl.o 00:01:39.327 CC examples/nvme/nvme_manage/nvme_manage.o 00:01:39.327 CC test/nvme/doorbell_aers/doorbell_aers.o 00:01:39.588 CC test/nvme/e2edp/nvme_dp.o 00:01:39.588 CC test/thread/poller_perf/poller_perf.o 00:01:39.588 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:01:39.588 CC test/accel/dif/dif.o 00:01:39.588 CC test/nvme/reset/reset.o 00:01:39.588 CC test/nvme/err_injection/err_injection.o 00:01:39.588 CC test/nvme/connect_stress/connect_stress.o 00:01:39.588 CC examples/blob/cli/blobcli.o 00:01:39.588 CC test/nvme/fused_ordering/fused_ordering.o 00:01:39.588 CC app/fio/bdev/fio_plugin.o 00:01:39.588 CC examples/nvmf/nvmf/nvmf.o 00:01:39.588 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:01:39.588 CC examples/bdev/bdevperf/bdevperf.o 00:01:39.588 LINK spdk_lspci 00:01:39.588 CC test/blobfs/mkfs/mkfs.o 00:01:39.588 CC test/app/bdev_svc/bdev_svc.o 00:01:39.588 CC examples/thread/thread/thread_ex.o 00:01:39.588 CC test/event/app_repeat/app_repeat.o 00:01:39.588 CC examples/blob/hello_world/hello_blob.o 00:01:39.588 CC test/bdev/bdevio/bdevio.o 00:01:39.588 CC examples/bdev/hello_world/hello_bdev.o 00:01:39.588 CC test/event/scheduler/scheduler.o 00:01:39.588 CC test/dma/test_dma/test_dma.o 00:01:39.588 CC test/env/mem_callbacks/mem_callbacks.o 00:01:39.588 LINK vhost 00:01:39.856 LINK iscsi_tgt 00:01:39.856 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:01:39.856 LINK rpc_client_test 00:01:39.856 LINK interrupt_tgt 00:01:39.856 CC test/lvol/esnap/esnap.o 00:01:39.856 LINK spdk_tgt 00:01:39.856 LINK nvmf_tgt 00:01:39.856 LINK spdk_nvme_discover 00:01:39.856 LINK spdk_trace_record 00:01:39.856 LINK reactor 00:01:39.856 LINK event_perf 00:01:39.856 LINK stub 00:01:39.856 LINK jsoncat 00:01:39.856 CXX test/cpp_headers/endian.o 00:01:39.856 LINK startup 00:01:39.856 CXX test/cpp_headers/env_dpdk.o 00:01:39.856 LINK led 00:01:39.856 LINK lsvmd 00:01:39.856 LINK reactor_perf 00:01:39.856 CXX test/cpp_headers/env.o 00:01:39.856 CXX test/cpp_headers/event.o 00:01:39.856 LINK zipf 00:01:39.856 LINK histogram_perf 00:01:39.856 CXX test/cpp_headers/fd_group.o 00:01:39.856 CXX test/cpp_headers/fd.o 00:01:39.856 LINK vtophys 00:01:39.856 CXX test/cpp_headers/file.o 00:01:39.856 LINK verify 00:01:39.856 LINK bdev_svc 00:01:39.856 LINK poller_perf 00:01:39.856 LINK boot_partition 00:01:39.856 LINK reserve 00:01:39.856 CXX test/cpp_headers/ftl.o 00:01:39.856 LINK spdk_dd 00:01:39.856 LINK env_dpdk_post_init 00:01:39.856 CXX test/cpp_headers/gpt_spec.o 00:01:39.856 LINK app_repeat 00:01:39.856 LINK connect_stress 00:01:39.856 LINK hello_world 00:01:39.856 LINK ioat_perf 00:01:39.856 LINK simple_copy 00:01:39.856 LINK cmb_copy 00:01:40.131 LINK mkfs 00:01:40.131 CXX test/cpp_headers/hexlify.o 00:01:40.131 CXX test/cpp_headers/histogram_data.o 00:01:40.131 CXX test/cpp_headers/idxd.o 00:01:40.131 LINK doorbell_aers 00:01:40.131 CXX test/cpp_headers/idxd_spec.o 00:01:40.131 CXX test/cpp_headers/init.o 00:01:40.131 CXX test/cpp_headers/ioat.o 00:01:40.131 LINK hello_sock 00:01:40.131 CXX test/cpp_headers/ioat_spec.o 00:01:40.131 LINK fused_ordering 00:01:40.131 LINK pmr_persistence 00:01:40.131 LINK hotplug 00:01:40.131 LINK err_injection 00:01:40.131 CXX test/cpp_headers/iscsi_spec.o 00:01:40.131 CXX test/cpp_headers/json.o 00:01:40.131 CXX test/cpp_headers/jsonrpc.o 00:01:40.131 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:01:40.131 CXX test/cpp_headers/keyring.o 00:01:40.131 LINK scheduler 00:01:40.131 LINK thread 00:01:40.131 LINK reset 00:01:40.131 LINK nvme_dp 00:01:40.131 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:01:40.131 LINK hello_blob 00:01:40.131 LINK aer 00:01:40.131 CXX test/cpp_headers/keyring_module.o 00:01:40.131 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:01:40.131 CXX test/cpp_headers/likely.o 00:01:40.131 LINK overhead 00:01:40.131 LINK hello_bdev 00:01:40.131 LINK sgl 00:01:40.131 LINK fdp 00:01:40.131 LINK arbitration 00:01:40.131 LINK nvme_compliance 00:01:40.131 CXX test/cpp_headers/log.o 00:01:40.131 LINK nvmf 00:01:40.131 CXX test/cpp_headers/lvol.o 00:01:40.131 CXX test/cpp_headers/memory.o 00:01:40.131 CXX test/cpp_headers/mmio.o 00:01:40.131 CXX test/cpp_headers/nbd.o 00:01:40.131 CXX test/cpp_headers/notify.o 00:01:40.131 CXX test/cpp_headers/nvme.o 00:01:40.131 LINK idxd_perf 00:01:40.399 LINK spdk_trace 00:01:40.399 CXX test/cpp_headers/nvme_intel.o 00:01:40.399 CXX test/cpp_headers/nvme_ocssd.o 00:01:40.399 LINK reconnect 00:01:40.399 LINK test_dma 00:01:40.399 LINK abort 00:01:40.399 CXX test/cpp_headers/nvme_ocssd_spec.o 00:01:40.399 LINK dif 00:01:40.399 CXX test/cpp_headers/nvme_spec.o 00:01:40.399 CXX test/cpp_headers/nvme_zns.o 00:01:40.399 CXX test/cpp_headers/nvmf_cmd.o 00:01:40.399 LINK accel_perf 00:01:40.399 CXX test/cpp_headers/nvmf.o 00:01:40.399 CXX test/cpp_headers/nvmf_fc_spec.o 00:01:40.399 LINK pci_ut 00:01:40.399 CXX test/cpp_headers/nvmf_spec.o 00:01:40.399 LINK bdevio 00:01:40.399 CXX test/cpp_headers/nvmf_transport.o 00:01:40.399 CXX test/cpp_headers/opal.o 00:01:40.399 CXX test/cpp_headers/opal_spec.o 00:01:40.399 CXX test/cpp_headers/pci_ids.o 00:01:40.399 CXX test/cpp_headers/pipe.o 00:01:40.399 CXX test/cpp_headers/queue.o 00:01:40.399 CXX test/cpp_headers/reduce.o 00:01:40.399 CXX test/cpp_headers/rpc.o 00:01:40.399 CXX test/cpp_headers/scheduler.o 00:01:40.399 CXX test/cpp_headers/scsi.o 00:01:40.399 CXX test/cpp_headers/sock.o 00:01:40.399 CXX test/cpp_headers/scsi_spec.o 00:01:40.399 CXX test/cpp_headers/stdinc.o 00:01:40.399 CXX test/cpp_headers/string.o 00:01:40.399 CXX test/cpp_headers/thread.o 00:01:40.399 CXX test/cpp_headers/trace.o 00:01:40.399 CXX test/cpp_headers/trace_parser.o 00:01:40.399 CXX test/cpp_headers/tree.o 00:01:40.399 LINK nvme_manage 00:01:40.399 CXX test/cpp_headers/ublk.o 00:01:40.399 CXX test/cpp_headers/util.o 00:01:40.399 CXX test/cpp_headers/uuid.o 00:01:40.399 CXX test/cpp_headers/version.o 00:01:40.399 CXX test/cpp_headers/vfio_user_pci.o 00:01:40.399 CXX test/cpp_headers/vfio_user_spec.o 00:01:40.399 CXX test/cpp_headers/vhost.o 00:01:40.399 CXX test/cpp_headers/vmd.o 00:01:40.399 CXX test/cpp_headers/xor.o 00:01:40.399 CXX test/cpp_headers/zipf.o 00:01:40.658 LINK blobcli 00:01:40.658 LINK nvme_fuzz 00:01:40.658 LINK spdk_bdev 00:01:40.658 LINK spdk_nvme 00:01:40.658 LINK spdk_nvme_perf 00:01:40.658 LINK mem_callbacks 00:01:40.919 LINK spdk_top 00:01:40.919 LINK vhost_fuzz 00:01:40.919 LINK memory_ut 00:01:40.919 LINK bdevperf 00:01:40.919 LINK spdk_nvme_identify 00:01:40.919 LINK cuse 00:01:41.863 LINK iscsi_fuzz 00:01:43.242 LINK esnap 00:01:43.502 00:01:43.502 real 0m42.232s 00:01:43.502 user 6m55.932s 00:01:43.502 sys 3m16.890s 00:01:43.502 03:02:17 -- common/autotest_common.sh@1112 -- $ xtrace_disable 00:01:43.502 03:02:17 -- common/autotest_common.sh@10 -- $ set +x 00:01:43.502 ************************************ 00:01:43.502 END TEST make 00:01:43.502 ************************************ 00:01:43.502 03:02:17 -- spdk/autobuild.sh@1 -- $ stop_monitor_resources 00:01:43.502 03:02:17 -- pm/common@30 -- $ signal_monitor_resources TERM 00:01:43.502 03:02:17 -- pm/common@41 -- $ local monitor pid pids signal=TERM 00:01:43.502 03:02:17 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:43.502 03:02:17 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/collect-cpu-load.pid ]] 00:01:43.502 03:02:17 -- pm/common@45 -- $ pid=3785619 00:01:43.502 03:02:17 -- pm/common@52 -- $ sudo kill -TERM 3785619 00:01:43.502 03:02:17 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:43.502 03:02:17 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/collect-vmstat.pid ]] 00:01:43.502 03:02:17 -- pm/common@45 -- $ pid=3785625 00:01:43.502 03:02:17 -- pm/common@52 -- $ sudo kill -TERM 3785625 00:01:43.762 03:02:18 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:43.762 03:02:18 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/collect-cpu-temp.pid ]] 00:01:43.762 03:02:18 -- pm/common@45 -- $ pid=3785627 00:01:43.762 03:02:18 -- pm/common@52 -- $ sudo kill -TERM 3785627 00:01:43.762 03:02:18 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:43.762 03:02:18 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/collect-bmc-pm.pid ]] 00:01:43.762 03:02:18 -- pm/common@45 -- $ pid=3785620 00:01:43.762 03:02:18 -- pm/common@52 -- $ sudo kill -TERM 3785620 00:01:43.762 03:02:18 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:01:43.762 03:02:18 -- nvmf/common.sh@7 -- # uname -s 00:01:43.762 03:02:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:01:43.762 03:02:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:01:43.762 03:02:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:01:43.762 03:02:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:01:43.762 03:02:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:01:43.762 03:02:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:01:43.762 03:02:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:01:43.762 03:02:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:01:43.762 03:02:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:01:43.762 03:02:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:01:43.762 03:02:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:01:43.762 03:02:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:01:43.762 03:02:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:01:43.762 03:02:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:01:43.762 03:02:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:01:43.762 03:02:18 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:01:43.762 03:02:18 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:01:43.762 03:02:18 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:01:43.762 03:02:18 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:43.762 03:02:18 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:43.762 03:02:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:43.762 03:02:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:43.762 03:02:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:43.762 03:02:18 -- paths/export.sh@5 -- # export PATH 00:01:43.762 03:02:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:43.762 03:02:18 -- nvmf/common.sh@47 -- # : 0 00:01:43.762 03:02:18 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:01:43.762 03:02:18 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:01:43.762 03:02:18 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:01:43.762 03:02:18 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:01:43.762 03:02:18 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:01:43.762 03:02:18 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:01:43.762 03:02:18 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:01:43.762 03:02:18 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:01:43.762 03:02:18 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:01:43.762 03:02:18 -- spdk/autotest.sh@32 -- # uname -s 00:01:43.762 03:02:18 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:01:43.762 03:02:18 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:01:43.762 03:02:18 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/coredumps 00:01:43.762 03:02:18 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:01:43.762 03:02:18 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/coredumps 00:01:43.762 03:02:18 -- spdk/autotest.sh@44 -- # modprobe nbd 00:01:43.762 03:02:18 -- spdk/autotest.sh@46 -- # type -P udevadm 00:01:43.762 03:02:18 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:01:43.762 03:02:18 -- spdk/autotest.sh@48 -- # udevadm_pid=3843152 00:01:43.762 03:02:18 -- spdk/autotest.sh@53 -- # start_monitor_resources 00:01:43.762 03:02:18 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:01:43.762 03:02:18 -- pm/common@17 -- # local monitor 00:01:43.762 03:02:18 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:01:43.762 03:02:18 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=3843153 00:01:43.762 03:02:18 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:01:43.762 03:02:18 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=3843155 00:01:43.762 03:02:18 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:01:43.762 03:02:18 -- pm/common@21 -- # date +%s 00:01:43.762 03:02:18 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=3843158 00:01:43.762 03:02:18 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:01:43.762 03:02:18 -- pm/common@21 -- # date +%s 00:01:43.762 03:02:18 -- pm/common@21 -- # date +%s 00:01:43.762 03:02:18 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=3843162 00:01:43.762 03:02:18 -- pm/common@26 -- # sleep 1 00:01:43.762 03:02:18 -- pm/common@21 -- # date +%s 00:01:43.762 03:02:18 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1714006938 00:01:43.762 03:02:18 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1714006938 00:01:43.762 03:02:18 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1714006938 00:01:43.762 03:02:18 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1714006938 00:01:44.023 Redirecting to /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/monitor.autotest.sh.1714006938_collect-bmc-pm.bmc.pm.log 00:01:44.023 Redirecting to /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/monitor.autotest.sh.1714006938_collect-vmstat.pm.log 00:01:44.023 Redirecting to /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/monitor.autotest.sh.1714006938_collect-cpu-load.pm.log 00:01:44.023 Redirecting to /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/monitor.autotest.sh.1714006938_collect-cpu-temp.pm.log 00:01:44.960 03:02:19 -- spdk/autotest.sh@55 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:01:44.960 03:02:19 -- spdk/autotest.sh@57 -- # timing_enter autotest 00:01:44.960 03:02:19 -- common/autotest_common.sh@710 -- # xtrace_disable 00:01:44.960 03:02:19 -- common/autotest_common.sh@10 -- # set +x 00:01:44.960 03:02:19 -- spdk/autotest.sh@59 -- # create_test_list 00:01:44.960 03:02:19 -- common/autotest_common.sh@734 -- # xtrace_disable 00:01:44.960 03:02:19 -- common/autotest_common.sh@10 -- # set +x 00:01:44.960 03:02:19 -- spdk/autotest.sh@61 -- # dirname /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/autotest.sh 00:01:44.960 03:02:19 -- spdk/autotest.sh@61 -- # readlink -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:01:44.960 03:02:19 -- spdk/autotest.sh@61 -- # src=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:01:44.960 03:02:19 -- spdk/autotest.sh@62 -- # out=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output 00:01:44.960 03:02:19 -- spdk/autotest.sh@63 -- # cd /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:01:44.960 03:02:19 -- spdk/autotest.sh@65 -- # freebsd_update_contigmem_mod 00:01:44.960 03:02:19 -- common/autotest_common.sh@1441 -- # uname 00:01:44.960 03:02:19 -- common/autotest_common.sh@1441 -- # '[' Linux = FreeBSD ']' 00:01:44.960 03:02:19 -- spdk/autotest.sh@66 -- # freebsd_set_maxsock_buf 00:01:44.960 03:02:19 -- common/autotest_common.sh@1461 -- # uname 00:01:44.960 03:02:19 -- common/autotest_common.sh@1461 -- # [[ Linux = FreeBSD ]] 00:01:44.960 03:02:19 -- spdk/autotest.sh@71 -- # grep CC_TYPE mk/cc.mk 00:01:44.960 03:02:19 -- spdk/autotest.sh@71 -- # CC_TYPE=CC_TYPE=gcc 00:01:44.960 03:02:19 -- spdk/autotest.sh@72 -- # hash lcov 00:01:44.960 03:02:19 -- spdk/autotest.sh@72 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:01:44.960 03:02:19 -- spdk/autotest.sh@80 -- # export 'LCOV_OPTS= 00:01:44.960 --rc lcov_branch_coverage=1 00:01:44.960 --rc lcov_function_coverage=1 00:01:44.960 --rc genhtml_branch_coverage=1 00:01:44.960 --rc genhtml_function_coverage=1 00:01:44.960 --rc genhtml_legend=1 00:01:44.960 --rc geninfo_all_blocks=1 00:01:44.960 ' 00:01:44.960 03:02:19 -- spdk/autotest.sh@80 -- # LCOV_OPTS=' 00:01:44.960 --rc lcov_branch_coverage=1 00:01:44.960 --rc lcov_function_coverage=1 00:01:44.960 --rc genhtml_branch_coverage=1 00:01:44.960 --rc genhtml_function_coverage=1 00:01:44.960 --rc genhtml_legend=1 00:01:44.960 --rc geninfo_all_blocks=1 00:01:44.960 ' 00:01:44.960 03:02:19 -- spdk/autotest.sh@81 -- # export 'LCOV=lcov 00:01:44.960 --rc lcov_branch_coverage=1 00:01:44.960 --rc lcov_function_coverage=1 00:01:44.960 --rc genhtml_branch_coverage=1 00:01:44.960 --rc genhtml_function_coverage=1 00:01:44.960 --rc genhtml_legend=1 00:01:44.960 --rc geninfo_all_blocks=1 00:01:44.960 --no-external' 00:01:44.960 03:02:19 -- spdk/autotest.sh@81 -- # LCOV='lcov 00:01:44.960 --rc lcov_branch_coverage=1 00:01:44.960 --rc lcov_function_coverage=1 00:01:44.960 --rc genhtml_branch_coverage=1 00:01:44.960 --rc genhtml_function_coverage=1 00:01:44.960 --rc genhtml_legend=1 00:01:44.960 --rc geninfo_all_blocks=1 00:01:44.960 --no-external' 00:01:44.960 03:02:19 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -v 00:01:44.960 lcov: LCOV version 1.14 00:01:44.960 03:02:19 -- spdk/autotest.sh@85 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -i -t Baseline -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_base.info 00:01:51.530 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/accel.gcno:no functions found 00:01:51.530 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/accel.gcno 00:01:51.530 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/assert.gcno:no functions found 00:01:51.530 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/assert.gcno 00:01:51.530 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/base64.gcno:no functions found 00:01:51.530 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/base64.gcno 00:01:51.530 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/accel_module.gcno:no functions found 00:01:51.530 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/accel_module.gcno 00:01:51.530 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno:no functions found 00:01:51.530 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno 00:01:51.530 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/barrier.gcno:no functions found 00:01:51.530 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/barrier.gcno 00:01:51.530 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/bdev.gcno:no functions found 00:01:51.530 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/bdev.gcno 00:01:51.530 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno:no functions found 00:01:51.530 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno 00:01:51.530 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/blobfs.gcno:no functions found 00:01:51.530 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/blobfs.gcno 00:01:51.530 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/bit_array.gcno:no functions found 00:01:51.530 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/bit_array.gcno 00:01:51.530 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno:no functions found 00:01:51.530 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno 00:01:51.530 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno:no functions found 00:01:51.530 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno 00:01:51.530 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/blob.gcno:no functions found 00:01:51.530 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/blob.gcno 00:01:51.530 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/conf.gcno:no functions found 00:01:51.530 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/conf.gcno 00:01:51.530 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno:no functions found 00:01:51.530 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno 00:01:51.530 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/config.gcno:no functions found 00:01:51.530 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/config.gcno 00:01:51.530 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/cpuset.gcno:no functions found 00:01:51.530 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/cpuset.gcno 00:01:51.530 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/crc16.gcno:no functions found 00:01:51.530 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/crc16.gcno 00:01:51.530 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/dif.gcno:no functions found 00:01:51.530 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/dif.gcno 00:01:51.530 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/crc64.gcno:no functions found 00:01:51.530 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/crc64.gcno 00:01:51.530 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/crc32.gcno:no functions found 00:01:51.530 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/crc32.gcno 00:01:51.530 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/dma.gcno:no functions found 00:01:51.530 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/dma.gcno 00:01:51.530 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/endian.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/endian.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/event.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/event.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/env.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/env.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/fd.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/fd.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/fd_group.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/fd_group.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/file.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/file.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/ftl.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/ftl.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/hexlify.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/hexlify.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/idxd.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/idxd.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/init.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/init.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/ioat.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/ioat.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/json.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/json.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/keyring.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/keyring.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/keyring_module.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/keyring_module.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/likely.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/likely.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/log.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/log.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/memory.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/memory.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/lvol.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/lvol.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/mmio.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/mmio.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/notify.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/notify.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nbd.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nbd.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvme.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvme.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvmf.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvmf.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/opal.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/opal.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/pipe.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/pipe.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/reduce.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/reduce.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/rpc.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/rpc.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/queue.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/queue.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/scsi.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/scsi.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/scheduler.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/scheduler.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/sock.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/sock.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/stdinc.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/stdinc.gcno 00:01:51.531 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/string.gcno:no functions found 00:01:51.531 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/string.gcno 00:01:51.532 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/thread.gcno:no functions found 00:01:51.532 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/thread.gcno 00:01:51.532 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/trace.gcno:no functions found 00:01:51.532 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/trace.gcno 00:01:51.532 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno:no functions found 00:01:51.532 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno 00:01:51.532 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/tree.gcno:no functions found 00:01:51.532 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/tree.gcno 00:01:51.532 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/ublk.gcno:no functions found 00:01:51.532 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/ublk.gcno 00:01:51.532 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/util.gcno:no functions found 00:01:51.532 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/util.gcno 00:01:51.532 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/uuid.gcno:no functions found 00:01:51.532 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/uuid.gcno 00:01:51.532 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/version.gcno:no functions found 00:01:51.532 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/version.gcno 00:01:51.532 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno:no functions found 00:01:51.532 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno 00:01:51.532 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno:no functions found 00:01:51.532 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno 00:01:51.791 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/vhost.gcno:no functions found 00:01:51.791 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/vhost.gcno 00:01:51.791 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/vmd.gcno:no functions found 00:01:51.791 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/vmd.gcno 00:01:51.791 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/zipf.gcno:no functions found 00:01:51.791 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/zipf.gcno 00:01:51.791 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/xor.gcno:no functions found 00:01:51.791 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/xor.gcno 00:01:55.075 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/nvme/nvme_stubs.gcno:no functions found 00:01:55.075 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/nvme/nvme_stubs.gcno 00:02:03.198 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:03.198 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:03.198 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:03.198 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:03.198 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:03.198 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:02:08.468 03:02:42 -- spdk/autotest.sh@89 -- # timing_enter pre_cleanup 00:02:08.468 03:02:42 -- common/autotest_common.sh@710 -- # xtrace_disable 00:02:08.468 03:02:42 -- common/autotest_common.sh@10 -- # set +x 00:02:08.468 03:02:42 -- spdk/autotest.sh@91 -- # rm -f 00:02:08.468 03:02:42 -- spdk/autotest.sh@94 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh reset 00:02:10.362 0000:5f:00.0 (1b96 2600): Already using the nvme driver 00:02:10.620 0000:5e:00.0 (8086 0a54): Already using the nvme driver 00:02:10.620 0000:00:04.7 (8086 2021): Already using the ioatdma driver 00:02:10.620 0000:00:04.6 (8086 2021): Already using the ioatdma driver 00:02:10.620 0000:00:04.5 (8086 2021): Already using the ioatdma driver 00:02:10.620 0000:00:04.4 (8086 2021): Already using the ioatdma driver 00:02:10.620 0000:00:04.3 (8086 2021): Already using the ioatdma driver 00:02:10.620 0000:00:04.2 (8086 2021): Already using the ioatdma driver 00:02:10.620 0000:00:04.1 (8086 2021): Already using the ioatdma driver 00:02:10.620 0000:00:04.0 (8086 2021): Already using the ioatdma driver 00:02:10.620 0000:80:04.7 (8086 2021): Already using the ioatdma driver 00:02:10.620 0000:80:04.6 (8086 2021): Already using the ioatdma driver 00:02:10.620 0000:80:04.5 (8086 2021): Already using the ioatdma driver 00:02:10.620 0000:80:04.4 (8086 2021): Already using the ioatdma driver 00:02:10.620 0000:80:04.3 (8086 2021): Already using the ioatdma driver 00:02:10.878 0000:80:04.2 (8086 2021): Already using the ioatdma driver 00:02:10.878 0000:80:04.1 (8086 2021): Already using the ioatdma driver 00:02:10.878 0000:80:04.0 (8086 2021): Already using the ioatdma driver 00:02:10.878 03:02:45 -- spdk/autotest.sh@96 -- # get_zoned_devs 00:02:10.878 03:02:45 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:02:10.878 03:02:45 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:02:10.878 03:02:45 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:02:10.878 03:02:45 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:02:10.878 03:02:45 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:02:10.878 03:02:45 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:02:10.878 03:02:45 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:10.878 03:02:45 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:02:10.878 03:02:45 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:02:10.878 03:02:45 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme1n1 00:02:10.878 03:02:45 -- common/autotest_common.sh@1648 -- # local device=nvme1n1 00:02:10.878 03:02:45 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme1n1/queue/zoned ]] 00:02:10.878 03:02:45 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:02:10.878 03:02:45 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:02:10.878 03:02:45 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme1n2 00:02:10.878 03:02:45 -- common/autotest_common.sh@1648 -- # local device=nvme1n2 00:02:10.878 03:02:45 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme1n2/queue/zoned ]] 00:02:10.878 03:02:45 -- common/autotest_common.sh@1651 -- # [[ host-managed != none ]] 00:02:10.878 03:02:45 -- common/autotest_common.sh@1660 -- # zoned_devs["${nvme##*/}"]=0000:5f:00.0 00:02:10.878 03:02:45 -- spdk/autotest.sh@98 -- # (( 1 > 0 )) 00:02:10.878 03:02:45 -- spdk/autotest.sh@103 -- # export PCI_BLOCKED=0000:5f:00.0 00:02:10.878 03:02:45 -- spdk/autotest.sh@103 -- # PCI_BLOCKED=0000:5f:00.0 00:02:10.878 03:02:45 -- spdk/autotest.sh@104 -- # export PCI_ZONED=0000:5f:00.0 00:02:10.878 03:02:45 -- spdk/autotest.sh@104 -- # PCI_ZONED=0000:5f:00.0 00:02:10.878 03:02:45 -- spdk/autotest.sh@110 -- # for dev in /dev/nvme*n!(*p*) 00:02:10.878 03:02:45 -- spdk/autotest.sh@112 -- # [[ -z '' ]] 00:02:10.878 03:02:45 -- spdk/autotest.sh@113 -- # block_in_use /dev/nvme0n1 00:02:10.878 03:02:45 -- scripts/common.sh@378 -- # local block=/dev/nvme0n1 pt 00:02:10.878 03:02:45 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:02:10.878 No valid GPT data, bailing 00:02:10.878 03:02:45 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:02:10.878 03:02:45 -- scripts/common.sh@391 -- # pt= 00:02:10.878 03:02:45 -- scripts/common.sh@392 -- # return 1 00:02:10.878 03:02:45 -- spdk/autotest.sh@114 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:02:10.878 1+0 records in 00:02:10.878 1+0 records out 00:02:10.878 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00186551 s, 562 MB/s 00:02:10.878 03:02:45 -- spdk/autotest.sh@110 -- # for dev in /dev/nvme*n!(*p*) 00:02:10.878 03:02:45 -- spdk/autotest.sh@112 -- # [[ -z '' ]] 00:02:10.878 03:02:45 -- spdk/autotest.sh@113 -- # block_in_use /dev/nvme1n1 00:02:10.878 03:02:45 -- scripts/common.sh@378 -- # local block=/dev/nvme1n1 pt 00:02:10.878 03:02:45 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme1n1 00:02:10.878 No valid GPT data, bailing 00:02:10.878 03:02:45 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme1n1 00:02:10.878 03:02:45 -- scripts/common.sh@391 -- # pt= 00:02:10.878 03:02:45 -- scripts/common.sh@392 -- # return 1 00:02:10.878 03:02:45 -- spdk/autotest.sh@114 -- # dd if=/dev/zero of=/dev/nvme1n1 bs=1M count=1 00:02:10.878 1+0 records in 00:02:10.878 1+0 records out 00:02:10.878 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00518793 s, 202 MB/s 00:02:10.878 03:02:45 -- spdk/autotest.sh@110 -- # for dev in /dev/nvme*n!(*p*) 00:02:10.878 03:02:45 -- spdk/autotest.sh@112 -- # [[ -z 0000:5f:00.0 ]] 00:02:10.878 03:02:45 -- spdk/autotest.sh@112 -- # continue 00:02:10.878 03:02:45 -- spdk/autotest.sh@118 -- # sync 00:02:10.878 03:02:45 -- spdk/autotest.sh@120 -- # xtrace_disable_per_cmd reap_spdk_processes 00:02:10.878 03:02:45 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:02:10.878 03:02:45 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:02:16.165 03:02:49 -- spdk/autotest.sh@124 -- # uname -s 00:02:16.165 03:02:49 -- spdk/autotest.sh@124 -- # '[' Linux = Linux ']' 00:02:16.165 03:02:49 -- spdk/autotest.sh@125 -- # run_test setup.sh /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/test-setup.sh 00:02:16.165 03:02:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:16.165 03:02:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:16.165 03:02:49 -- common/autotest_common.sh@10 -- # set +x 00:02:16.165 ************************************ 00:02:16.165 START TEST setup.sh 00:02:16.165 ************************************ 00:02:16.165 03:02:50 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/test-setup.sh 00:02:16.165 * Looking for test storage... 00:02:16.165 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup 00:02:16.165 03:02:50 -- setup/test-setup.sh@10 -- # uname -s 00:02:16.165 03:02:50 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:02:16.165 03:02:50 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/acl.sh 00:02:16.165 03:02:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:16.165 03:02:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:16.165 03:02:50 -- common/autotest_common.sh@10 -- # set +x 00:02:16.165 ************************************ 00:02:16.165 START TEST acl 00:02:16.165 ************************************ 00:02:16.165 03:02:50 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/acl.sh 00:02:16.165 * Looking for test storage... 00:02:16.165 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup 00:02:16.165 03:02:50 -- setup/acl.sh@10 -- # get_zoned_devs 00:02:16.165 03:02:50 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:02:16.165 03:02:50 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:02:16.165 03:02:50 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:02:16.165 03:02:50 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:02:16.165 03:02:50 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:02:16.165 03:02:50 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:02:16.165 03:02:50 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:16.165 03:02:50 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:02:16.165 03:02:50 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:02:16.165 03:02:50 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme1n1 00:02:16.165 03:02:50 -- common/autotest_common.sh@1648 -- # local device=nvme1n1 00:02:16.165 03:02:50 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme1n1/queue/zoned ]] 00:02:16.165 03:02:50 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:02:16.165 03:02:50 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:02:16.165 03:02:50 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme1n2 00:02:16.165 03:02:50 -- common/autotest_common.sh@1648 -- # local device=nvme1n2 00:02:16.165 03:02:50 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme1n2/queue/zoned ]] 00:02:16.165 03:02:50 -- common/autotest_common.sh@1651 -- # [[ host-managed != none ]] 00:02:16.165 03:02:50 -- common/autotest_common.sh@1660 -- # zoned_devs["${nvme##*/}"]=0000:5f:00.0 00:02:16.165 03:02:50 -- setup/acl.sh@12 -- # devs=() 00:02:16.165 03:02:50 -- setup/acl.sh@12 -- # declare -a devs 00:02:16.165 03:02:50 -- setup/acl.sh@13 -- # drivers=() 00:02:16.165 03:02:50 -- setup/acl.sh@13 -- # declare -A drivers 00:02:16.165 03:02:50 -- setup/acl.sh@51 -- # setup reset 00:02:16.165 03:02:50 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:16.165 03:02:50 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh reset 00:02:20.350 03:02:54 -- setup/acl.sh@52 -- # collect_setup_devs 00:02:20.350 03:02:54 -- setup/acl.sh@16 -- # local dev driver 00:02:20.350 03:02:54 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:20.350 03:02:54 -- setup/acl.sh@15 -- # setup output status 00:02:20.350 03:02:54 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:20.350 03:02:54 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh status 00:02:22.882 Hugepages 00:02:22.882 node hugesize free / total 00:02:22.882 03:02:57 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:22.882 03:02:57 -- setup/acl.sh@19 -- # continue 00:02:22.882 03:02:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:22.882 03:02:57 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:22.882 03:02:57 -- setup/acl.sh@19 -- # continue 00:02:22.882 03:02:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:22.882 03:02:57 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:22.882 03:02:57 -- setup/acl.sh@19 -- # continue 00:02:22.882 03:02:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:22.882 00:02:22.882 Type BDF Vendor Device NUMA Driver Device Block devices 00:02:22.882 03:02:57 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:22.882 03:02:57 -- setup/acl.sh@19 -- # continue 00:02:22.882 03:02:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:22.882 03:02:57 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # continue 00:02:22.882 03:02:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:22.882 03:02:57 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # continue 00:02:22.882 03:02:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:22.882 03:02:57 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # continue 00:02:22.882 03:02:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:22.882 03:02:57 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # continue 00:02:22.882 03:02:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:22.882 03:02:57 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # continue 00:02:22.882 03:02:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:22.882 03:02:57 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # continue 00:02:22.882 03:02:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:22.882 03:02:57 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # continue 00:02:22.882 03:02:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:22.882 03:02:57 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # continue 00:02:22.882 03:02:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:22.882 03:02:57 -- setup/acl.sh@19 -- # [[ 0000:5e:00.0 == *:*:*.* ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:02:22.882 03:02:57 -- setup/acl.sh@21 -- # [[ 0000:5f:00.0 == *\0\0\0\0\:\5\e\:\0\0\.\0* ]] 00:02:22.882 03:02:57 -- setup/acl.sh@22 -- # devs+=("$dev") 00:02:22.882 03:02:57 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:02:22.882 03:02:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:22.882 03:02:57 -- setup/acl.sh@19 -- # [[ 0000:5f:00.0 == *:*:*.* ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:02:22.882 03:02:57 -- setup/acl.sh@21 -- # [[ 0000:5f:00.0 == *\0\0\0\0\:\5\f\:\0\0\.\0* ]] 00:02:22.882 03:02:57 -- setup/acl.sh@21 -- # continue 00:02:22.882 03:02:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:22.882 03:02:57 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # continue 00:02:22.882 03:02:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:22.882 03:02:57 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # continue 00:02:22.882 03:02:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:22.882 03:02:57 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # continue 00:02:22.882 03:02:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:22.882 03:02:57 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # continue 00:02:22.882 03:02:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:22.882 03:02:57 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # continue 00:02:22.882 03:02:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:22.882 03:02:57 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # continue 00:02:22.882 03:02:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:22.882 03:02:57 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # continue 00:02:22.882 03:02:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:22.882 03:02:57 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:22.882 03:02:57 -- setup/acl.sh@20 -- # continue 00:02:22.882 03:02:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:22.882 03:02:57 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:02:22.882 03:02:57 -- setup/acl.sh@54 -- # run_test denied denied 00:02:22.882 03:02:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:22.882 03:02:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:22.882 03:02:57 -- common/autotest_common.sh@10 -- # set +x 00:02:23.140 ************************************ 00:02:23.140 START TEST denied 00:02:23.140 ************************************ 00:02:23.140 03:02:57 -- common/autotest_common.sh@1111 -- # denied 00:02:23.140 03:02:57 -- setup/acl.sh@38 -- # PCI_BLOCKED='0000:5f:00.0 0000:5e:00.0' 00:02:23.140 03:02:57 -- setup/acl.sh@38 -- # setup output config 00:02:23.140 03:02:57 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:5e:00.0' 00:02:23.140 03:02:57 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:23.140 03:02:57 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh config 00:02:26.422 0000:5e:00.0 (8086 0a54): Skipping denied controller at 0000:5e:00.0 00:02:26.422 03:03:00 -- setup/acl.sh@40 -- # verify 0000:5e:00.0 00:02:26.422 03:03:00 -- setup/acl.sh@28 -- # local dev driver 00:02:26.422 03:03:00 -- setup/acl.sh@30 -- # for dev in "$@" 00:02:26.422 03:03:00 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:5e:00.0 ]] 00:02:26.422 03:03:00 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:5e:00.0/driver 00:02:26.422 03:03:00 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:02:26.422 03:03:00 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:02:26.422 03:03:00 -- setup/acl.sh@41 -- # setup reset 00:02:26.422 03:03:00 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:26.422 03:03:00 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh reset 00:02:30.603 00:02:30.603 real 0m7.411s 00:02:30.603 user 0m2.443s 00:02:30.603 sys 0m4.243s 00:02:30.603 03:03:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:02:30.603 03:03:04 -- common/autotest_common.sh@10 -- # set +x 00:02:30.603 ************************************ 00:02:30.603 END TEST denied 00:02:30.603 ************************************ 00:02:30.603 03:03:04 -- setup/acl.sh@55 -- # run_test allowed allowed 00:02:30.603 03:03:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:30.603 03:03:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:30.603 03:03:04 -- common/autotest_common.sh@10 -- # set +x 00:02:30.603 ************************************ 00:02:30.603 START TEST allowed 00:02:30.603 ************************************ 00:02:30.603 03:03:05 -- common/autotest_common.sh@1111 -- # allowed 00:02:30.603 03:03:05 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:5e:00.0 00:02:30.603 03:03:05 -- setup/acl.sh@45 -- # setup output config 00:02:30.603 03:03:05 -- setup/acl.sh@46 -- # grep -E '0000:5e:00.0 .*: nvme -> .*' 00:02:30.603 03:03:05 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:30.603 03:03:05 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh config 00:02:35.864 0000:5e:00.0 (8086 0a54): nvme -> vfio-pci 00:02:35.864 03:03:09 -- setup/acl.sh@47 -- # verify 00:02:35.864 03:03:09 -- setup/acl.sh@28 -- # local dev driver 00:02:35.864 03:03:09 -- setup/acl.sh@48 -- # setup reset 00:02:35.864 03:03:09 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:35.864 03:03:09 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh reset 00:02:39.146 00:02:39.146 real 0m7.893s 00:02:39.146 user 0m2.534s 00:02:39.146 sys 0m4.479s 00:02:39.146 03:03:12 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:02:39.146 03:03:12 -- common/autotest_common.sh@10 -- # set +x 00:02:39.146 ************************************ 00:02:39.146 END TEST allowed 00:02:39.146 ************************************ 00:02:39.146 00:02:39.146 real 0m22.645s 00:02:39.146 user 0m7.742s 00:02:39.146 sys 0m13.475s 00:02:39.146 03:03:12 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:02:39.146 03:03:12 -- common/autotest_common.sh@10 -- # set +x 00:02:39.146 ************************************ 00:02:39.146 END TEST acl 00:02:39.146 ************************************ 00:02:39.146 03:03:13 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/hugepages.sh 00:02:39.146 03:03:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:39.146 03:03:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:39.146 03:03:13 -- common/autotest_common.sh@10 -- # set +x 00:02:39.146 ************************************ 00:02:39.146 START TEST hugepages 00:02:39.146 ************************************ 00:02:39.146 03:03:13 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/hugepages.sh 00:02:39.146 * Looking for test storage... 00:02:39.146 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup 00:02:39.146 03:03:13 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:02:39.146 03:03:13 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:02:39.146 03:03:13 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:02:39.146 03:03:13 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:02:39.146 03:03:13 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:02:39.146 03:03:13 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:02:39.146 03:03:13 -- setup/common.sh@17 -- # local get=Hugepagesize 00:02:39.146 03:03:13 -- setup/common.sh@18 -- # local node= 00:02:39.146 03:03:13 -- setup/common.sh@19 -- # local var val 00:02:39.146 03:03:13 -- setup/common.sh@20 -- # local mem_f mem 00:02:39.146 03:03:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:39.146 03:03:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:39.146 03:03:13 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:39.146 03:03:13 -- setup/common.sh@28 -- # mapfile -t mem 00:02:39.146 03:03:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.146 03:03:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 75349720 kB' 'MemAvailable: 79341556 kB' 'Buffers: 12048 kB' 'Cached: 10201608 kB' 'SwapCached: 0 kB' 'Active: 7232292 kB' 'Inactive: 3509768 kB' 'Active(anon): 6266384 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 531852 kB' 'Mapped: 187340 kB' 'Shmem: 5737980 kB' 'KReclaimable: 224344 kB' 'Slab: 698112 kB' 'SReclaimable: 224344 kB' 'SUnreclaim: 473768 kB' 'KernelStack: 19792 kB' 'PageTables: 8908 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 52952936 kB' 'Committed_AS: 7628660 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218664 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.146 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.146 03:03:13 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # continue 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # IFS=': ' 00:02:39.147 03:03:13 -- setup/common.sh@31 -- # read -r var val _ 00:02:39.147 03:03:13 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:39.147 03:03:13 -- setup/common.sh@33 -- # echo 2048 00:02:39.147 03:03:13 -- setup/common.sh@33 -- # return 0 00:02:39.147 03:03:13 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:02:39.147 03:03:13 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:02:39.147 03:03:13 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:02:39.147 03:03:13 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:02:39.147 03:03:13 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:02:39.147 03:03:13 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:02:39.147 03:03:13 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:02:39.147 03:03:13 -- setup/hugepages.sh@207 -- # get_nodes 00:02:39.147 03:03:13 -- setup/hugepages.sh@27 -- # local node 00:02:39.147 03:03:13 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:39.147 03:03:13 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:02:39.147 03:03:13 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:39.148 03:03:13 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:39.148 03:03:13 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:39.148 03:03:13 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:39.148 03:03:13 -- setup/hugepages.sh@208 -- # clear_hp 00:02:39.148 03:03:13 -- setup/hugepages.sh@37 -- # local node hp 00:02:39.148 03:03:13 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:39.148 03:03:13 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:39.148 03:03:13 -- setup/hugepages.sh@41 -- # echo 0 00:02:39.148 03:03:13 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:39.148 03:03:13 -- setup/hugepages.sh@41 -- # echo 0 00:02:39.148 03:03:13 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:39.148 03:03:13 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:39.148 03:03:13 -- setup/hugepages.sh@41 -- # echo 0 00:02:39.148 03:03:13 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:39.148 03:03:13 -- setup/hugepages.sh@41 -- # echo 0 00:02:39.148 03:03:13 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:02:39.148 03:03:13 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:02:39.148 03:03:13 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:02:39.148 03:03:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:39.148 03:03:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:39.148 03:03:13 -- common/autotest_common.sh@10 -- # set +x 00:02:39.148 ************************************ 00:02:39.148 START TEST default_setup 00:02:39.148 ************************************ 00:02:39.148 03:03:13 -- common/autotest_common.sh@1111 -- # default_setup 00:02:39.148 03:03:13 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:02:39.148 03:03:13 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:39.148 03:03:13 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:02:39.148 03:03:13 -- setup/hugepages.sh@51 -- # shift 00:02:39.148 03:03:13 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:02:39.148 03:03:13 -- setup/hugepages.sh@52 -- # local node_ids 00:02:39.148 03:03:13 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:39.148 03:03:13 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:39.148 03:03:13 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:02:39.148 03:03:13 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:02:39.148 03:03:13 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:39.148 03:03:13 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:39.148 03:03:13 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:39.148 03:03:13 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:39.148 03:03:13 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:39.148 03:03:13 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:02:39.148 03:03:13 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:39.148 03:03:13 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:02:39.148 03:03:13 -- setup/hugepages.sh@73 -- # return 0 00:02:39.148 03:03:13 -- setup/hugepages.sh@137 -- # setup output 00:02:39.148 03:03:13 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:39.148 03:03:13 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh 00:02:41.674 0000:5f:00.0 (1b96 2600): Skipping denied controller at 0000:5f:00.0 00:02:41.932 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:02:41.932 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:02:41.932 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:02:41.932 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:02:41.932 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:02:42.191 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:02:42.191 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:02:42.191 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:02:42.191 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:02:42.191 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:02:42.191 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:02:42.191 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:02:42.191 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:02:42.191 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:02:42.191 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:02:42.191 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:02:43.131 0000:5e:00.0 (8086 0a54): nvme -> vfio-pci 00:02:43.131 03:03:17 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:02:43.131 03:03:17 -- setup/hugepages.sh@89 -- # local node 00:02:43.131 03:03:17 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:43.131 03:03:17 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:43.131 03:03:17 -- setup/hugepages.sh@92 -- # local surp 00:02:43.131 03:03:17 -- setup/hugepages.sh@93 -- # local resv 00:02:43.131 03:03:17 -- setup/hugepages.sh@94 -- # local anon 00:02:43.131 03:03:17 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:43.131 03:03:17 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:43.131 03:03:17 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:43.131 03:03:17 -- setup/common.sh@18 -- # local node= 00:02:43.131 03:03:17 -- setup/common.sh@19 -- # local var val 00:02:43.131 03:03:17 -- setup/common.sh@20 -- # local mem_f mem 00:02:43.131 03:03:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:43.131 03:03:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:43.131 03:03:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:43.131 03:03:17 -- setup/common.sh@28 -- # mapfile -t mem 00:02:43.131 03:03:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:43.131 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.131 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.131 03:03:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 77544364 kB' 'MemAvailable: 81535832 kB' 'Buffers: 12048 kB' 'Cached: 10201704 kB' 'SwapCached: 0 kB' 'Active: 7250448 kB' 'Inactive: 3509768 kB' 'Active(anon): 6284540 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 549456 kB' 'Mapped: 187520 kB' 'Shmem: 5738076 kB' 'KReclaimable: 223608 kB' 'Slab: 694352 kB' 'SReclaimable: 223608 kB' 'SUnreclaim: 470744 kB' 'KernelStack: 19856 kB' 'PageTables: 8948 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 54001512 kB' 'Committed_AS: 7645596 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218680 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:02:43.131 03:03:17 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.131 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.131 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.131 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.131 03:03:17 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.131 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.131 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.131 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.131 03:03:17 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.131 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.131 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.131 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.131 03:03:17 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.131 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.131 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.131 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.131 03:03:17 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.131 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.131 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.131 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.131 03:03:17 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.131 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.131 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.131 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.131 03:03:17 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.131 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.132 03:03:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.132 03:03:17 -- setup/common.sh@33 -- # echo 0 00:02:43.132 03:03:17 -- setup/common.sh@33 -- # return 0 00:02:43.132 03:03:17 -- setup/hugepages.sh@97 -- # anon=0 00:02:43.132 03:03:17 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:43.132 03:03:17 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:43.132 03:03:17 -- setup/common.sh@18 -- # local node= 00:02:43.132 03:03:17 -- setup/common.sh@19 -- # local var val 00:02:43.132 03:03:17 -- setup/common.sh@20 -- # local mem_f mem 00:02:43.132 03:03:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:43.132 03:03:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:43.132 03:03:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:43.132 03:03:17 -- setup/common.sh@28 -- # mapfile -t mem 00:02:43.132 03:03:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.132 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 77548504 kB' 'MemAvailable: 81539972 kB' 'Buffers: 12048 kB' 'Cached: 10201708 kB' 'SwapCached: 0 kB' 'Active: 7251564 kB' 'Inactive: 3509768 kB' 'Active(anon): 6285656 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 550512 kB' 'Mapped: 187596 kB' 'Shmem: 5738080 kB' 'KReclaimable: 223608 kB' 'Slab: 694380 kB' 'SReclaimable: 223608 kB' 'SUnreclaim: 470772 kB' 'KernelStack: 19872 kB' 'PageTables: 9012 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 54001512 kB' 'Committed_AS: 7676964 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218712 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.133 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.133 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.134 03:03:17 -- setup/common.sh@33 -- # echo 0 00:02:43.134 03:03:17 -- setup/common.sh@33 -- # return 0 00:02:43.134 03:03:17 -- setup/hugepages.sh@99 -- # surp=0 00:02:43.134 03:03:17 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:43.134 03:03:17 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:43.134 03:03:17 -- setup/common.sh@18 -- # local node= 00:02:43.134 03:03:17 -- setup/common.sh@19 -- # local var val 00:02:43.134 03:03:17 -- setup/common.sh@20 -- # local mem_f mem 00:02:43.134 03:03:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:43.134 03:03:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:43.134 03:03:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:43.134 03:03:17 -- setup/common.sh@28 -- # mapfile -t mem 00:02:43.134 03:03:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 77548288 kB' 'MemAvailable: 81539756 kB' 'Buffers: 12048 kB' 'Cached: 10201720 kB' 'SwapCached: 0 kB' 'Active: 7249840 kB' 'Inactive: 3509768 kB' 'Active(anon): 6283932 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 549148 kB' 'Mapped: 187520 kB' 'Shmem: 5738092 kB' 'KReclaimable: 223608 kB' 'Slab: 694348 kB' 'SReclaimable: 223608 kB' 'SUnreclaim: 470740 kB' 'KernelStack: 19792 kB' 'PageTables: 8696 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 54001512 kB' 'Committed_AS: 7645380 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218664 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.134 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.134 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.135 03:03:17 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.135 03:03:17 -- setup/common.sh@33 -- # echo 0 00:02:43.135 03:03:17 -- setup/common.sh@33 -- # return 0 00:02:43.135 03:03:17 -- setup/hugepages.sh@100 -- # resv=0 00:02:43.135 03:03:17 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:43.135 nr_hugepages=1024 00:02:43.135 03:03:17 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:43.135 resv_hugepages=0 00:02:43.135 03:03:17 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:43.135 surplus_hugepages=0 00:02:43.135 03:03:17 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:43.135 anon_hugepages=0 00:02:43.135 03:03:17 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:43.135 03:03:17 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:43.135 03:03:17 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:43.135 03:03:17 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:43.135 03:03:17 -- setup/common.sh@18 -- # local node= 00:02:43.135 03:03:17 -- setup/common.sh@19 -- # local var val 00:02:43.135 03:03:17 -- setup/common.sh@20 -- # local mem_f mem 00:02:43.135 03:03:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:43.135 03:03:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:43.135 03:03:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:43.135 03:03:17 -- setup/common.sh@28 -- # mapfile -t mem 00:02:43.135 03:03:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.135 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.136 03:03:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 77549056 kB' 'MemAvailable: 81540524 kB' 'Buffers: 12048 kB' 'Cached: 10201736 kB' 'SwapCached: 0 kB' 'Active: 7250032 kB' 'Inactive: 3509768 kB' 'Active(anon): 6284124 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 549324 kB' 'Mapped: 187520 kB' 'Shmem: 5738108 kB' 'KReclaimable: 223608 kB' 'Slab: 694348 kB' 'SReclaimable: 223608 kB' 'SUnreclaim: 470740 kB' 'KernelStack: 19776 kB' 'PageTables: 8656 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 54001512 kB' 'Committed_AS: 7648040 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218680 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.136 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.136 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.137 03:03:17 -- setup/common.sh@33 -- # echo 1024 00:02:43.137 03:03:17 -- setup/common.sh@33 -- # return 0 00:02:43.137 03:03:17 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:43.137 03:03:17 -- setup/hugepages.sh@112 -- # get_nodes 00:02:43.137 03:03:17 -- setup/hugepages.sh@27 -- # local node 00:02:43.137 03:03:17 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:43.137 03:03:17 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:02:43.137 03:03:17 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:43.137 03:03:17 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:43.137 03:03:17 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:43.137 03:03:17 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:43.137 03:03:17 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:43.137 03:03:17 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:43.137 03:03:17 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:43.137 03:03:17 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:43.137 03:03:17 -- setup/common.sh@18 -- # local node=0 00:02:43.137 03:03:17 -- setup/common.sh@19 -- # local var val 00:02:43.137 03:03:17 -- setup/common.sh@20 -- # local mem_f mem 00:02:43.137 03:03:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:43.137 03:03:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:43.137 03:03:17 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:43.137 03:03:17 -- setup/common.sh@28 -- # mapfile -t mem 00:02:43.137 03:03:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:43.137 03:03:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32587572 kB' 'MemFree: 26207396 kB' 'MemUsed: 6380176 kB' 'SwapCached: 0 kB' 'Active: 3247820 kB' 'Inactive: 133200 kB' 'Active(anon): 2483576 kB' 'Inactive(anon): 0 kB' 'Active(file): 764244 kB' 'Inactive(file): 133200 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3021384 kB' 'Mapped: 149080 kB' 'AnonPages: 362808 kB' 'Shmem: 2123940 kB' 'KernelStack: 12120 kB' 'PageTables: 6144 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 105200 kB' 'Slab: 354676 kB' 'SReclaimable: 105200 kB' 'SUnreclaim: 249476 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.137 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.137 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.138 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.138 03:03:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.397 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.397 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.397 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.397 03:03:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.397 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.397 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.397 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.397 03:03:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.397 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.397 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.397 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.397 03:03:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.397 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.397 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.397 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.397 03:03:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.397 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.397 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.397 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.397 03:03:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.397 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.397 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.397 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.397 03:03:17 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.397 03:03:17 -- setup/common.sh@32 -- # continue 00:02:43.397 03:03:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.397 03:03:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.397 03:03:17 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.397 03:03:17 -- setup/common.sh@33 -- # echo 0 00:02:43.397 03:03:17 -- setup/common.sh@33 -- # return 0 00:02:43.397 03:03:17 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:43.397 03:03:17 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:43.397 03:03:17 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:43.397 03:03:17 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:43.397 03:03:17 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:02:43.397 node0=1024 expecting 1024 00:02:43.397 03:03:17 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:02:43.397 00:02:43.397 real 0m4.261s 00:02:43.397 user 0m1.423s 00:02:43.397 sys 0m2.092s 00:02:43.397 03:03:17 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:02:43.397 03:03:17 -- common/autotest_common.sh@10 -- # set +x 00:02:43.397 ************************************ 00:02:43.397 END TEST default_setup 00:02:43.397 ************************************ 00:02:43.397 03:03:17 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:02:43.397 03:03:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:43.397 03:03:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:43.397 03:03:17 -- common/autotest_common.sh@10 -- # set +x 00:02:43.397 ************************************ 00:02:43.397 START TEST per_node_1G_alloc 00:02:43.397 ************************************ 00:02:43.397 03:03:17 -- common/autotest_common.sh@1111 -- # per_node_1G_alloc 00:02:43.397 03:03:17 -- setup/hugepages.sh@143 -- # local IFS=, 00:02:43.397 03:03:17 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:02:43.397 03:03:17 -- setup/hugepages.sh@49 -- # local size=1048576 00:02:43.397 03:03:17 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:02:43.397 03:03:17 -- setup/hugepages.sh@51 -- # shift 00:02:43.397 03:03:17 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:02:43.397 03:03:17 -- setup/hugepages.sh@52 -- # local node_ids 00:02:43.397 03:03:17 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:43.397 03:03:17 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:02:43.397 03:03:17 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:02:43.397 03:03:17 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:02:43.397 03:03:17 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:43.397 03:03:17 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:02:43.397 03:03:17 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:43.397 03:03:17 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:43.397 03:03:17 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:43.397 03:03:17 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:02:43.397 03:03:17 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:43.397 03:03:17 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:02:43.397 03:03:17 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:43.397 03:03:17 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:02:43.398 03:03:17 -- setup/hugepages.sh@73 -- # return 0 00:02:43.398 03:03:17 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:02:43.398 03:03:17 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:02:43.398 03:03:17 -- setup/hugepages.sh@146 -- # setup output 00:02:43.398 03:03:17 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:43.398 03:03:17 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh 00:02:45.988 0000:5f:00.0 (1b96 2600): Skipping denied controller at 0000:5f:00.0 00:02:46.558 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:02:46.558 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:46.558 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:02:46.558 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:02:46.558 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:02:46.558 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:02:46.558 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:02:46.558 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:02:46.558 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:02:46.558 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:02:46.558 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:02:46.558 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:02:46.558 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:02:46.558 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:02:46.558 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:02:46.559 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:02:46.559 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:02:46.559 03:03:20 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:02:46.559 03:03:20 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:02:46.559 03:03:20 -- setup/hugepages.sh@89 -- # local node 00:02:46.559 03:03:20 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:46.559 03:03:20 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:46.559 03:03:20 -- setup/hugepages.sh@92 -- # local surp 00:02:46.559 03:03:20 -- setup/hugepages.sh@93 -- # local resv 00:02:46.559 03:03:20 -- setup/hugepages.sh@94 -- # local anon 00:02:46.559 03:03:20 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:46.559 03:03:20 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:46.559 03:03:20 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:46.559 03:03:20 -- setup/common.sh@18 -- # local node= 00:02:46.559 03:03:20 -- setup/common.sh@19 -- # local var val 00:02:46.559 03:03:20 -- setup/common.sh@20 -- # local mem_f mem 00:02:46.559 03:03:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:46.559 03:03:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:46.559 03:03:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:46.559 03:03:20 -- setup/common.sh@28 -- # mapfile -t mem 00:02:46.559 03:03:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 77542176 kB' 'MemAvailable: 81533644 kB' 'Buffers: 12048 kB' 'Cached: 10201828 kB' 'SwapCached: 0 kB' 'Active: 7251664 kB' 'Inactive: 3509768 kB' 'Active(anon): 6285756 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 550516 kB' 'Mapped: 187628 kB' 'Shmem: 5738200 kB' 'KReclaimable: 223608 kB' 'Slab: 694564 kB' 'SReclaimable: 223608 kB' 'SUnreclaim: 470956 kB' 'KernelStack: 19824 kB' 'PageTables: 8812 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 54001512 kB' 'Committed_AS: 7645672 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218792 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.559 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.559 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:46.560 03:03:20 -- setup/common.sh@33 -- # echo 0 00:02:46.560 03:03:20 -- setup/common.sh@33 -- # return 0 00:02:46.560 03:03:20 -- setup/hugepages.sh@97 -- # anon=0 00:02:46.560 03:03:20 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:46.560 03:03:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:46.560 03:03:20 -- setup/common.sh@18 -- # local node= 00:02:46.560 03:03:20 -- setup/common.sh@19 -- # local var val 00:02:46.560 03:03:20 -- setup/common.sh@20 -- # local mem_f mem 00:02:46.560 03:03:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:46.560 03:03:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:46.560 03:03:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:46.560 03:03:20 -- setup/common.sh@28 -- # mapfile -t mem 00:02:46.560 03:03:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 77543356 kB' 'MemAvailable: 81534824 kB' 'Buffers: 12048 kB' 'Cached: 10201836 kB' 'SwapCached: 0 kB' 'Active: 7251432 kB' 'Inactive: 3509768 kB' 'Active(anon): 6285524 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 550300 kB' 'Mapped: 187620 kB' 'Shmem: 5738208 kB' 'KReclaimable: 223608 kB' 'Slab: 694564 kB' 'SReclaimable: 223608 kB' 'SUnreclaim: 470956 kB' 'KernelStack: 19824 kB' 'PageTables: 8796 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 54001512 kB' 'Committed_AS: 7646052 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218760 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.560 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.560 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.561 03:03:20 -- setup/common.sh@33 -- # echo 0 00:02:46.561 03:03:20 -- setup/common.sh@33 -- # return 0 00:02:46.561 03:03:20 -- setup/hugepages.sh@99 -- # surp=0 00:02:46.561 03:03:20 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:46.561 03:03:21 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:46.561 03:03:21 -- setup/common.sh@18 -- # local node= 00:02:46.561 03:03:21 -- setup/common.sh@19 -- # local var val 00:02:46.561 03:03:21 -- setup/common.sh@20 -- # local mem_f mem 00:02:46.561 03:03:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:46.561 03:03:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:46.561 03:03:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:46.561 03:03:21 -- setup/common.sh@28 -- # mapfile -t mem 00:02:46.561 03:03:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:46.561 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 77544836 kB' 'MemAvailable: 81536304 kB' 'Buffers: 12048 kB' 'Cached: 10201848 kB' 'SwapCached: 0 kB' 'Active: 7250720 kB' 'Inactive: 3509768 kB' 'Active(anon): 6284812 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 549996 kB' 'Mapped: 187544 kB' 'Shmem: 5738220 kB' 'KReclaimable: 223608 kB' 'Slab: 694524 kB' 'SReclaimable: 223608 kB' 'SUnreclaim: 470916 kB' 'KernelStack: 19840 kB' 'PageTables: 8848 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 54001512 kB' 'Committed_AS: 7646068 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218760 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:02:46.561 03:03:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.561 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.561 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.561 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.561 03:03:21 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.561 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.561 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.562 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.562 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:46.563 03:03:21 -- setup/common.sh@33 -- # echo 0 00:02:46.563 03:03:21 -- setup/common.sh@33 -- # return 0 00:02:46.563 03:03:21 -- setup/hugepages.sh@100 -- # resv=0 00:02:46.563 03:03:21 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:46.563 nr_hugepages=1024 00:02:46.563 03:03:21 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:46.563 resv_hugepages=0 00:02:46.563 03:03:21 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:46.563 surplus_hugepages=0 00:02:46.563 03:03:21 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:46.563 anon_hugepages=0 00:02:46.563 03:03:21 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:46.563 03:03:21 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:46.563 03:03:21 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:46.563 03:03:21 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:46.563 03:03:21 -- setup/common.sh@18 -- # local node= 00:02:46.563 03:03:21 -- setup/common.sh@19 -- # local var val 00:02:46.563 03:03:21 -- setup/common.sh@20 -- # local mem_f mem 00:02:46.563 03:03:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:46.563 03:03:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:46.563 03:03:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:46.563 03:03:21 -- setup/common.sh@28 -- # mapfile -t mem 00:02:46.563 03:03:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.563 03:03:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 77545428 kB' 'MemAvailable: 81536896 kB' 'Buffers: 12048 kB' 'Cached: 10201872 kB' 'SwapCached: 0 kB' 'Active: 7250168 kB' 'Inactive: 3509768 kB' 'Active(anon): 6284260 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 549384 kB' 'Mapped: 187544 kB' 'Shmem: 5738244 kB' 'KReclaimable: 223608 kB' 'Slab: 694524 kB' 'SReclaimable: 223608 kB' 'SUnreclaim: 470916 kB' 'KernelStack: 19824 kB' 'PageTables: 8792 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 54001512 kB' 'Committed_AS: 7646080 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218776 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.563 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.563 03:03:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.564 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.564 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.564 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.564 03:03:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.564 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.564 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.564 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.564 03:03:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.564 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.564 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.564 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.564 03:03:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.825 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.825 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:46.826 03:03:21 -- setup/common.sh@33 -- # echo 1024 00:02:46.826 03:03:21 -- setup/common.sh@33 -- # return 0 00:02:46.826 03:03:21 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:46.826 03:03:21 -- setup/hugepages.sh@112 -- # get_nodes 00:02:46.826 03:03:21 -- setup/hugepages.sh@27 -- # local node 00:02:46.826 03:03:21 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:46.826 03:03:21 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:46.826 03:03:21 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:46.826 03:03:21 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:46.826 03:03:21 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:46.826 03:03:21 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:46.826 03:03:21 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:46.826 03:03:21 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:46.826 03:03:21 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:46.826 03:03:21 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:46.826 03:03:21 -- setup/common.sh@18 -- # local node=0 00:02:46.826 03:03:21 -- setup/common.sh@19 -- # local var val 00:02:46.826 03:03:21 -- setup/common.sh@20 -- # local mem_f mem 00:02:46.826 03:03:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:46.826 03:03:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:46.826 03:03:21 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:46.826 03:03:21 -- setup/common.sh@28 -- # mapfile -t mem 00:02:46.826 03:03:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32587572 kB' 'MemFree: 27256728 kB' 'MemUsed: 5330844 kB' 'SwapCached: 0 kB' 'Active: 3248736 kB' 'Inactive: 133200 kB' 'Active(anon): 2484492 kB' 'Inactive(anon): 0 kB' 'Active(file): 764244 kB' 'Inactive(file): 133200 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3021428 kB' 'Mapped: 149108 kB' 'AnonPages: 363796 kB' 'Shmem: 2123984 kB' 'KernelStack: 12152 kB' 'PageTables: 6172 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 105200 kB' 'Slab: 354956 kB' 'SReclaimable: 105200 kB' 'SUnreclaim: 249756 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.826 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.826 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@33 -- # echo 0 00:02:46.827 03:03:21 -- setup/common.sh@33 -- # return 0 00:02:46.827 03:03:21 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:46.827 03:03:21 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:46.827 03:03:21 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:46.827 03:03:21 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:46.827 03:03:21 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:46.827 03:03:21 -- setup/common.sh@18 -- # local node=1 00:02:46.827 03:03:21 -- setup/common.sh@19 -- # local var val 00:02:46.827 03:03:21 -- setup/common.sh@20 -- # local mem_f mem 00:02:46.827 03:03:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:46.827 03:03:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:46.827 03:03:21 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:46.827 03:03:21 -- setup/common.sh@28 -- # mapfile -t mem 00:02:46.827 03:03:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60735396 kB' 'MemFree: 50289192 kB' 'MemUsed: 10446204 kB' 'SwapCached: 0 kB' 'Active: 4001280 kB' 'Inactive: 3376568 kB' 'Active(anon): 3799616 kB' 'Inactive(anon): 0 kB' 'Active(file): 201664 kB' 'Inactive(file): 3376568 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7192508 kB' 'Mapped: 38436 kB' 'AnonPages: 185412 kB' 'Shmem: 3614276 kB' 'KernelStack: 7688 kB' 'PageTables: 2672 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 118408 kB' 'Slab: 339568 kB' 'SReclaimable: 118408 kB' 'SUnreclaim: 221160 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.827 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.827 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # continue 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # IFS=': ' 00:02:46.828 03:03:21 -- setup/common.sh@31 -- # read -r var val _ 00:02:46.828 03:03:21 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:46.828 03:03:21 -- setup/common.sh@33 -- # echo 0 00:02:46.828 03:03:21 -- setup/common.sh@33 -- # return 0 00:02:46.828 03:03:21 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:46.828 03:03:21 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:46.828 03:03:21 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:46.828 03:03:21 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:46.828 03:03:21 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:02:46.828 node0=512 expecting 512 00:02:46.828 03:03:21 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:46.828 03:03:21 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:46.828 03:03:21 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:46.828 03:03:21 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:02:46.828 node1=512 expecting 512 00:02:46.828 03:03:21 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:02:46.828 00:02:46.828 real 0m3.354s 00:02:46.828 user 0m1.408s 00:02:46.828 sys 0m1.992s 00:02:46.828 03:03:21 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:02:46.828 03:03:21 -- common/autotest_common.sh@10 -- # set +x 00:02:46.828 ************************************ 00:02:46.828 END TEST per_node_1G_alloc 00:02:46.828 ************************************ 00:02:46.828 03:03:21 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:02:46.828 03:03:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:46.828 03:03:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:46.828 03:03:21 -- common/autotest_common.sh@10 -- # set +x 00:02:46.828 ************************************ 00:02:46.828 START TEST even_2G_alloc 00:02:46.828 ************************************ 00:02:46.828 03:03:21 -- common/autotest_common.sh@1111 -- # even_2G_alloc 00:02:46.828 03:03:21 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:02:46.828 03:03:21 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:46.828 03:03:21 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:46.828 03:03:21 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:46.828 03:03:21 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:46.828 03:03:21 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:46.828 03:03:21 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:46.828 03:03:21 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:46.828 03:03:21 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:46.828 03:03:21 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:46.828 03:03:21 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:46.828 03:03:21 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:46.828 03:03:21 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:46.828 03:03:21 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:02:46.828 03:03:21 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:46.828 03:03:21 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:02:46.828 03:03:21 -- setup/hugepages.sh@83 -- # : 512 00:02:46.828 03:03:21 -- setup/hugepages.sh@84 -- # : 1 00:02:46.828 03:03:21 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:46.828 03:03:21 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:02:46.828 03:03:21 -- setup/hugepages.sh@83 -- # : 0 00:02:46.828 03:03:21 -- setup/hugepages.sh@84 -- # : 0 00:02:46.829 03:03:21 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:46.829 03:03:21 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:02:46.829 03:03:21 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:02:46.829 03:03:21 -- setup/hugepages.sh@153 -- # setup output 00:02:46.829 03:03:21 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:46.829 03:03:21 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh 00:02:50.120 0000:5f:00.0 (1b96 2600): Skipping denied controller at 0000:5f:00.0 00:02:50.120 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:02:50.120 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:50.120 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:02:50.120 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:02:50.120 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:02:50.120 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:02:50.120 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:02:50.120 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:02:50.120 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:02:50.120 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:02:50.120 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:02:50.120 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:02:50.120 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:02:50.120 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:02:50.120 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:02:50.120 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:02:50.120 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:02:50.120 03:03:24 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:02:50.120 03:03:24 -- setup/hugepages.sh@89 -- # local node 00:02:50.120 03:03:24 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:50.120 03:03:24 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:50.120 03:03:24 -- setup/hugepages.sh@92 -- # local surp 00:02:50.120 03:03:24 -- setup/hugepages.sh@93 -- # local resv 00:02:50.120 03:03:24 -- setup/hugepages.sh@94 -- # local anon 00:02:50.120 03:03:24 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:50.120 03:03:24 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:50.120 03:03:24 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:50.120 03:03:24 -- setup/common.sh@18 -- # local node= 00:02:50.120 03:03:24 -- setup/common.sh@19 -- # local var val 00:02:50.120 03:03:24 -- setup/common.sh@20 -- # local mem_f mem 00:02:50.120 03:03:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:50.120 03:03:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:50.120 03:03:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:50.120 03:03:24 -- setup/common.sh@28 -- # mapfile -t mem 00:02:50.120 03:03:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.120 03:03:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 77542440 kB' 'MemAvailable: 81533908 kB' 'Buffers: 12048 kB' 'Cached: 10201952 kB' 'SwapCached: 0 kB' 'Active: 7249420 kB' 'Inactive: 3509768 kB' 'Active(anon): 6283512 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 547944 kB' 'Mapped: 186584 kB' 'Shmem: 5738324 kB' 'KReclaimable: 223608 kB' 'Slab: 694904 kB' 'SReclaimable: 223608 kB' 'SUnreclaim: 471296 kB' 'KernelStack: 19792 kB' 'PageTables: 8644 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 54001512 kB' 'Committed_AS: 7637316 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218856 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.120 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.120 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.121 03:03:24 -- setup/common.sh@33 -- # echo 0 00:02:50.121 03:03:24 -- setup/common.sh@33 -- # return 0 00:02:50.121 03:03:24 -- setup/hugepages.sh@97 -- # anon=0 00:02:50.121 03:03:24 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:50.121 03:03:24 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:50.121 03:03:24 -- setup/common.sh@18 -- # local node= 00:02:50.121 03:03:24 -- setup/common.sh@19 -- # local var val 00:02:50.121 03:03:24 -- setup/common.sh@20 -- # local mem_f mem 00:02:50.121 03:03:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:50.121 03:03:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:50.121 03:03:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:50.121 03:03:24 -- setup/common.sh@28 -- # mapfile -t mem 00:02:50.121 03:03:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 77545056 kB' 'MemAvailable: 81536524 kB' 'Buffers: 12048 kB' 'Cached: 10201956 kB' 'SwapCached: 0 kB' 'Active: 7247820 kB' 'Inactive: 3509768 kB' 'Active(anon): 6281912 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 546852 kB' 'Mapped: 186452 kB' 'Shmem: 5738328 kB' 'KReclaimable: 223608 kB' 'Slab: 694896 kB' 'SReclaimable: 223608 kB' 'SUnreclaim: 471288 kB' 'KernelStack: 19760 kB' 'PageTables: 8532 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 54001512 kB' 'Committed_AS: 7636572 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218776 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.121 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.121 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.122 03:03:24 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.122 03:03:24 -- setup/common.sh@33 -- # echo 0 00:02:50.122 03:03:24 -- setup/common.sh@33 -- # return 0 00:02:50.122 03:03:24 -- setup/hugepages.sh@99 -- # surp=0 00:02:50.122 03:03:24 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:50.122 03:03:24 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:50.122 03:03:24 -- setup/common.sh@18 -- # local node= 00:02:50.122 03:03:24 -- setup/common.sh@19 -- # local var val 00:02:50.122 03:03:24 -- setup/common.sh@20 -- # local mem_f mem 00:02:50.122 03:03:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:50.122 03:03:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:50.122 03:03:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:50.122 03:03:24 -- setup/common.sh@28 -- # mapfile -t mem 00:02:50.122 03:03:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.122 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 77549172 kB' 'MemAvailable: 81540640 kB' 'Buffers: 12048 kB' 'Cached: 10201968 kB' 'SwapCached: 0 kB' 'Active: 7248488 kB' 'Inactive: 3509768 kB' 'Active(anon): 6282580 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 547604 kB' 'Mapped: 186452 kB' 'Shmem: 5738340 kB' 'KReclaimable: 223608 kB' 'Slab: 694880 kB' 'SReclaimable: 223608 kB' 'SUnreclaim: 471272 kB' 'KernelStack: 19792 kB' 'PageTables: 8652 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 54001512 kB' 'Committed_AS: 7638104 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218760 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.123 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.123 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.124 03:03:24 -- setup/common.sh@33 -- # echo 0 00:02:50.124 03:03:24 -- setup/common.sh@33 -- # return 0 00:02:50.124 03:03:24 -- setup/hugepages.sh@100 -- # resv=0 00:02:50.124 03:03:24 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:50.124 nr_hugepages=1024 00:02:50.124 03:03:24 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:50.124 resv_hugepages=0 00:02:50.124 03:03:24 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:50.124 surplus_hugepages=0 00:02:50.124 03:03:24 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:50.124 anon_hugepages=0 00:02:50.124 03:03:24 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:50.124 03:03:24 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:50.124 03:03:24 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:50.124 03:03:24 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:50.124 03:03:24 -- setup/common.sh@18 -- # local node= 00:02:50.124 03:03:24 -- setup/common.sh@19 -- # local var val 00:02:50.124 03:03:24 -- setup/common.sh@20 -- # local mem_f mem 00:02:50.124 03:03:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:50.124 03:03:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:50.124 03:03:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:50.124 03:03:24 -- setup/common.sh@28 -- # mapfile -t mem 00:02:50.124 03:03:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.124 03:03:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 77547760 kB' 'MemAvailable: 81539228 kB' 'Buffers: 12048 kB' 'Cached: 10201968 kB' 'SwapCached: 0 kB' 'Active: 7247520 kB' 'Inactive: 3509768 kB' 'Active(anon): 6281612 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 546600 kB' 'Mapped: 186452 kB' 'Shmem: 5738340 kB' 'KReclaimable: 223608 kB' 'Slab: 694864 kB' 'SReclaimable: 223608 kB' 'SUnreclaim: 471256 kB' 'KernelStack: 19712 kB' 'PageTables: 8396 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 54001512 kB' 'Committed_AS: 7637752 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218760 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.124 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.124 03:03:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.125 03:03:24 -- setup/common.sh@33 -- # echo 1024 00:02:50.125 03:03:24 -- setup/common.sh@33 -- # return 0 00:02:50.125 03:03:24 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:50.125 03:03:24 -- setup/hugepages.sh@112 -- # get_nodes 00:02:50.125 03:03:24 -- setup/hugepages.sh@27 -- # local node 00:02:50.125 03:03:24 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:50.125 03:03:24 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:50.125 03:03:24 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:50.125 03:03:24 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:50.125 03:03:24 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:50.125 03:03:24 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:50.125 03:03:24 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:50.125 03:03:24 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:50.125 03:03:24 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:50.125 03:03:24 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:50.125 03:03:24 -- setup/common.sh@18 -- # local node=0 00:02:50.125 03:03:24 -- setup/common.sh@19 -- # local var val 00:02:50.125 03:03:24 -- setup/common.sh@20 -- # local mem_f mem 00:02:50.125 03:03:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:50.125 03:03:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:50.125 03:03:24 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:50.125 03:03:24 -- setup/common.sh@28 -- # mapfile -t mem 00:02:50.125 03:03:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32587572 kB' 'MemFree: 27268796 kB' 'MemUsed: 5318776 kB' 'SwapCached: 0 kB' 'Active: 3249472 kB' 'Inactive: 133200 kB' 'Active(anon): 2485228 kB' 'Inactive(anon): 0 kB' 'Active(file): 764244 kB' 'Inactive(file): 133200 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3021532 kB' 'Mapped: 147984 kB' 'AnonPages: 364380 kB' 'Shmem: 2124088 kB' 'KernelStack: 12152 kB' 'PageTables: 6248 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 105200 kB' 'Slab: 355104 kB' 'SReclaimable: 105200 kB' 'SUnreclaim: 249904 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.125 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.125 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@33 -- # echo 0 00:02:50.126 03:03:24 -- setup/common.sh@33 -- # return 0 00:02:50.126 03:03:24 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:50.126 03:03:24 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:50.126 03:03:24 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:50.126 03:03:24 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:50.126 03:03:24 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:50.126 03:03:24 -- setup/common.sh@18 -- # local node=1 00:02:50.126 03:03:24 -- setup/common.sh@19 -- # local var val 00:02:50.126 03:03:24 -- setup/common.sh@20 -- # local mem_f mem 00:02:50.126 03:03:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:50.126 03:03:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:50.126 03:03:24 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:50.126 03:03:24 -- setup/common.sh@28 -- # mapfile -t mem 00:02:50.126 03:03:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60735396 kB' 'MemFree: 50277964 kB' 'MemUsed: 10457432 kB' 'SwapCached: 0 kB' 'Active: 3999188 kB' 'Inactive: 3376568 kB' 'Active(anon): 3797524 kB' 'Inactive(anon): 0 kB' 'Active(file): 201664 kB' 'Inactive(file): 3376568 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7192512 kB' 'Mapped: 38468 kB' 'AnonPages: 183268 kB' 'Shmem: 3614280 kB' 'KernelStack: 7736 kB' 'PageTables: 2908 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 118408 kB' 'Slab: 339760 kB' 'SReclaimable: 118408 kB' 'SUnreclaim: 221352 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.126 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.126 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # continue 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.127 03:03:24 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.127 03:03:24 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.127 03:03:24 -- setup/common.sh@33 -- # echo 0 00:02:50.127 03:03:24 -- setup/common.sh@33 -- # return 0 00:02:50.127 03:03:24 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:50.127 03:03:24 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:50.127 03:03:24 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:50.127 03:03:24 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:50.127 03:03:24 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:02:50.127 node0=512 expecting 512 00:02:50.127 03:03:24 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:50.127 03:03:24 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:50.127 03:03:24 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:50.127 03:03:24 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:02:50.127 node1=512 expecting 512 00:02:50.127 03:03:24 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:02:50.127 00:02:50.127 real 0m3.244s 00:02:50.127 user 0m1.290s 00:02:50.127 sys 0m1.996s 00:02:50.127 03:03:24 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:02:50.127 03:03:24 -- common/autotest_common.sh@10 -- # set +x 00:02:50.127 ************************************ 00:02:50.127 END TEST even_2G_alloc 00:02:50.127 ************************************ 00:02:50.127 03:03:24 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:02:50.127 03:03:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:50.127 03:03:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:50.127 03:03:24 -- common/autotest_common.sh@10 -- # set +x 00:02:50.386 ************************************ 00:02:50.386 START TEST odd_alloc 00:02:50.386 ************************************ 00:02:50.386 03:03:24 -- common/autotest_common.sh@1111 -- # odd_alloc 00:02:50.386 03:03:24 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:02:50.386 03:03:24 -- setup/hugepages.sh@49 -- # local size=2098176 00:02:50.386 03:03:24 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:50.386 03:03:24 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:50.386 03:03:24 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:02:50.386 03:03:24 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:50.386 03:03:24 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:50.386 03:03:24 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:50.386 03:03:24 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:02:50.386 03:03:24 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:50.386 03:03:24 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:50.386 03:03:24 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:50.386 03:03:24 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:50.386 03:03:24 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:02:50.386 03:03:24 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:50.386 03:03:24 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:02:50.386 03:03:24 -- setup/hugepages.sh@83 -- # : 513 00:02:50.386 03:03:24 -- setup/hugepages.sh@84 -- # : 1 00:02:50.386 03:03:24 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:50.386 03:03:24 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:02:50.386 03:03:24 -- setup/hugepages.sh@83 -- # : 0 00:02:50.386 03:03:24 -- setup/hugepages.sh@84 -- # : 0 00:02:50.386 03:03:24 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:50.386 03:03:24 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:02:50.386 03:03:24 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:02:50.386 03:03:24 -- setup/hugepages.sh@160 -- # setup output 00:02:50.386 03:03:24 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:50.386 03:03:24 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh 00:02:53.676 0000:5f:00.0 (1b96 2600): Skipping denied controller at 0000:5f:00.0 00:02:53.676 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:02:53.676 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:53.676 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:02:53.676 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:02:53.676 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:02:53.676 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:02:53.676 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:02:53.676 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:02:53.676 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:02:53.676 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:02:53.676 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:02:53.676 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:02:53.676 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:02:53.676 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:02:53.676 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:02:53.676 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:02:53.676 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:02:53.676 03:03:27 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:02:53.676 03:03:27 -- setup/hugepages.sh@89 -- # local node 00:02:53.676 03:03:27 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:53.676 03:03:27 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:53.676 03:03:27 -- setup/hugepages.sh@92 -- # local surp 00:02:53.676 03:03:27 -- setup/hugepages.sh@93 -- # local resv 00:02:53.676 03:03:27 -- setup/hugepages.sh@94 -- # local anon 00:02:53.676 03:03:27 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:53.676 03:03:27 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:53.676 03:03:27 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:53.676 03:03:27 -- setup/common.sh@18 -- # local node= 00:02:53.676 03:03:27 -- setup/common.sh@19 -- # local var val 00:02:53.676 03:03:27 -- setup/common.sh@20 -- # local mem_f mem 00:02:53.676 03:03:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:53.676 03:03:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:53.676 03:03:27 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:53.676 03:03:27 -- setup/common.sh@28 -- # mapfile -t mem 00:02:53.676 03:03:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:53.676 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.676 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 77524652 kB' 'MemAvailable: 81516120 kB' 'Buffers: 12048 kB' 'Cached: 10202072 kB' 'SwapCached: 0 kB' 'Active: 7250292 kB' 'Inactive: 3509768 kB' 'Active(anon): 6284384 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 548660 kB' 'Mapped: 186576 kB' 'Shmem: 5738444 kB' 'KReclaimable: 223608 kB' 'Slab: 695980 kB' 'SReclaimable: 223608 kB' 'SUnreclaim: 472372 kB' 'KernelStack: 19808 kB' 'PageTables: 8688 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 54000488 kB' 'Committed_AS: 7637372 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218840 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.677 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.677 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.678 03:03:27 -- setup/common.sh@33 -- # echo 0 00:02:53.678 03:03:27 -- setup/common.sh@33 -- # return 0 00:02:53.678 03:03:27 -- setup/hugepages.sh@97 -- # anon=0 00:02:53.678 03:03:27 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:53.678 03:03:27 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:53.678 03:03:27 -- setup/common.sh@18 -- # local node= 00:02:53.678 03:03:27 -- setup/common.sh@19 -- # local var val 00:02:53.678 03:03:27 -- setup/common.sh@20 -- # local mem_f mem 00:02:53.678 03:03:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:53.678 03:03:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:53.678 03:03:27 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:53.678 03:03:27 -- setup/common.sh@28 -- # mapfile -t mem 00:02:53.678 03:03:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 77526508 kB' 'MemAvailable: 81517976 kB' 'Buffers: 12048 kB' 'Cached: 10202072 kB' 'SwapCached: 0 kB' 'Active: 7249956 kB' 'Inactive: 3509768 kB' 'Active(anon): 6284048 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 548316 kB' 'Mapped: 186528 kB' 'Shmem: 5738444 kB' 'KReclaimable: 223608 kB' 'Slab: 695980 kB' 'SReclaimable: 223608 kB' 'SUnreclaim: 472372 kB' 'KernelStack: 19776 kB' 'PageTables: 8572 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 54000488 kB' 'Committed_AS: 7637384 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218792 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.678 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.678 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.679 03:03:27 -- setup/common.sh@33 -- # echo 0 00:02:53.679 03:03:27 -- setup/common.sh@33 -- # return 0 00:02:53.679 03:03:27 -- setup/hugepages.sh@99 -- # surp=0 00:02:53.679 03:03:27 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:53.679 03:03:27 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:53.679 03:03:27 -- setup/common.sh@18 -- # local node= 00:02:53.679 03:03:27 -- setup/common.sh@19 -- # local var val 00:02:53.679 03:03:27 -- setup/common.sh@20 -- # local mem_f mem 00:02:53.679 03:03:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:53.679 03:03:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:53.679 03:03:27 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:53.679 03:03:27 -- setup/common.sh@28 -- # mapfile -t mem 00:02:53.679 03:03:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 77526008 kB' 'MemAvailable: 81517476 kB' 'Buffers: 12048 kB' 'Cached: 10202072 kB' 'SwapCached: 0 kB' 'Active: 7249460 kB' 'Inactive: 3509768 kB' 'Active(anon): 6283552 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 548276 kB' 'Mapped: 186452 kB' 'Shmem: 5738444 kB' 'KReclaimable: 223608 kB' 'Slab: 695972 kB' 'SReclaimable: 223608 kB' 'SUnreclaim: 472364 kB' 'KernelStack: 19776 kB' 'PageTables: 8568 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 54000488 kB' 'Committed_AS: 7637396 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218792 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.679 03:03:27 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:27 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.679 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.679 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.679 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.679 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.679 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.679 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.679 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.679 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.679 03:03:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.679 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.679 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.680 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.680 03:03:28 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.680 03:03:28 -- setup/common.sh@33 -- # echo 0 00:02:53.680 03:03:28 -- setup/common.sh@33 -- # return 0 00:02:53.681 03:03:28 -- setup/hugepages.sh@100 -- # resv=0 00:02:53.681 03:03:28 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:02:53.681 nr_hugepages=1025 00:02:53.681 03:03:28 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:53.681 resv_hugepages=0 00:02:53.681 03:03:28 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:53.681 surplus_hugepages=0 00:02:53.681 03:03:28 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:53.681 anon_hugepages=0 00:02:53.681 03:03:28 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:02:53.681 03:03:28 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:02:53.681 03:03:28 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:53.681 03:03:28 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:53.681 03:03:28 -- setup/common.sh@18 -- # local node= 00:02:53.681 03:03:28 -- setup/common.sh@19 -- # local var val 00:02:53.681 03:03:28 -- setup/common.sh@20 -- # local mem_f mem 00:02:53.681 03:03:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:53.681 03:03:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:53.681 03:03:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:53.681 03:03:28 -- setup/common.sh@28 -- # mapfile -t mem 00:02:53.681 03:03:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.681 03:03:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 77525756 kB' 'MemAvailable: 81517224 kB' 'Buffers: 12048 kB' 'Cached: 10202100 kB' 'SwapCached: 0 kB' 'Active: 7249408 kB' 'Inactive: 3509768 kB' 'Active(anon): 6283500 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 548204 kB' 'Mapped: 186452 kB' 'Shmem: 5738472 kB' 'KReclaimable: 223608 kB' 'Slab: 695972 kB' 'SReclaimable: 223608 kB' 'SUnreclaim: 472364 kB' 'KernelStack: 19744 kB' 'PageTables: 8464 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 54000488 kB' 'Committed_AS: 7637412 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218792 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.681 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.681 03:03:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.682 03:03:28 -- setup/common.sh@33 -- # echo 1025 00:02:53.682 03:03:28 -- setup/common.sh@33 -- # return 0 00:02:53.682 03:03:28 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:02:53.682 03:03:28 -- setup/hugepages.sh@112 -- # get_nodes 00:02:53.682 03:03:28 -- setup/hugepages.sh@27 -- # local node 00:02:53.682 03:03:28 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:53.682 03:03:28 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:53.682 03:03:28 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:53.682 03:03:28 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:02:53.682 03:03:28 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:53.682 03:03:28 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:53.682 03:03:28 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:53.682 03:03:28 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:53.682 03:03:28 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:53.682 03:03:28 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:53.682 03:03:28 -- setup/common.sh@18 -- # local node=0 00:02:53.682 03:03:28 -- setup/common.sh@19 -- # local var val 00:02:53.682 03:03:28 -- setup/common.sh@20 -- # local mem_f mem 00:02:53.682 03:03:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:53.682 03:03:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:53.682 03:03:28 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:53.682 03:03:28 -- setup/common.sh@28 -- # mapfile -t mem 00:02:53.682 03:03:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32587572 kB' 'MemFree: 27268964 kB' 'MemUsed: 5318608 kB' 'SwapCached: 0 kB' 'Active: 3250016 kB' 'Inactive: 133200 kB' 'Active(anon): 2485772 kB' 'Inactive(anon): 0 kB' 'Active(file): 764244 kB' 'Inactive(file): 133200 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3021652 kB' 'Mapped: 148016 kB' 'AnonPages: 364700 kB' 'Shmem: 2124208 kB' 'KernelStack: 12152 kB' 'PageTables: 6240 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 105200 kB' 'Slab: 355664 kB' 'SReclaimable: 105200 kB' 'SUnreclaim: 250464 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 03:03:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@33 -- # echo 0 00:02:53.683 03:03:28 -- setup/common.sh@33 -- # return 0 00:02:53.683 03:03:28 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:53.683 03:03:28 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:53.683 03:03:28 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:53.683 03:03:28 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:53.683 03:03:28 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:53.683 03:03:28 -- setup/common.sh@18 -- # local node=1 00:02:53.683 03:03:28 -- setup/common.sh@19 -- # local var val 00:02:53.683 03:03:28 -- setup/common.sh@20 -- # local mem_f mem 00:02:53.683 03:03:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:53.683 03:03:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:53.683 03:03:28 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:53.683 03:03:28 -- setup/common.sh@28 -- # mapfile -t mem 00:02:53.683 03:03:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60735396 kB' 'MemFree: 50256792 kB' 'MemUsed: 10478604 kB' 'SwapCached: 0 kB' 'Active: 3999484 kB' 'Inactive: 3376568 kB' 'Active(anon): 3797820 kB' 'Inactive(anon): 0 kB' 'Active(file): 201664 kB' 'Inactive(file): 3376568 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7192512 kB' 'Mapped: 38436 kB' 'AnonPages: 183608 kB' 'Shmem: 3614280 kB' 'KernelStack: 7640 kB' 'PageTables: 2380 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 118408 kB' 'Slab: 340308 kB' 'SReclaimable: 118408 kB' 'SUnreclaim: 221900 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.683 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # continue 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 03:03:28 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 03:03:28 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 03:03:28 -- setup/common.sh@33 -- # echo 0 00:02:53.684 03:03:28 -- setup/common.sh@33 -- # return 0 00:02:53.684 03:03:28 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:53.684 03:03:28 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:53.684 03:03:28 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:53.684 03:03:28 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:53.684 03:03:28 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:02:53.684 node0=512 expecting 513 00:02:53.684 03:03:28 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:53.684 03:03:28 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:53.684 03:03:28 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:53.684 03:03:28 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:02:53.684 node1=513 expecting 512 00:02:53.684 03:03:28 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:02:53.684 00:02:53.684 real 0m3.425s 00:02:53.684 user 0m1.379s 00:02:53.684 sys 0m2.100s 00:02:53.684 03:03:28 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:02:53.684 03:03:28 -- common/autotest_common.sh@10 -- # set +x 00:02:53.684 ************************************ 00:02:53.684 END TEST odd_alloc 00:02:53.684 ************************************ 00:02:53.684 03:03:28 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:02:53.684 03:03:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:53.684 03:03:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:53.684 03:03:28 -- common/autotest_common.sh@10 -- # set +x 00:02:53.943 ************************************ 00:02:53.943 START TEST custom_alloc 00:02:53.943 ************************************ 00:02:53.943 03:03:28 -- common/autotest_common.sh@1111 -- # custom_alloc 00:02:53.943 03:03:28 -- setup/hugepages.sh@167 -- # local IFS=, 00:02:53.943 03:03:28 -- setup/hugepages.sh@169 -- # local node 00:02:53.943 03:03:28 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:02:53.943 03:03:28 -- setup/hugepages.sh@170 -- # local nodes_hp 00:02:53.943 03:03:28 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:02:53.943 03:03:28 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:02:53.943 03:03:28 -- setup/hugepages.sh@49 -- # local size=1048576 00:02:53.943 03:03:28 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:53.943 03:03:28 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:53.943 03:03:28 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:02:53.943 03:03:28 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:53.943 03:03:28 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:53.943 03:03:28 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:53.943 03:03:28 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:02:53.943 03:03:28 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:53.943 03:03:28 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:53.943 03:03:28 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:53.943 03:03:28 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:53.943 03:03:28 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:02:53.943 03:03:28 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:53.943 03:03:28 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:02:53.943 03:03:28 -- setup/hugepages.sh@83 -- # : 256 00:02:53.943 03:03:28 -- setup/hugepages.sh@84 -- # : 1 00:02:53.943 03:03:28 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:53.943 03:03:28 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:02:53.943 03:03:28 -- setup/hugepages.sh@83 -- # : 0 00:02:53.943 03:03:28 -- setup/hugepages.sh@84 -- # : 0 00:02:53.943 03:03:28 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:53.943 03:03:28 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:02:53.943 03:03:28 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:02:53.943 03:03:28 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:02:53.943 03:03:28 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:53.943 03:03:28 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:53.943 03:03:28 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:53.943 03:03:28 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:53.943 03:03:28 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:53.943 03:03:28 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:53.943 03:03:28 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:53.943 03:03:28 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:53.943 03:03:28 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:53.943 03:03:28 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:53.943 03:03:28 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:53.943 03:03:28 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:53.943 03:03:28 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:02:53.943 03:03:28 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:02:53.943 03:03:28 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:02:53.943 03:03:28 -- setup/hugepages.sh@78 -- # return 0 00:02:53.943 03:03:28 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:02:53.943 03:03:28 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:02:53.943 03:03:28 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:02:53.943 03:03:28 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:02:53.943 03:03:28 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:02:53.943 03:03:28 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:02:53.943 03:03:28 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:02:53.943 03:03:28 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:02:53.943 03:03:28 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:53.943 03:03:28 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:53.943 03:03:28 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:53.943 03:03:28 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:53.943 03:03:28 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:53.943 03:03:28 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:53.943 03:03:28 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:53.943 03:03:28 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:02:53.943 03:03:28 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:02:53.943 03:03:28 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:02:53.943 03:03:28 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:02:53.943 03:03:28 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:02:53.943 03:03:28 -- setup/hugepages.sh@78 -- # return 0 00:02:53.943 03:03:28 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:02:53.943 03:03:28 -- setup/hugepages.sh@187 -- # setup output 00:02:53.943 03:03:28 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:53.943 03:03:28 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh 00:02:56.472 0000:5f:00.0 (1b96 2600): Skipping denied controller at 0000:5f:00.0 00:02:56.730 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:02:56.730 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:56.730 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:02:56.730 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:02:56.730 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:02:56.730 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:02:56.730 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:02:56.730 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:02:56.730 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:02:56.730 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:02:56.730 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:02:56.730 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:02:56.730 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:02:56.730 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:02:56.730 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:02:56.730 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:02:56.730 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:02:56.993 03:03:31 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:02:56.993 03:03:31 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:02:56.993 03:03:31 -- setup/hugepages.sh@89 -- # local node 00:02:56.993 03:03:31 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:56.993 03:03:31 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:56.993 03:03:31 -- setup/hugepages.sh@92 -- # local surp 00:02:56.993 03:03:31 -- setup/hugepages.sh@93 -- # local resv 00:02:56.993 03:03:31 -- setup/hugepages.sh@94 -- # local anon 00:02:56.993 03:03:31 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:56.993 03:03:31 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:56.993 03:03:31 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:56.993 03:03:31 -- setup/common.sh@18 -- # local node= 00:02:56.993 03:03:31 -- setup/common.sh@19 -- # local var val 00:02:56.993 03:03:31 -- setup/common.sh@20 -- # local mem_f mem 00:02:56.993 03:03:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:56.993 03:03:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:56.993 03:03:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:56.993 03:03:31 -- setup/common.sh@28 -- # mapfile -t mem 00:02:56.993 03:03:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.993 03:03:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 76477476 kB' 'MemAvailable: 80468944 kB' 'Buffers: 12048 kB' 'Cached: 10202196 kB' 'SwapCached: 0 kB' 'Active: 7250564 kB' 'Inactive: 3509768 kB' 'Active(anon): 6284656 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 548984 kB' 'Mapped: 186544 kB' 'Shmem: 5738568 kB' 'KReclaimable: 223608 kB' 'Slab: 695380 kB' 'SReclaimable: 223608 kB' 'SUnreclaim: 471772 kB' 'KernelStack: 20128 kB' 'PageTables: 9460 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53477224 kB' 'Committed_AS: 7640684 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218968 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.993 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.993 03:03:31 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.994 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.994 03:03:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.994 03:03:31 -- setup/common.sh@33 -- # echo 0 00:02:56.994 03:03:31 -- setup/common.sh@33 -- # return 0 00:02:56.994 03:03:31 -- setup/hugepages.sh@97 -- # anon=0 00:02:56.994 03:03:31 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:56.994 03:03:31 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:56.994 03:03:31 -- setup/common.sh@18 -- # local node= 00:02:56.994 03:03:31 -- setup/common.sh@19 -- # local var val 00:02:56.994 03:03:31 -- setup/common.sh@20 -- # local mem_f mem 00:02:56.994 03:03:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:56.994 03:03:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:56.994 03:03:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:56.994 03:03:31 -- setup/common.sh@28 -- # mapfile -t mem 00:02:56.994 03:03:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.995 03:03:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 76478776 kB' 'MemAvailable: 80470244 kB' 'Buffers: 12048 kB' 'Cached: 10202200 kB' 'SwapCached: 0 kB' 'Active: 7250212 kB' 'Inactive: 3509768 kB' 'Active(anon): 6284304 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 548924 kB' 'Mapped: 186484 kB' 'Shmem: 5738572 kB' 'KReclaimable: 223608 kB' 'Slab: 695492 kB' 'SReclaimable: 223608 kB' 'SUnreclaim: 471884 kB' 'KernelStack: 19872 kB' 'PageTables: 8604 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53477224 kB' 'Committed_AS: 7640696 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218840 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.995 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.995 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.996 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.996 03:03:31 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.997 03:03:31 -- setup/common.sh@33 -- # echo 0 00:02:56.997 03:03:31 -- setup/common.sh@33 -- # return 0 00:02:56.997 03:03:31 -- setup/hugepages.sh@99 -- # surp=0 00:02:56.997 03:03:31 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:56.997 03:03:31 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:56.997 03:03:31 -- setup/common.sh@18 -- # local node= 00:02:56.997 03:03:31 -- setup/common.sh@19 -- # local var val 00:02:56.997 03:03:31 -- setup/common.sh@20 -- # local mem_f mem 00:02:56.997 03:03:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:56.997 03:03:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:56.997 03:03:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:56.997 03:03:31 -- setup/common.sh@28 -- # mapfile -t mem 00:02:56.997 03:03:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.997 03:03:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 76480080 kB' 'MemAvailable: 80471548 kB' 'Buffers: 12048 kB' 'Cached: 10202208 kB' 'SwapCached: 0 kB' 'Active: 7250224 kB' 'Inactive: 3509768 kB' 'Active(anon): 6284316 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 548912 kB' 'Mapped: 186484 kB' 'Shmem: 5738580 kB' 'KReclaimable: 223608 kB' 'Slab: 695460 kB' 'SReclaimable: 223608 kB' 'SUnreclaim: 471852 kB' 'KernelStack: 19952 kB' 'PageTables: 8860 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53477224 kB' 'Committed_AS: 7639188 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218968 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.997 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.997 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.998 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.998 03:03:31 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.998 03:03:31 -- setup/common.sh@33 -- # echo 0 00:02:56.998 03:03:31 -- setup/common.sh@33 -- # return 0 00:02:56.998 03:03:31 -- setup/hugepages.sh@100 -- # resv=0 00:02:56.998 03:03:31 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:02:56.998 nr_hugepages=1536 00:02:56.998 03:03:31 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:56.998 resv_hugepages=0 00:02:56.998 03:03:31 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:56.998 surplus_hugepages=0 00:02:56.998 03:03:31 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:56.998 anon_hugepages=0 00:02:56.998 03:03:31 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:02:56.998 03:03:31 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:02:56.998 03:03:31 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:56.998 03:03:31 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:56.998 03:03:31 -- setup/common.sh@18 -- # local node= 00:02:56.998 03:03:31 -- setup/common.sh@19 -- # local var val 00:02:56.998 03:03:31 -- setup/common.sh@20 -- # local mem_f mem 00:02:56.999 03:03:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:56.999 03:03:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:56.999 03:03:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:56.999 03:03:31 -- setup/common.sh@28 -- # mapfile -t mem 00:02:56.999 03:03:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.999 03:03:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 76480656 kB' 'MemAvailable: 80472124 kB' 'Buffers: 12048 kB' 'Cached: 10202228 kB' 'SwapCached: 0 kB' 'Active: 7252408 kB' 'Inactive: 3509768 kB' 'Active(anon): 6286500 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 551140 kB' 'Mapped: 186988 kB' 'Shmem: 5738600 kB' 'KReclaimable: 223608 kB' 'Slab: 695460 kB' 'SReclaimable: 223608 kB' 'SUnreclaim: 471852 kB' 'KernelStack: 20112 kB' 'PageTables: 9268 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53477224 kB' 'Committed_AS: 7642740 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218952 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.999 03:03:31 -- setup/common.sh@32 -- # continue 00:02:56.999 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.000 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.000 03:03:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:57.000 03:03:31 -- setup/common.sh@33 -- # echo 1536 00:02:57.000 03:03:31 -- setup/common.sh@33 -- # return 0 00:02:57.000 03:03:31 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:02:57.000 03:03:31 -- setup/hugepages.sh@112 -- # get_nodes 00:02:57.000 03:03:31 -- setup/hugepages.sh@27 -- # local node 00:02:57.000 03:03:31 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:57.000 03:03:31 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:57.000 03:03:31 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:57.000 03:03:31 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:02:57.000 03:03:31 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:57.000 03:03:31 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:57.000 03:03:31 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:57.000 03:03:31 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:57.000 03:03:31 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:57.000 03:03:31 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:57.000 03:03:31 -- setup/common.sh@18 -- # local node=0 00:02:57.000 03:03:31 -- setup/common.sh@19 -- # local var val 00:02:57.001 03:03:31 -- setup/common.sh@20 -- # local mem_f mem 00:02:57.001 03:03:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:57.001 03:03:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:57.001 03:03:31 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:57.001 03:03:31 -- setup/common.sh@28 -- # mapfile -t mem 00:02:57.001 03:03:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:57.001 03:03:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32587572 kB' 'MemFree: 27259236 kB' 'MemUsed: 5328336 kB' 'SwapCached: 0 kB' 'Active: 3256744 kB' 'Inactive: 133200 kB' 'Active(anon): 2492500 kB' 'Inactive(anon): 0 kB' 'Active(file): 764244 kB' 'Inactive(file): 133200 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3021724 kB' 'Mapped: 148048 kB' 'AnonPages: 371400 kB' 'Shmem: 2124280 kB' 'KernelStack: 12424 kB' 'PageTables: 6696 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 105200 kB' 'Slab: 355288 kB' 'SReclaimable: 105200 kB' 'SUnreclaim: 250088 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.001 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.001 03:03:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@33 -- # echo 0 00:02:57.002 03:03:31 -- setup/common.sh@33 -- # return 0 00:02:57.002 03:03:31 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:57.002 03:03:31 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:57.002 03:03:31 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:57.002 03:03:31 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:57.002 03:03:31 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:57.002 03:03:31 -- setup/common.sh@18 -- # local node=1 00:02:57.002 03:03:31 -- setup/common.sh@19 -- # local var val 00:02:57.002 03:03:31 -- setup/common.sh@20 -- # local mem_f mem 00:02:57.002 03:03:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:57.002 03:03:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:57.002 03:03:31 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:57.002 03:03:31 -- setup/common.sh@28 -- # mapfile -t mem 00:02:57.002 03:03:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.002 03:03:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60735396 kB' 'MemFree: 49213228 kB' 'MemUsed: 11522168 kB' 'SwapCached: 0 kB' 'Active: 3999456 kB' 'Inactive: 3376568 kB' 'Active(anon): 3797792 kB' 'Inactive(anon): 0 kB' 'Active(file): 201664 kB' 'Inactive(file): 3376568 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7192580 kB' 'Mapped: 38432 kB' 'AnonPages: 183524 kB' 'Shmem: 3614348 kB' 'KernelStack: 7592 kB' 'PageTables: 2240 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 118408 kB' 'Slab: 340172 kB' 'SReclaimable: 118408 kB' 'SUnreclaim: 221764 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.002 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.002 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.003 03:03:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.003 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.003 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.003 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.003 03:03:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.003 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.003 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.003 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.003 03:03:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.003 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.003 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.003 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.003 03:03:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.003 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.003 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.003 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.003 03:03:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.003 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.003 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.261 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.261 03:03:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.261 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.261 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.261 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.261 03:03:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.261 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.261 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.261 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.261 03:03:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.261 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.261 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.262 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.262 03:03:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.262 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.262 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.262 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.262 03:03:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.262 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.262 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.262 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.262 03:03:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.262 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.262 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.262 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.262 03:03:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.262 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.262 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.262 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.262 03:03:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.262 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.262 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.262 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.262 03:03:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.262 03:03:31 -- setup/common.sh@32 -- # continue 00:02:57.262 03:03:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:57.262 03:03:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:57.262 03:03:31 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:57.262 03:03:31 -- setup/common.sh@33 -- # echo 0 00:02:57.262 03:03:31 -- setup/common.sh@33 -- # return 0 00:02:57.262 03:03:31 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:57.262 03:03:31 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:57.262 03:03:31 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:57.262 03:03:31 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:57.262 03:03:31 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:02:57.262 node0=512 expecting 512 00:02:57.262 03:03:31 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:57.262 03:03:31 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:57.262 03:03:31 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:57.262 03:03:31 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:02:57.262 node1=1024 expecting 1024 00:02:57.262 03:03:31 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:02:57.262 00:02:57.262 real 0m3.212s 00:02:57.262 user 0m1.264s 00:02:57.262 sys 0m1.880s 00:02:57.262 03:03:31 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:02:57.262 03:03:31 -- common/autotest_common.sh@10 -- # set +x 00:02:57.262 ************************************ 00:02:57.262 END TEST custom_alloc 00:02:57.262 ************************************ 00:02:57.262 03:03:31 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:02:57.262 03:03:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:57.262 03:03:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:57.262 03:03:31 -- common/autotest_common.sh@10 -- # set +x 00:02:57.262 ************************************ 00:02:57.262 START TEST no_shrink_alloc 00:02:57.262 ************************************ 00:02:57.262 03:03:31 -- common/autotest_common.sh@1111 -- # no_shrink_alloc 00:02:57.262 03:03:31 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:02:57.262 03:03:31 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:57.262 03:03:31 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:02:57.262 03:03:31 -- setup/hugepages.sh@51 -- # shift 00:02:57.262 03:03:31 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:02:57.262 03:03:31 -- setup/hugepages.sh@52 -- # local node_ids 00:02:57.262 03:03:31 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:57.262 03:03:31 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:57.262 03:03:31 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:02:57.262 03:03:31 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:02:57.262 03:03:31 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:57.262 03:03:31 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:57.262 03:03:31 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:57.262 03:03:31 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:57.262 03:03:31 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:57.262 03:03:31 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:02:57.262 03:03:31 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:57.262 03:03:31 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:02:57.262 03:03:31 -- setup/hugepages.sh@73 -- # return 0 00:02:57.262 03:03:31 -- setup/hugepages.sh@198 -- # setup output 00:02:57.262 03:03:31 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:57.262 03:03:31 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh 00:02:59.790 0000:5f:00.0 (1b96 2600): Skipping denied controller at 0000:5f:00.0 00:03:00.048 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:00.048 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:00.048 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:00.048 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:00.048 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:00.048 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:00.048 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:00.048 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:00.048 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:00.048 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:00.048 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:00.048 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:00.048 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:00.048 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:00.048 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:00.048 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:00.048 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:00.310 03:03:34 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:03:00.310 03:03:34 -- setup/hugepages.sh@89 -- # local node 00:03:00.310 03:03:34 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:00.310 03:03:34 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:00.310 03:03:34 -- setup/hugepages.sh@92 -- # local surp 00:03:00.310 03:03:34 -- setup/hugepages.sh@93 -- # local resv 00:03:00.310 03:03:34 -- setup/hugepages.sh@94 -- # local anon 00:03:00.310 03:03:34 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:00.310 03:03:34 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:00.310 03:03:34 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:00.310 03:03:34 -- setup/common.sh@18 -- # local node= 00:03:00.310 03:03:34 -- setup/common.sh@19 -- # local var val 00:03:00.310 03:03:34 -- setup/common.sh@20 -- # local mem_f mem 00:03:00.310 03:03:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:00.310 03:03:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:00.310 03:03:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:00.310 03:03:34 -- setup/common.sh@28 -- # mapfile -t mem 00:03:00.310 03:03:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:00.310 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.310 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.310 03:03:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 77446972 kB' 'MemAvailable: 81438440 kB' 'Buffers: 12048 kB' 'Cached: 10202320 kB' 'SwapCached: 0 kB' 'Active: 7250924 kB' 'Inactive: 3509768 kB' 'Active(anon): 6285016 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 549280 kB' 'Mapped: 186508 kB' 'Shmem: 5738692 kB' 'KReclaimable: 223608 kB' 'Slab: 695432 kB' 'SReclaimable: 223608 kB' 'SUnreclaim: 471824 kB' 'KernelStack: 19824 kB' 'PageTables: 8712 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 54001512 kB' 'Committed_AS: 7638212 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218744 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:03:00.310 03:03:34 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.310 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.310 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.310 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.310 03:03:34 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.310 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.310 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.310 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.310 03:03:34 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.310 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.310 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.311 03:03:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:00.311 03:03:34 -- setup/common.sh@33 -- # echo 0 00:03:00.311 03:03:34 -- setup/common.sh@33 -- # return 0 00:03:00.311 03:03:34 -- setup/hugepages.sh@97 -- # anon=0 00:03:00.311 03:03:34 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:00.311 03:03:34 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:00.311 03:03:34 -- setup/common.sh@18 -- # local node= 00:03:00.311 03:03:34 -- setup/common.sh@19 -- # local var val 00:03:00.311 03:03:34 -- setup/common.sh@20 -- # local mem_f mem 00:03:00.311 03:03:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:00.311 03:03:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:00.311 03:03:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:00.311 03:03:34 -- setup/common.sh@28 -- # mapfile -t mem 00:03:00.311 03:03:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.311 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 77447072 kB' 'MemAvailable: 81438540 kB' 'Buffers: 12048 kB' 'Cached: 10202320 kB' 'SwapCached: 0 kB' 'Active: 7250988 kB' 'Inactive: 3509768 kB' 'Active(anon): 6285080 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 549800 kB' 'Mapped: 187012 kB' 'Shmem: 5738692 kB' 'KReclaimable: 223608 kB' 'Slab: 695448 kB' 'SReclaimable: 223608 kB' 'SUnreclaim: 471840 kB' 'KernelStack: 19760 kB' 'PageTables: 8508 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 54001512 kB' 'Committed_AS: 7640108 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218712 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.312 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.312 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.313 03:03:34 -- setup/common.sh@33 -- # echo 0 00:03:00.313 03:03:34 -- setup/common.sh@33 -- # return 0 00:03:00.313 03:03:34 -- setup/hugepages.sh@99 -- # surp=0 00:03:00.313 03:03:34 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:00.313 03:03:34 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:00.313 03:03:34 -- setup/common.sh@18 -- # local node= 00:03:00.313 03:03:34 -- setup/common.sh@19 -- # local var val 00:03:00.313 03:03:34 -- setup/common.sh@20 -- # local mem_f mem 00:03:00.313 03:03:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:00.313 03:03:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:00.313 03:03:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:00.313 03:03:34 -- setup/common.sh@28 -- # mapfile -t mem 00:03:00.313 03:03:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 77442324 kB' 'MemAvailable: 81433792 kB' 'Buffers: 12048 kB' 'Cached: 10202336 kB' 'SwapCached: 0 kB' 'Active: 7255640 kB' 'Inactive: 3509768 kB' 'Active(anon): 6289732 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 554492 kB' 'Mapped: 187360 kB' 'Shmem: 5738708 kB' 'KReclaimable: 223608 kB' 'Slab: 695448 kB' 'SReclaimable: 223608 kB' 'SUnreclaim: 471840 kB' 'KernelStack: 19792 kB' 'PageTables: 8640 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 54001512 kB' 'Committed_AS: 7644356 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218716 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.313 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.313 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.314 03:03:34 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:00.314 03:03:34 -- setup/common.sh@33 -- # echo 0 00:03:00.314 03:03:34 -- setup/common.sh@33 -- # return 0 00:03:00.314 03:03:34 -- setup/hugepages.sh@100 -- # resv=0 00:03:00.314 03:03:34 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:00.314 nr_hugepages=1024 00:03:00.314 03:03:34 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:00.314 resv_hugepages=0 00:03:00.314 03:03:34 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:00.314 surplus_hugepages=0 00:03:00.314 03:03:34 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:00.314 anon_hugepages=0 00:03:00.314 03:03:34 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:00.314 03:03:34 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:00.314 03:03:34 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:00.314 03:03:34 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:00.314 03:03:34 -- setup/common.sh@18 -- # local node= 00:03:00.314 03:03:34 -- setup/common.sh@19 -- # local var val 00:03:00.314 03:03:34 -- setup/common.sh@20 -- # local mem_f mem 00:03:00.314 03:03:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:00.314 03:03:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:00.314 03:03:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:00.314 03:03:34 -- setup/common.sh@28 -- # mapfile -t mem 00:03:00.314 03:03:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.314 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.315 03:03:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 77449616 kB' 'MemAvailable: 81441084 kB' 'Buffers: 12048 kB' 'Cached: 10202352 kB' 'SwapCached: 0 kB' 'Active: 7249984 kB' 'Inactive: 3509768 kB' 'Active(anon): 6284076 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 548760 kB' 'Mapped: 186508 kB' 'Shmem: 5738724 kB' 'KReclaimable: 223608 kB' 'Slab: 695448 kB' 'SReclaimable: 223608 kB' 'SUnreclaim: 471840 kB' 'KernelStack: 19776 kB' 'PageTables: 8564 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 54001512 kB' 'Committed_AS: 7638252 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218696 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.315 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.315 03:03:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:00.316 03:03:34 -- setup/common.sh@33 -- # echo 1024 00:03:00.316 03:03:34 -- setup/common.sh@33 -- # return 0 00:03:00.316 03:03:34 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:00.316 03:03:34 -- setup/hugepages.sh@112 -- # get_nodes 00:03:00.316 03:03:34 -- setup/hugepages.sh@27 -- # local node 00:03:00.316 03:03:34 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:00.316 03:03:34 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:00.316 03:03:34 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:00.316 03:03:34 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:00.316 03:03:34 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:00.316 03:03:34 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:00.316 03:03:34 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:00.316 03:03:34 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:00.316 03:03:34 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:00.316 03:03:34 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:00.316 03:03:34 -- setup/common.sh@18 -- # local node=0 00:03:00.316 03:03:34 -- setup/common.sh@19 -- # local var val 00:03:00.316 03:03:34 -- setup/common.sh@20 -- # local mem_f mem 00:03:00.316 03:03:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:00.316 03:03:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:00.316 03:03:34 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:00.316 03:03:34 -- setup/common.sh@28 -- # mapfile -t mem 00:03:00.316 03:03:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:00.316 03:03:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32587572 kB' 'MemFree: 26205624 kB' 'MemUsed: 6381948 kB' 'SwapCached: 0 kB' 'Active: 3249348 kB' 'Inactive: 133200 kB' 'Active(anon): 2485104 kB' 'Inactive(anon): 0 kB' 'Active(file): 764244 kB' 'Inactive(file): 133200 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3021800 kB' 'Mapped: 148080 kB' 'AnonPages: 364048 kB' 'Shmem: 2124356 kB' 'KernelStack: 12120 kB' 'PageTables: 6092 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 105200 kB' 'Slab: 355308 kB' 'SReclaimable: 105200 kB' 'SUnreclaim: 250108 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.316 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.316 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # continue 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:00.317 03:03:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:00.317 03:03:34 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:00.317 03:03:34 -- setup/common.sh@33 -- # echo 0 00:03:00.317 03:03:34 -- setup/common.sh@33 -- # return 0 00:03:00.317 03:03:34 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:00.317 03:03:34 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:00.317 03:03:34 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:00.317 03:03:34 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:00.317 03:03:34 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:00.317 node0=1024 expecting 1024 00:03:00.317 03:03:34 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:00.317 03:03:34 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:03:00.317 03:03:34 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:03:00.317 03:03:34 -- setup/hugepages.sh@202 -- # setup output 00:03:00.317 03:03:34 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:00.317 03:03:34 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh 00:03:03.607 0000:5f:00.0 (1b96 2600): Skipping denied controller at 0000:5f:00.0 00:03:03.607 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:03.607 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:03.607 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:03.607 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:03.607 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:03.607 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:03.607 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:03.607 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:03.607 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:03.607 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:03.607 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:03.607 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:03.607 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:03.607 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:03.607 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:03.607 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:03.607 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:03.607 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:03:03.607 03:03:37 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:03:03.607 03:03:37 -- setup/hugepages.sh@89 -- # local node 00:03:03.607 03:03:37 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:03.607 03:03:37 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:03.607 03:03:37 -- setup/hugepages.sh@92 -- # local surp 00:03:03.607 03:03:37 -- setup/hugepages.sh@93 -- # local resv 00:03:03.607 03:03:37 -- setup/hugepages.sh@94 -- # local anon 00:03:03.607 03:03:37 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:03.607 03:03:37 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:03.607 03:03:37 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:03.607 03:03:37 -- setup/common.sh@18 -- # local node= 00:03:03.607 03:03:37 -- setup/common.sh@19 -- # local var val 00:03:03.607 03:03:37 -- setup/common.sh@20 -- # local mem_f mem 00:03:03.607 03:03:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:03.607 03:03:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:03.607 03:03:37 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:03.607 03:03:37 -- setup/common.sh@28 -- # mapfile -t mem 00:03:03.607 03:03:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 77468860 kB' 'MemAvailable: 81460328 kB' 'Buffers: 12048 kB' 'Cached: 10202424 kB' 'SwapCached: 0 kB' 'Active: 7257644 kB' 'Inactive: 3509768 kB' 'Active(anon): 6291736 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 555792 kB' 'Mapped: 187324 kB' 'Shmem: 5738796 kB' 'KReclaimable: 223608 kB' 'Slab: 695708 kB' 'SReclaimable: 223608 kB' 'SUnreclaim: 472100 kB' 'KernelStack: 19824 kB' 'PageTables: 8736 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 54001512 kB' 'Committed_AS: 7645092 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218764 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.607 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.607 03:03:37 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.608 03:03:37 -- setup/common.sh@33 -- # echo 0 00:03:03.608 03:03:37 -- setup/common.sh@33 -- # return 0 00:03:03.608 03:03:37 -- setup/hugepages.sh@97 -- # anon=0 00:03:03.608 03:03:37 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:03.608 03:03:37 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:03.608 03:03:37 -- setup/common.sh@18 -- # local node= 00:03:03.608 03:03:37 -- setup/common.sh@19 -- # local var val 00:03:03.608 03:03:37 -- setup/common.sh@20 -- # local mem_f mem 00:03:03.608 03:03:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:03.608 03:03:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:03.608 03:03:37 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:03.608 03:03:37 -- setup/common.sh@28 -- # mapfile -t mem 00:03:03.608 03:03:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 77472612 kB' 'MemAvailable: 81464080 kB' 'Buffers: 12048 kB' 'Cached: 10202424 kB' 'SwapCached: 0 kB' 'Active: 7252244 kB' 'Inactive: 3509768 kB' 'Active(anon): 6286336 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 550392 kB' 'Mapped: 186596 kB' 'Shmem: 5738796 kB' 'KReclaimable: 223608 kB' 'Slab: 695788 kB' 'SReclaimable: 223608 kB' 'SUnreclaim: 472180 kB' 'KernelStack: 19792 kB' 'PageTables: 8604 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 54001512 kB' 'Committed_AS: 7641660 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218744 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:37 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.608 03:03:37 -- setup/common.sh@33 -- # echo 0 00:03:03.608 03:03:37 -- setup/common.sh@33 -- # return 0 00:03:03.608 03:03:37 -- setup/hugepages.sh@99 -- # surp=0 00:03:03.608 03:03:38 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:03.608 03:03:38 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:03.608 03:03:38 -- setup/common.sh@18 -- # local node= 00:03:03.608 03:03:38 -- setup/common.sh@19 -- # local var val 00:03:03.608 03:03:38 -- setup/common.sh@20 -- # local mem_f mem 00:03:03.608 03:03:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:03.608 03:03:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:03.608 03:03:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:03.608 03:03:38 -- setup/common.sh@28 -- # mapfile -t mem 00:03:03.608 03:03:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:03.608 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 77472108 kB' 'MemAvailable: 81463576 kB' 'Buffers: 12048 kB' 'Cached: 10202424 kB' 'SwapCached: 0 kB' 'Active: 7252112 kB' 'Inactive: 3509768 kB' 'Active(anon): 6286204 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 550248 kB' 'Mapped: 186596 kB' 'Shmem: 5738796 kB' 'KReclaimable: 223608 kB' 'Slab: 695788 kB' 'SReclaimable: 223608 kB' 'SUnreclaim: 472180 kB' 'KernelStack: 19744 kB' 'PageTables: 8476 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 54001512 kB' 'Committed_AS: 7640324 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218744 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:03:03.608 03:03:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.608 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.608 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.608 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.608 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.608 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.608 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.608 03:03:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.609 03:03:38 -- setup/common.sh@33 -- # echo 0 00:03:03.609 03:03:38 -- setup/common.sh@33 -- # return 0 00:03:03.609 03:03:38 -- setup/hugepages.sh@100 -- # resv=0 00:03:03.609 03:03:38 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:03.609 nr_hugepages=1024 00:03:03.609 03:03:38 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:03.609 resv_hugepages=0 00:03:03.609 03:03:38 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:03.609 surplus_hugepages=0 00:03:03.609 03:03:38 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:03.609 anon_hugepages=0 00:03:03.609 03:03:38 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:03.609 03:03:38 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:03.609 03:03:38 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:03.609 03:03:38 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:03.609 03:03:38 -- setup/common.sh@18 -- # local node= 00:03:03.609 03:03:38 -- setup/common.sh@19 -- # local var val 00:03:03.609 03:03:38 -- setup/common.sh@20 -- # local mem_f mem 00:03:03.609 03:03:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:03.609 03:03:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:03.609 03:03:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:03.609 03:03:38 -- setup/common.sh@28 -- # mapfile -t mem 00:03:03.609 03:03:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:03.609 03:03:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93322968 kB' 'MemFree: 77469556 kB' 'MemAvailable: 81461024 kB' 'Buffers: 12048 kB' 'Cached: 10202432 kB' 'SwapCached: 0 kB' 'Active: 7253352 kB' 'Inactive: 3509768 kB' 'Active(anon): 6287444 kB' 'Inactive(anon): 0 kB' 'Active(file): 965908 kB' 'Inactive(file): 3509768 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 551528 kB' 'Mapped: 186596 kB' 'Shmem: 5738804 kB' 'KReclaimable: 223608 kB' 'Slab: 695788 kB' 'SReclaimable: 223608 kB' 'SUnreclaim: 472180 kB' 'KernelStack: 20032 kB' 'PageTables: 9112 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 54001512 kB' 'Committed_AS: 7641688 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218888 kB' 'VmallocChunk: 0 kB' 'Percpu: 64128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1657812 kB' 'DirectMap2M: 14798848 kB' 'DirectMap1G: 85983232 kB' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.609 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.609 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.610 03:03:38 -- setup/common.sh@33 -- # echo 1024 00:03:03.610 03:03:38 -- setup/common.sh@33 -- # return 0 00:03:03.610 03:03:38 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:03.610 03:03:38 -- setup/hugepages.sh@112 -- # get_nodes 00:03:03.610 03:03:38 -- setup/hugepages.sh@27 -- # local node 00:03:03.610 03:03:38 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:03.610 03:03:38 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:03.610 03:03:38 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:03.610 03:03:38 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:03.610 03:03:38 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:03.610 03:03:38 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:03.610 03:03:38 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:03.610 03:03:38 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:03.610 03:03:38 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:03.610 03:03:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:03.610 03:03:38 -- setup/common.sh@18 -- # local node=0 00:03:03.610 03:03:38 -- setup/common.sh@19 -- # local var val 00:03:03.610 03:03:38 -- setup/common.sh@20 -- # local mem_f mem 00:03:03.610 03:03:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:03.610 03:03:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:03.610 03:03:38 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:03.610 03:03:38 -- setup/common.sh@28 -- # mapfile -t mem 00:03:03.610 03:03:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32587572 kB' 'MemFree: 26211776 kB' 'MemUsed: 6375796 kB' 'SwapCached: 0 kB' 'Active: 3250616 kB' 'Inactive: 133200 kB' 'Active(anon): 2486372 kB' 'Inactive(anon): 0 kB' 'Active(file): 764244 kB' 'Inactive(file): 133200 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3021836 kB' 'Mapped: 148172 kB' 'AnonPages: 365148 kB' 'Shmem: 2124392 kB' 'KernelStack: 12120 kB' 'PageTables: 5824 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 105200 kB' 'Slab: 355544 kB' 'SReclaimable: 105200 kB' 'SUnreclaim: 250344 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.610 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.610 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.611 03:03:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.611 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.611 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.611 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.611 03:03:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.611 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.611 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.611 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.611 03:03:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.611 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.611 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.611 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.611 03:03:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.611 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.611 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.611 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.611 03:03:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.611 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.611 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.611 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.611 03:03:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.611 03:03:38 -- setup/common.sh@32 -- # continue 00:03:03.611 03:03:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.611 03:03:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.611 03:03:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.611 03:03:38 -- setup/common.sh@33 -- # echo 0 00:03:03.611 03:03:38 -- setup/common.sh@33 -- # return 0 00:03:03.611 03:03:38 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:03.611 03:03:38 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:03.611 03:03:38 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:03.611 03:03:38 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:03.611 03:03:38 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:03.611 node0=1024 expecting 1024 00:03:03.611 03:03:38 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:03.611 00:03:03.611 real 0m6.434s 00:03:03.611 user 0m2.555s 00:03:03.611 sys 0m3.943s 00:03:03.611 03:03:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:03.611 03:03:38 -- common/autotest_common.sh@10 -- # set +x 00:03:03.611 ************************************ 00:03:03.611 END TEST no_shrink_alloc 00:03:03.611 ************************************ 00:03:03.869 03:03:38 -- setup/hugepages.sh@217 -- # clear_hp 00:03:03.869 03:03:38 -- setup/hugepages.sh@37 -- # local node hp 00:03:03.869 03:03:38 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:03.869 03:03:38 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:03.869 03:03:38 -- setup/hugepages.sh@41 -- # echo 0 00:03:03.869 03:03:38 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:03.869 03:03:38 -- setup/hugepages.sh@41 -- # echo 0 00:03:03.869 03:03:38 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:03.869 03:03:38 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:03.869 03:03:38 -- setup/hugepages.sh@41 -- # echo 0 00:03:03.869 03:03:38 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:03.869 03:03:38 -- setup/hugepages.sh@41 -- # echo 0 00:03:03.869 03:03:38 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:03.869 03:03:38 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:03.869 00:03:03.869 real 0m24.988s 00:03:03.869 user 0m9.747s 00:03:03.869 sys 0m14.569s 00:03:03.869 03:03:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:03.869 03:03:38 -- common/autotest_common.sh@10 -- # set +x 00:03:03.869 ************************************ 00:03:03.869 END TEST hugepages 00:03:03.869 ************************************ 00:03:03.869 03:03:38 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/driver.sh 00:03:03.869 03:03:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:03.869 03:03:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:03.869 03:03:38 -- common/autotest_common.sh@10 -- # set +x 00:03:03.869 ************************************ 00:03:03.869 START TEST driver 00:03:03.869 ************************************ 00:03:03.869 03:03:38 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/driver.sh 00:03:04.127 * Looking for test storage... 00:03:04.127 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup 00:03:04.127 03:03:38 -- setup/driver.sh@68 -- # setup reset 00:03:04.128 03:03:38 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:04.128 03:03:38 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh reset 00:03:08.400 03:03:42 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:03:08.400 03:03:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:08.400 03:03:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:08.400 03:03:42 -- common/autotest_common.sh@10 -- # set +x 00:03:08.659 ************************************ 00:03:08.659 START TEST guess_driver 00:03:08.659 ************************************ 00:03:08.659 03:03:42 -- common/autotest_common.sh@1111 -- # guess_driver 00:03:08.659 03:03:42 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:03:08.659 03:03:42 -- setup/driver.sh@47 -- # local fail=0 00:03:08.659 03:03:42 -- setup/driver.sh@49 -- # pick_driver 00:03:08.659 03:03:42 -- setup/driver.sh@36 -- # vfio 00:03:08.659 03:03:42 -- setup/driver.sh@21 -- # local iommu_grups 00:03:08.659 03:03:42 -- setup/driver.sh@22 -- # local unsafe_vfio 00:03:08.659 03:03:42 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:03:08.659 03:03:42 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:03:08.659 03:03:42 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:03:08.659 03:03:42 -- setup/driver.sh@29 -- # (( 220 > 0 )) 00:03:08.659 03:03:42 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:03:08.659 03:03:42 -- setup/driver.sh@14 -- # mod vfio_pci 00:03:08.659 03:03:42 -- setup/driver.sh@12 -- # dep vfio_pci 00:03:08.659 03:03:42 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:03:08.659 03:03:42 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:03:08.659 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:08.659 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:08.659 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:08.659 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:08.659 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:03:08.659 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:03:08.659 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:03:08.659 03:03:42 -- setup/driver.sh@30 -- # return 0 00:03:08.659 03:03:42 -- setup/driver.sh@37 -- # echo vfio-pci 00:03:08.659 03:03:42 -- setup/driver.sh@49 -- # driver=vfio-pci 00:03:08.659 03:03:42 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:03:08.659 03:03:42 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:03:08.659 Looking for driver=vfio-pci 00:03:08.659 03:03:42 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:08.659 03:03:42 -- setup/driver.sh@45 -- # setup output config 00:03:08.659 03:03:42 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:08.659 03:03:42 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh config 00:03:11.947 03:03:45 -- setup/driver.sh@58 -- # [[ denied == \-\> ]] 00:03:11.947 03:03:45 -- setup/driver.sh@58 -- # continue 00:03:11.947 03:03:45 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:11.947 03:03:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:11.947 03:03:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:11.947 03:03:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:11.947 03:03:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:11.947 03:03:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:11.947 03:03:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:11.947 03:03:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:11.947 03:03:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:11.947 03:03:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:11.947 03:03:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:11.947 03:03:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:11.947 03:03:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:11.947 03:03:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:11.947 03:03:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:11.947 03:03:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:11.947 03:03:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:11.947 03:03:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:11.947 03:03:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:11.947 03:03:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:11.947 03:03:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:11.947 03:03:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:11.947 03:03:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:11.947 03:03:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:11.947 03:03:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:11.947 03:03:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:11.947 03:03:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:11.947 03:03:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:11.947 03:03:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:11.947 03:03:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:11.947 03:03:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:11.947 03:03:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:11.947 03:03:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:11.947 03:03:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:11.947 03:03:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:11.947 03:03:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:11.947 03:03:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:11.947 03:03:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:11.947 03:03:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:11.947 03:03:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:11.947 03:03:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:11.947 03:03:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:11.947 03:03:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:11.947 03:03:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:11.947 03:03:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:11.947 03:03:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:11.947 03:03:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:11.947 03:03:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:11.947 03:03:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:12.884 03:03:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:12.884 03:03:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:12.884 03:03:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:12.884 03:03:47 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:03:12.884 03:03:47 -- setup/driver.sh@65 -- # setup reset 00:03:12.884 03:03:47 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:12.884 03:03:47 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh reset 00:03:17.066 00:03:17.066 real 0m8.444s 00:03:17.066 user 0m2.499s 00:03:17.066 sys 0m4.428s 00:03:17.066 03:03:51 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:17.066 03:03:51 -- common/autotest_common.sh@10 -- # set +x 00:03:17.066 ************************************ 00:03:17.066 END TEST guess_driver 00:03:17.066 ************************************ 00:03:17.066 00:03:17.066 real 0m13.129s 00:03:17.066 user 0m3.949s 00:03:17.066 sys 0m6.894s 00:03:17.066 03:03:51 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:17.066 03:03:51 -- common/autotest_common.sh@10 -- # set +x 00:03:17.066 ************************************ 00:03:17.066 END TEST driver 00:03:17.066 ************************************ 00:03:17.066 03:03:51 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/devices.sh 00:03:17.067 03:03:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:17.067 03:03:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:17.067 03:03:51 -- common/autotest_common.sh@10 -- # set +x 00:03:17.324 ************************************ 00:03:17.324 START TEST devices 00:03:17.324 ************************************ 00:03:17.324 03:03:51 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/devices.sh 00:03:17.324 * Looking for test storage... 00:03:17.324 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup 00:03:17.324 03:03:51 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:17.324 03:03:51 -- setup/devices.sh@192 -- # setup reset 00:03:17.324 03:03:51 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:17.324 03:03:51 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh reset 00:03:21.510 03:03:55 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:21.510 03:03:55 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:03:21.510 03:03:55 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:03:21.510 03:03:55 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:03:21.511 03:03:55 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:03:21.511 03:03:55 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:03:21.511 03:03:55 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:03:21.511 03:03:55 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:21.511 03:03:55 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:03:21.511 03:03:55 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:03:21.511 03:03:55 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme1n1 00:03:21.511 03:03:55 -- common/autotest_common.sh@1648 -- # local device=nvme1n1 00:03:21.511 03:03:55 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme1n1/queue/zoned ]] 00:03:21.511 03:03:55 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:03:21.511 03:03:55 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:03:21.511 03:03:55 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme1n2 00:03:21.511 03:03:55 -- common/autotest_common.sh@1648 -- # local device=nvme1n2 00:03:21.511 03:03:55 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme1n2/queue/zoned ]] 00:03:21.511 03:03:55 -- common/autotest_common.sh@1651 -- # [[ host-managed != none ]] 00:03:21.511 03:03:55 -- common/autotest_common.sh@1660 -- # zoned_devs["${nvme##*/}"]=0000:5f:00.0 00:03:21.511 03:03:55 -- setup/devices.sh@196 -- # blocks=() 00:03:21.511 03:03:55 -- setup/devices.sh@196 -- # declare -a blocks 00:03:21.511 03:03:55 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:21.511 03:03:55 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:21.511 03:03:55 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:21.511 03:03:55 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:21.511 03:03:55 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:21.511 03:03:55 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:21.511 03:03:55 -- setup/devices.sh@202 -- # pci=0000:5e:00.0 00:03:21.511 03:03:55 -- setup/devices.sh@203 -- # [[ 0000:5f:00.0 == *\0\0\0\0\:\5\e\:\0\0\.\0* ]] 00:03:21.511 03:03:55 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:21.511 03:03:55 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:03:21.511 03:03:55 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:21.511 No valid GPT data, bailing 00:03:21.511 03:03:55 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:21.511 03:03:55 -- scripts/common.sh@391 -- # pt= 00:03:21.511 03:03:55 -- scripts/common.sh@392 -- # return 1 00:03:21.511 03:03:55 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:21.511 03:03:55 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:21.511 03:03:55 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:21.511 03:03:55 -- setup/common.sh@80 -- # echo 1000204886016 00:03:21.511 03:03:55 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:03:21.511 03:03:55 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:21.511 03:03:55 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:5e:00.0 00:03:21.511 03:03:55 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:21.511 03:03:55 -- setup/devices.sh@201 -- # ctrl=nvme1n1 00:03:21.511 03:03:55 -- setup/devices.sh@201 -- # ctrl=nvme1 00:03:21.511 03:03:55 -- setup/devices.sh@202 -- # pci=0000:5f:00.0 00:03:21.511 03:03:55 -- setup/devices.sh@203 -- # [[ 0000:5f:00.0 == *\0\0\0\0\:\5\f\:\0\0\.\0* ]] 00:03:21.511 03:03:55 -- setup/devices.sh@203 -- # continue 00:03:21.511 03:03:55 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:21.511 03:03:55 -- setup/devices.sh@201 -- # ctrl=nvme1n2 00:03:21.511 03:03:55 -- setup/devices.sh@201 -- # ctrl=nvme1 00:03:21.511 03:03:55 -- setup/devices.sh@202 -- # pci=0000:5f:00.0 00:03:21.511 03:03:55 -- setup/devices.sh@203 -- # [[ 0000:5f:00.0 == *\0\0\0\0\:\5\f\:\0\0\.\0* ]] 00:03:21.511 03:03:55 -- setup/devices.sh@203 -- # continue 00:03:21.511 03:03:55 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:21.511 03:03:55 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:21.511 03:03:55 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:21.511 03:03:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:21.511 03:03:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:21.511 03:03:55 -- common/autotest_common.sh@10 -- # set +x 00:03:21.511 ************************************ 00:03:21.511 START TEST nvme_mount 00:03:21.511 ************************************ 00:03:21.511 03:03:55 -- common/autotest_common.sh@1111 -- # nvme_mount 00:03:21.511 03:03:55 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:21.511 03:03:55 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:21.511 03:03:55 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:03:21.511 03:03:55 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:21.511 03:03:55 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:21.511 03:03:55 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:21.511 03:03:55 -- setup/common.sh@40 -- # local part_no=1 00:03:21.511 03:03:55 -- setup/common.sh@41 -- # local size=1073741824 00:03:21.511 03:03:55 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:21.511 03:03:55 -- setup/common.sh@44 -- # parts=() 00:03:21.511 03:03:55 -- setup/common.sh@44 -- # local parts 00:03:21.511 03:03:55 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:21.511 03:03:55 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:21.511 03:03:55 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:21.511 03:03:55 -- setup/common.sh@46 -- # (( part++ )) 00:03:21.511 03:03:55 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:21.511 03:03:55 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:21.511 03:03:55 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:21.511 03:03:55 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:22.077 Creating new GPT entries in memory. 00:03:22.077 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:22.077 other utilities. 00:03:22.077 03:03:56 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:22.077 03:03:56 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:22.077 03:03:56 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:22.077 03:03:56 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:22.077 03:03:56 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:23.013 Creating new GPT entries in memory. 00:03:23.013 The operation has completed successfully. 00:03:23.013 03:03:57 -- setup/common.sh@57 -- # (( part++ )) 00:03:23.013 03:03:57 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:23.013 03:03:57 -- setup/common.sh@62 -- # wait 3878576 00:03:23.013 03:03:57 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:03:23.013 03:03:57 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:23.013 03:03:57 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:03:23.013 03:03:57 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:23.013 03:03:57 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:23.013 03:03:57 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:03:23.013 03:03:57 -- setup/devices.sh@105 -- # verify 0000:5e:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:23.013 03:03:57 -- setup/devices.sh@48 -- # local dev=0000:5e:00.0 00:03:23.013 03:03:57 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:23.013 03:03:57 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:03:23.013 03:03:57 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:23.013 03:03:57 -- setup/devices.sh@53 -- # local found=0 00:03:23.013 03:03:57 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:23.013 03:03:57 -- setup/devices.sh@56 -- # : 00:03:23.013 03:03:57 -- setup/devices.sh@59 -- # local pci status 00:03:23.013 03:03:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:23.013 03:03:57 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5e:00.0 00:03:23.013 03:03:57 -- setup/devices.sh@47 -- # setup output config 00:03:23.013 03:03:57 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:23.013 03:03:57 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh config 00:03:26.300 03:04:00 -- setup/devices.sh@62 -- # [[ 0000:5f:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:26.300 03:04:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:26.300 03:04:00 -- setup/devices.sh@62 -- # [[ 0000:5e:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:26.300 03:04:00 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:26.300 03:04:00 -- setup/devices.sh@63 -- # found=1 00:03:26.300 03:04:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:26.300 03:04:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:26.300 03:04:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:26.300 03:04:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:26.300 03:04:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:26.300 03:04:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:26.300 03:04:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:26.300 03:04:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:26.300 03:04:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:26.300 03:04:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:26.300 03:04:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:26.300 03:04:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:26.300 03:04:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:26.300 03:04:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:26.300 03:04:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:26.300 03:04:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:26.300 03:04:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:26.300 03:04:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:26.300 03:04:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:26.300 03:04:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:26.300 03:04:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:26.300 03:04:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:26.300 03:04:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:26.300 03:04:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:26.300 03:04:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:26.300 03:04:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:26.301 03:04:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:26.301 03:04:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:26.301 03:04:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:26.301 03:04:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:26.301 03:04:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:26.301 03:04:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:26.301 03:04:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:26.301 03:04:00 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:26.301 03:04:00 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:26.301 03:04:00 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:03:26.301 03:04:00 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:26.301 03:04:00 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:26.301 03:04:00 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:26.301 03:04:00 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:03:26.301 03:04:00 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:03:26.301 03:04:00 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:26.301 03:04:00 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:26.301 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:26.301 03:04:00 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:26.301 03:04:00 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:26.559 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:26.559 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:26.559 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:26.559 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:26.559 03:04:00 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:26.559 03:04:00 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:26.559 03:04:00 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:03:26.559 03:04:00 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:26.559 03:04:00 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:26.559 03:04:01 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:03:26.559 03:04:01 -- setup/devices.sh@116 -- # verify 0000:5e:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:26.559 03:04:01 -- setup/devices.sh@48 -- # local dev=0000:5e:00.0 00:03:26.559 03:04:01 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:26.559 03:04:01 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:03:26.559 03:04:01 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:26.559 03:04:01 -- setup/devices.sh@53 -- # local found=0 00:03:26.559 03:04:01 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:26.559 03:04:01 -- setup/devices.sh@56 -- # : 00:03:26.559 03:04:01 -- setup/devices.sh@59 -- # local pci status 00:03:26.559 03:04:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:26.559 03:04:01 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5e:00.0 00:03:26.559 03:04:01 -- setup/devices.sh@47 -- # setup output config 00:03:26.559 03:04:01 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:26.559 03:04:01 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh config 00:03:29.843 03:04:03 -- setup/devices.sh@62 -- # [[ 0000:5f:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.844 03:04:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.844 03:04:04 -- setup/devices.sh@62 -- # [[ 0000:5e:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.844 03:04:04 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:29.844 03:04:04 -- setup/devices.sh@63 -- # found=1 00:03:29.844 03:04:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.844 03:04:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.844 03:04:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.844 03:04:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.844 03:04:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.844 03:04:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.844 03:04:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.844 03:04:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.844 03:04:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.844 03:04:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.844 03:04:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.844 03:04:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.844 03:04:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.844 03:04:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.844 03:04:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.844 03:04:04 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.844 03:04:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.844 03:04:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.844 03:04:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.844 03:04:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.844 03:04:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.844 03:04:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.844 03:04:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.844 03:04:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.844 03:04:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.844 03:04:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.844 03:04:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.844 03:04:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.844 03:04:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.844 03:04:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.844 03:04:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.844 03:04:04 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:29.844 03:04:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.844 03:04:04 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:29.844 03:04:04 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:29.844 03:04:04 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:03:29.844 03:04:04 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:29.844 03:04:04 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:29.844 03:04:04 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:03:29.844 03:04:04 -- setup/devices.sh@125 -- # verify 0000:5e:00.0 data@nvme0n1 '' '' 00:03:29.844 03:04:04 -- setup/devices.sh@48 -- # local dev=0000:5e:00.0 00:03:29.844 03:04:04 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:29.844 03:04:04 -- setup/devices.sh@50 -- # local mount_point= 00:03:29.844 03:04:04 -- setup/devices.sh@51 -- # local test_file= 00:03:29.844 03:04:04 -- setup/devices.sh@53 -- # local found=0 00:03:29.844 03:04:04 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:29.844 03:04:04 -- setup/devices.sh@59 -- # local pci status 00:03:29.844 03:04:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.844 03:04:04 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5e:00.0 00:03:29.844 03:04:04 -- setup/devices.sh@47 -- # setup output config 00:03:29.844 03:04:04 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:29.844 03:04:04 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh config 00:03:33.129 03:04:07 -- setup/devices.sh@62 -- # [[ 0000:5f:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:33.129 03:04:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.129 03:04:07 -- setup/devices.sh@62 -- # [[ 0000:5e:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:33.129 03:04:07 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:33.129 03:04:07 -- setup/devices.sh@63 -- # found=1 00:03:33.129 03:04:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.129 03:04:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:33.129 03:04:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.129 03:04:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:33.129 03:04:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.129 03:04:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:33.129 03:04:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.129 03:04:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:33.129 03:04:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.129 03:04:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:33.129 03:04:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.130 03:04:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:33.130 03:04:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.130 03:04:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:33.130 03:04:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.130 03:04:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:33.130 03:04:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.130 03:04:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:33.130 03:04:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.130 03:04:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:33.130 03:04:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.130 03:04:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:33.130 03:04:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.130 03:04:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:33.130 03:04:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.130 03:04:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:33.130 03:04:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.130 03:04:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:33.130 03:04:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.130 03:04:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:33.130 03:04:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.130 03:04:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:33.130 03:04:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.130 03:04:07 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:33.130 03:04:07 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:33.130 03:04:07 -- setup/devices.sh@68 -- # return 0 00:03:33.130 03:04:07 -- setup/devices.sh@128 -- # cleanup_nvme 00:03:33.130 03:04:07 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:03:33.130 03:04:07 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:33.130 03:04:07 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:33.130 03:04:07 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:33.130 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:33.130 00:03:33.130 real 0m12.230s 00:03:33.130 user 0m3.700s 00:03:33.130 sys 0m6.303s 00:03:33.130 03:04:07 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:33.130 03:04:07 -- common/autotest_common.sh@10 -- # set +x 00:03:33.130 ************************************ 00:03:33.130 END TEST nvme_mount 00:03:33.130 ************************************ 00:03:33.130 03:04:07 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:03:33.130 03:04:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:33.130 03:04:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:33.130 03:04:07 -- common/autotest_common.sh@10 -- # set +x 00:03:33.387 ************************************ 00:03:33.387 START TEST dm_mount 00:03:33.387 ************************************ 00:03:33.387 03:04:07 -- common/autotest_common.sh@1111 -- # dm_mount 00:03:33.387 03:04:07 -- setup/devices.sh@144 -- # pv=nvme0n1 00:03:33.387 03:04:07 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:03:33.387 03:04:07 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:03:33.387 03:04:07 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:03:33.387 03:04:07 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:33.387 03:04:07 -- setup/common.sh@40 -- # local part_no=2 00:03:33.387 03:04:07 -- setup/common.sh@41 -- # local size=1073741824 00:03:33.387 03:04:07 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:33.387 03:04:07 -- setup/common.sh@44 -- # parts=() 00:03:33.387 03:04:07 -- setup/common.sh@44 -- # local parts 00:03:33.387 03:04:07 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:33.387 03:04:07 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:33.387 03:04:07 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:33.387 03:04:07 -- setup/common.sh@46 -- # (( part++ )) 00:03:33.387 03:04:07 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:33.387 03:04:07 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:33.387 03:04:07 -- setup/common.sh@46 -- # (( part++ )) 00:03:33.387 03:04:07 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:33.387 03:04:07 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:33.387 03:04:07 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:33.387 03:04:07 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:03:34.322 Creating new GPT entries in memory. 00:03:34.322 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:34.322 other utilities. 00:03:34.322 03:04:08 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:34.322 03:04:08 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:34.322 03:04:08 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:34.322 03:04:08 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:34.322 03:04:08 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:35.255 Creating new GPT entries in memory. 00:03:35.255 The operation has completed successfully. 00:03:35.255 03:04:09 -- setup/common.sh@57 -- # (( part++ )) 00:03:35.255 03:04:09 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:35.255 03:04:09 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:35.255 03:04:09 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:35.255 03:04:09 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:36.654 The operation has completed successfully. 00:03:36.654 03:04:10 -- setup/common.sh@57 -- # (( part++ )) 00:03:36.654 03:04:10 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:36.654 03:04:10 -- setup/common.sh@62 -- # wait 3883361 00:03:36.654 03:04:10 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:36.654 03:04:10 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount 00:03:36.654 03:04:10 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:36.654 03:04:10 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:36.654 03:04:10 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:36.654 03:04:10 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:36.654 03:04:10 -- setup/devices.sh@161 -- # break 00:03:36.654 03:04:10 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:36.654 03:04:10 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:36.654 03:04:10 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:03:36.654 03:04:10 -- setup/devices.sh@166 -- # dm=dm-0 00:03:36.654 03:04:10 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:03:36.654 03:04:10 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:03:36.654 03:04:10 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount 00:03:36.654 03:04:10 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount size= 00:03:36.654 03:04:10 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount 00:03:36.654 03:04:10 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:36.654 03:04:10 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:36.654 03:04:10 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount 00:03:36.654 03:04:10 -- setup/devices.sh@174 -- # verify 0000:5e:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:36.654 03:04:10 -- setup/devices.sh@48 -- # local dev=0000:5e:00.0 00:03:36.654 03:04:10 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:36.654 03:04:10 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount 00:03:36.654 03:04:10 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:36.654 03:04:10 -- setup/devices.sh@53 -- # local found=0 00:03:36.654 03:04:10 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:36.654 03:04:10 -- setup/devices.sh@56 -- # : 00:03:36.654 03:04:10 -- setup/devices.sh@59 -- # local pci status 00:03:36.654 03:04:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.654 03:04:10 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5e:00.0 00:03:36.654 03:04:10 -- setup/devices.sh@47 -- # setup output config 00:03:36.654 03:04:10 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:36.654 03:04:10 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh config 00:03:39.184 03:04:13 -- setup/devices.sh@62 -- # [[ 0000:5f:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:39.184 03:04:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.442 03:04:13 -- setup/devices.sh@62 -- # [[ 0000:5e:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:39.442 03:04:13 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:39.442 03:04:13 -- setup/devices.sh@63 -- # found=1 00:03:39.442 03:04:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.442 03:04:13 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:39.442 03:04:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.442 03:04:13 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:39.442 03:04:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.442 03:04:13 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:39.442 03:04:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.442 03:04:13 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:39.442 03:04:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.442 03:04:13 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:39.442 03:04:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.442 03:04:13 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:39.442 03:04:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.442 03:04:13 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:39.442 03:04:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.442 03:04:13 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:39.442 03:04:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.442 03:04:13 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:39.442 03:04:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.442 03:04:13 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:39.442 03:04:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.442 03:04:13 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:39.442 03:04:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.442 03:04:13 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:39.442 03:04:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.442 03:04:13 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:39.442 03:04:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.442 03:04:13 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:39.442 03:04:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.442 03:04:13 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:39.442 03:04:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.442 03:04:13 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:39.442 03:04:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.442 03:04:13 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:39.442 03:04:13 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:39.442 03:04:13 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount 00:03:39.442 03:04:13 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:39.442 03:04:13 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:39.442 03:04:13 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount 00:03:39.442 03:04:13 -- setup/devices.sh@184 -- # verify 0000:5e:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:03:39.442 03:04:13 -- setup/devices.sh@48 -- # local dev=0000:5e:00.0 00:03:39.442 03:04:13 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:03:39.442 03:04:13 -- setup/devices.sh@50 -- # local mount_point= 00:03:39.442 03:04:13 -- setup/devices.sh@51 -- # local test_file= 00:03:39.442 03:04:13 -- setup/devices.sh@53 -- # local found=0 00:03:39.442 03:04:13 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:39.442 03:04:13 -- setup/devices.sh@59 -- # local pci status 00:03:39.442 03:04:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.442 03:04:13 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5e:00.0 00:03:39.442 03:04:13 -- setup/devices.sh@47 -- # setup output config 00:03:39.442 03:04:13 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:39.442 03:04:13 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh config 00:03:41.969 03:04:16 -- setup/devices.sh@62 -- # [[ 0000:5f:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:41.970 03:04:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.227 03:04:16 -- setup/devices.sh@62 -- # [[ 0000:5e:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:42.227 03:04:16 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:03:42.227 03:04:16 -- setup/devices.sh@63 -- # found=1 00:03:42.227 03:04:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.227 03:04:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:42.227 03:04:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.227 03:04:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:42.227 03:04:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.227 03:04:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:42.227 03:04:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.227 03:04:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:42.227 03:04:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.227 03:04:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:42.227 03:04:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.227 03:04:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:42.227 03:04:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.227 03:04:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:42.227 03:04:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.227 03:04:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:42.227 03:04:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.227 03:04:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:42.227 03:04:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.227 03:04:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:42.227 03:04:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.227 03:04:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:42.227 03:04:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.227 03:04:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:42.227 03:04:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.227 03:04:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:42.227 03:04:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.227 03:04:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:42.228 03:04:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.228 03:04:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:42.228 03:04:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.228 03:04:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:42.228 03:04:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.486 03:04:16 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:42.486 03:04:16 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:42.486 03:04:16 -- setup/devices.sh@68 -- # return 0 00:03:42.486 03:04:16 -- setup/devices.sh@187 -- # cleanup_dm 00:03:42.486 03:04:16 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount 00:03:42.486 03:04:16 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:42.486 03:04:16 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:03:42.486 03:04:16 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:42.486 03:04:16 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:03:42.486 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:42.486 03:04:16 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:42.486 03:04:16 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:03:42.486 00:03:42.486 real 0m9.240s 00:03:42.486 user 0m2.252s 00:03:42.486 sys 0m3.917s 00:03:42.486 03:04:16 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:42.486 03:04:16 -- common/autotest_common.sh@10 -- # set +x 00:03:42.486 ************************************ 00:03:42.486 END TEST dm_mount 00:03:42.486 ************************************ 00:03:42.486 03:04:16 -- setup/devices.sh@1 -- # cleanup 00:03:42.486 03:04:16 -- setup/devices.sh@11 -- # cleanup_nvme 00:03:42.486 03:04:16 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:03:42.486 03:04:16 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:42.486 03:04:16 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:42.744 03:04:16 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:42.744 03:04:16 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:43.001 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:43.001 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:43.001 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:43.001 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:43.001 03:04:17 -- setup/devices.sh@12 -- # cleanup_dm 00:03:43.001 03:04:17 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount 00:03:43.001 03:04:17 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:43.001 03:04:17 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:43.001 03:04:17 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:43.001 03:04:17 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:03:43.001 03:04:17 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:03:43.001 00:03:43.002 real 0m25.655s 00:03:43.002 user 0m7.464s 00:03:43.002 sys 0m12.712s 00:03:43.002 03:04:17 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:43.002 03:04:17 -- common/autotest_common.sh@10 -- # set +x 00:03:43.002 ************************************ 00:03:43.002 END TEST devices 00:03:43.002 ************************************ 00:03:43.002 00:03:43.002 real 1m27.180s 00:03:43.002 user 0m29.199s 00:03:43.002 sys 0m48.079s 00:03:43.002 03:04:17 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:43.002 03:04:17 -- common/autotest_common.sh@10 -- # set +x 00:03:43.002 ************************************ 00:03:43.002 END TEST setup.sh 00:03:43.002 ************************************ 00:03:43.002 03:04:17 -- spdk/autotest.sh@128 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh status 00:03:46.284 Hugepages 00:03:46.284 node hugesize free / total 00:03:46.284 node0 1048576kB 0 / 0 00:03:46.284 node0 2048kB 2048 / 2048 00:03:46.284 node1 1048576kB 0 / 0 00:03:46.284 node1 2048kB 0 / 0 00:03:46.284 00:03:46.284 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:46.284 I/OAT 0000:00:04.0 8086 2021 0 ioatdma - - 00:03:46.284 I/OAT 0000:00:04.1 8086 2021 0 ioatdma - - 00:03:46.284 I/OAT 0000:00:04.2 8086 2021 0 ioatdma - - 00:03:46.284 I/OAT 0000:00:04.3 8086 2021 0 ioatdma - - 00:03:46.284 I/OAT 0000:00:04.4 8086 2021 0 ioatdma - - 00:03:46.284 I/OAT 0000:00:04.5 8086 2021 0 ioatdma - - 00:03:46.284 I/OAT 0000:00:04.6 8086 2021 0 ioatdma - - 00:03:46.284 I/OAT 0000:00:04.7 8086 2021 0 ioatdma - - 00:03:46.284 NVMe 0000:5e:00.0 8086 0a54 0 nvme nvme0 nvme0n1 00:03:46.284 NVMe 0000:5f:00.0 1b96 2600 0 nvme nvme1 nvme1n1 nvme1n2 00:03:46.284 I/OAT 0000:80:04.0 8086 2021 1 ioatdma - - 00:03:46.284 I/OAT 0000:80:04.1 8086 2021 1 ioatdma - - 00:03:46.284 I/OAT 0000:80:04.2 8086 2021 1 ioatdma - - 00:03:46.284 I/OAT 0000:80:04.3 8086 2021 1 ioatdma - - 00:03:46.284 I/OAT 0000:80:04.4 8086 2021 1 ioatdma - - 00:03:46.284 I/OAT 0000:80:04.5 8086 2021 1 ioatdma - - 00:03:46.284 I/OAT 0000:80:04.6 8086 2021 1 ioatdma - - 00:03:46.284 I/OAT 0000:80:04.7 8086 2021 1 ioatdma - - 00:03:46.284 03:04:20 -- spdk/autotest.sh@130 -- # uname -s 00:03:46.284 03:04:20 -- spdk/autotest.sh@130 -- # [[ Linux == Linux ]] 00:03:46.284 03:04:20 -- spdk/autotest.sh@132 -- # nvme_namespace_revert 00:03:46.284 03:04:20 -- common/autotest_common.sh@1517 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh 00:03:48.834 0000:5f:00.0 (1b96 2600): Skipping denied controller at 0000:5f:00.0 00:03:49.092 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:03:49.092 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:03:49.092 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:03:49.364 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:03:49.364 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:03:49.364 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:03:49.364 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:03:49.364 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:03:49.364 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:03:49.364 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:03:49.364 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:03:49.364 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:03:49.364 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:03:49.364 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:03:49.364 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:03:49.364 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:03:50.302 0000:5e:00.0 (8086 0a54): nvme -> vfio-pci 00:03:50.302 03:04:24 -- common/autotest_common.sh@1518 -- # sleep 1 00:03:51.237 03:04:25 -- common/autotest_common.sh@1519 -- # bdfs=() 00:03:51.237 03:04:25 -- common/autotest_common.sh@1519 -- # local bdfs 00:03:51.237 03:04:25 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:03:51.237 03:04:25 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:03:51.237 03:04:25 -- common/autotest_common.sh@1499 -- # bdfs=() 00:03:51.237 03:04:25 -- common/autotest_common.sh@1499 -- # local bdfs 00:03:51.237 03:04:25 -- common/autotest_common.sh@1500 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:51.237 03:04:25 -- common/autotest_common.sh@1500 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:51.237 03:04:25 -- common/autotest_common.sh@1500 -- # jq -r '.config[].params.traddr' 00:03:51.496 03:04:25 -- common/autotest_common.sh@1501 -- # (( 1 == 0 )) 00:03:51.496 03:04:25 -- common/autotest_common.sh@1505 -- # printf '%s\n' 0000:5e:00.0 00:03:51.496 03:04:25 -- common/autotest_common.sh@1522 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh reset 00:03:54.029 0000:5f:00.0 (1b96 2600): Skipping denied controller at 0000:5f:00.0 00:03:54.287 Waiting for block devices as requested 00:03:54.546 0000:5e:00.0 (8086 0a54): vfio-pci -> nvme 00:03:54.546 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:03:54.546 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:03:54.805 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:03:54.805 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:03:54.805 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:03:54.805 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:03:55.064 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:03:55.064 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:03:55.064 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:03:55.064 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:03:55.322 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:03:55.322 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:03:55.322 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:03:55.581 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:03:55.581 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:03:55.581 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:03:55.581 03:04:30 -- common/autotest_common.sh@1524 -- # for bdf in "${bdfs[@]}" 00:03:55.581 03:04:30 -- common/autotest_common.sh@1525 -- # get_nvme_ctrlr_from_bdf 0000:5e:00.0 00:03:55.581 03:04:30 -- common/autotest_common.sh@1488 -- # readlink -f /sys/class/nvme/nvme0 /sys/class/nvme/nvme1 00:03:55.581 03:04:30 -- common/autotest_common.sh@1488 -- # grep 0000:5e:00.0/nvme/nvme 00:03:55.581 03:04:30 -- common/autotest_common.sh@1488 -- # bdf_sysfs_path=/sys/devices/pci0000:5d/0000:5d:02.0/0000:5e:00.0/nvme/nvme0 00:03:55.581 03:04:30 -- common/autotest_common.sh@1489 -- # [[ -z /sys/devices/pci0000:5d/0000:5d:02.0/0000:5e:00.0/nvme/nvme0 ]] 00:03:55.581 03:04:30 -- common/autotest_common.sh@1493 -- # basename /sys/devices/pci0000:5d/0000:5d:02.0/0000:5e:00.0/nvme/nvme0 00:03:55.840 03:04:30 -- common/autotest_common.sh@1493 -- # printf '%s\n' nvme0 00:03:55.840 03:04:30 -- common/autotest_common.sh@1525 -- # nvme_ctrlr=/dev/nvme0 00:03:55.840 03:04:30 -- common/autotest_common.sh@1526 -- # [[ -z /dev/nvme0 ]] 00:03:55.840 03:04:30 -- common/autotest_common.sh@1531 -- # nvme id-ctrl /dev/nvme0 00:03:55.840 03:04:30 -- common/autotest_common.sh@1531 -- # grep oacs 00:03:55.840 03:04:30 -- common/autotest_common.sh@1531 -- # cut -d: -f2 00:03:55.840 03:04:30 -- common/autotest_common.sh@1531 -- # oacs=' 0xf' 00:03:55.840 03:04:30 -- common/autotest_common.sh@1532 -- # oacs_ns_manage=8 00:03:55.840 03:04:30 -- common/autotest_common.sh@1534 -- # [[ 8 -ne 0 ]] 00:03:55.840 03:04:30 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:03:55.840 03:04:30 -- common/autotest_common.sh@1540 -- # grep unvmcap 00:03:55.840 03:04:30 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:03:55.840 03:04:30 -- common/autotest_common.sh@1540 -- # unvmcap=' 0' 00:03:55.840 03:04:30 -- common/autotest_common.sh@1541 -- # [[ 0 -eq 0 ]] 00:03:55.840 03:04:30 -- common/autotest_common.sh@1543 -- # continue 00:03:55.840 03:04:30 -- spdk/autotest.sh@135 -- # timing_exit pre_cleanup 00:03:55.840 03:04:30 -- common/autotest_common.sh@716 -- # xtrace_disable 00:03:55.840 03:04:30 -- common/autotest_common.sh@10 -- # set +x 00:03:55.840 03:04:30 -- spdk/autotest.sh@138 -- # timing_enter afterboot 00:03:55.840 03:04:30 -- common/autotest_common.sh@710 -- # xtrace_disable 00:03:55.840 03:04:30 -- common/autotest_common.sh@10 -- # set +x 00:03:55.840 03:04:30 -- spdk/autotest.sh@139 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh 00:03:59.125 0000:5f:00.0 (1b96 2600): Skipping denied controller at 0000:5f:00.0 00:03:59.125 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:03:59.125 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:03:59.125 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:03:59.125 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:03:59.125 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:03:59.125 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:03:59.125 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:03:59.125 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:03:59.125 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:03:59.125 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:03:59.125 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:03:59.125 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:03:59.125 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:03:59.125 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:03:59.125 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:03:59.125 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:04:00.089 0000:5e:00.0 (8086 0a54): nvme -> vfio-pci 00:04:00.089 03:04:34 -- spdk/autotest.sh@140 -- # timing_exit afterboot 00:04:00.089 03:04:34 -- common/autotest_common.sh@716 -- # xtrace_disable 00:04:00.089 03:04:34 -- common/autotest_common.sh@10 -- # set +x 00:04:00.089 03:04:34 -- spdk/autotest.sh@144 -- # opal_revert_cleanup 00:04:00.089 03:04:34 -- common/autotest_common.sh@1577 -- # mapfile -t bdfs 00:04:00.089 03:04:34 -- common/autotest_common.sh@1577 -- # get_nvme_bdfs_by_id 0x0a54 00:04:00.089 03:04:34 -- common/autotest_common.sh@1563 -- # bdfs=() 00:04:00.089 03:04:34 -- common/autotest_common.sh@1563 -- # local bdfs 00:04:00.089 03:04:34 -- common/autotest_common.sh@1565 -- # get_nvme_bdfs 00:04:00.089 03:04:34 -- common/autotest_common.sh@1499 -- # bdfs=() 00:04:00.089 03:04:34 -- common/autotest_common.sh@1499 -- # local bdfs 00:04:00.089 03:04:34 -- common/autotest_common.sh@1500 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:00.089 03:04:34 -- common/autotest_common.sh@1500 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:00.089 03:04:34 -- common/autotest_common.sh@1500 -- # jq -r '.config[].params.traddr' 00:04:00.089 03:04:34 -- common/autotest_common.sh@1501 -- # (( 1 == 0 )) 00:04:00.089 03:04:34 -- common/autotest_common.sh@1505 -- # printf '%s\n' 0000:5e:00.0 00:04:00.089 03:04:34 -- common/autotest_common.sh@1565 -- # for bdf in $(get_nvme_bdfs) 00:04:00.089 03:04:34 -- common/autotest_common.sh@1566 -- # cat /sys/bus/pci/devices/0000:5e:00.0/device 00:04:00.089 03:04:34 -- common/autotest_common.sh@1566 -- # device=0x0a54 00:04:00.089 03:04:34 -- common/autotest_common.sh@1567 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:04:00.089 03:04:34 -- common/autotest_common.sh@1568 -- # bdfs+=($bdf) 00:04:00.089 03:04:34 -- common/autotest_common.sh@1572 -- # printf '%s\n' 0000:5e:00.0 00:04:00.089 03:04:34 -- common/autotest_common.sh@1578 -- # [[ -z 0000:5e:00.0 ]] 00:04:00.089 03:04:34 -- common/autotest_common.sh@1583 -- # spdk_tgt_pid=3893457 00:04:00.089 03:04:34 -- common/autotest_common.sh@1584 -- # waitforlisten 3893457 00:04:00.089 03:04:34 -- common/autotest_common.sh@1582 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt 00:04:00.089 03:04:34 -- common/autotest_common.sh@817 -- # '[' -z 3893457 ']' 00:04:00.089 03:04:34 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:00.089 03:04:34 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:00.089 03:04:34 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:00.089 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:00.089 03:04:34 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:00.089 03:04:34 -- common/autotest_common.sh@10 -- # set +x 00:04:00.348 [2024-04-25 03:04:34.601862] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:04:00.348 [2024-04-25 03:04:34.601906] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3893457 ] 00:04:00.348 EAL: No free 2048 kB hugepages reported on node 1 00:04:00.348 [2024-04-25 03:04:34.661304] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:00.348 [2024-04-25 03:04:34.737248] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:00.914 03:04:35 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:00.914 03:04:35 -- common/autotest_common.sh@850 -- # return 0 00:04:00.914 03:04:35 -- common/autotest_common.sh@1586 -- # bdf_id=0 00:04:00.914 03:04:35 -- common/autotest_common.sh@1587 -- # for bdf in "${bdfs[@]}" 00:04:00.914 03:04:35 -- common/autotest_common.sh@1588 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:5e:00.0 00:04:04.200 nvme0n1 00:04:04.200 03:04:38 -- common/autotest_common.sh@1590 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:04:04.200 [2024-04-25 03:04:38.519489] nvme_opal.c:2063:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:04:04.200 [2024-04-25 03:04:38.519517] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:04:04.200 request: 00:04:04.200 { 00:04:04.200 "nvme_ctrlr_name": "nvme0", 00:04:04.200 "password": "test", 00:04:04.200 "method": "bdev_nvme_opal_revert", 00:04:04.200 "req_id": 1 00:04:04.200 } 00:04:04.200 Got JSON-RPC error response 00:04:04.200 response: 00:04:04.200 { 00:04:04.200 "code": -32603, 00:04:04.200 "message": "Internal error" 00:04:04.200 } 00:04:04.200 03:04:38 -- common/autotest_common.sh@1590 -- # true 00:04:04.200 03:04:38 -- common/autotest_common.sh@1591 -- # (( ++bdf_id )) 00:04:04.200 03:04:38 -- common/autotest_common.sh@1594 -- # killprocess 3893457 00:04:04.200 03:04:38 -- common/autotest_common.sh@936 -- # '[' -z 3893457 ']' 00:04:04.200 03:04:38 -- common/autotest_common.sh@940 -- # kill -0 3893457 00:04:04.200 03:04:38 -- common/autotest_common.sh@941 -- # uname 00:04:04.200 03:04:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:04.200 03:04:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3893457 00:04:04.200 03:04:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:04.200 03:04:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:04.200 03:04:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3893457' 00:04:04.200 killing process with pid 3893457 00:04:04.200 03:04:38 -- common/autotest_common.sh@955 -- # kill 3893457 00:04:04.200 03:04:38 -- common/autotest_common.sh@960 -- # wait 3893457 00:04:06.103 03:04:40 -- spdk/autotest.sh@150 -- # '[' 0 -eq 1 ']' 00:04:06.103 03:04:40 -- spdk/autotest.sh@154 -- # '[' 1 -eq 1 ']' 00:04:06.103 03:04:40 -- spdk/autotest.sh@155 -- # [[ 0 -eq 1 ]] 00:04:06.103 03:04:40 -- spdk/autotest.sh@155 -- # [[ 0 -eq 1 ]] 00:04:06.103 03:04:40 -- spdk/autotest.sh@162 -- # timing_enter lib 00:04:06.103 03:04:40 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:06.103 03:04:40 -- common/autotest_common.sh@10 -- # set +x 00:04:06.103 03:04:40 -- spdk/autotest.sh@164 -- # run_test env /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/env/env.sh 00:04:06.103 03:04:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:06.103 03:04:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:06.103 03:04:40 -- common/autotest_common.sh@10 -- # set +x 00:04:06.103 ************************************ 00:04:06.103 START TEST env 00:04:06.103 ************************************ 00:04:06.103 03:04:40 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/env/env.sh 00:04:06.103 * Looking for test storage... 00:04:06.103 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/env 00:04:06.103 03:04:40 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/env/memory/memory_ut 00:04:06.103 03:04:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:06.103 03:04:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:06.103 03:04:40 -- common/autotest_common.sh@10 -- # set +x 00:04:06.362 ************************************ 00:04:06.362 START TEST env_memory 00:04:06.362 ************************************ 00:04:06.362 03:04:40 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/env/memory/memory_ut 00:04:06.362 00:04:06.362 00:04:06.362 CUnit - A unit testing framework for C - Version 2.1-3 00:04:06.362 http://cunit.sourceforge.net/ 00:04:06.362 00:04:06.362 00:04:06.362 Suite: memory 00:04:06.362 Test: alloc and free memory map ...[2024-04-25 03:04:40.648304] /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:04:06.362 passed 00:04:06.362 Test: mem map translation ...[2024-04-25 03:04:40.665942] /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:04:06.362 [2024-04-25 03:04:40.665954] /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:04:06.362 [2024-04-25 03:04:40.665989] /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:04:06.362 [2024-04-25 03:04:40.665995] /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:04:06.362 passed 00:04:06.362 Test: mem map registration ...[2024-04-25 03:04:40.703144] /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:04:06.362 [2024-04-25 03:04:40.703159] /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:04:06.362 passed 00:04:06.362 Test: mem map adjacent registrations ...passed 00:04:06.362 00:04:06.362 Run Summary: Type Total Ran Passed Failed Inactive 00:04:06.362 suites 1 1 n/a 0 0 00:04:06.362 tests 4 4 4 0 0 00:04:06.362 asserts 152 152 152 0 n/a 00:04:06.362 00:04:06.362 Elapsed time = 0.135 seconds 00:04:06.362 00:04:06.362 real 0m0.146s 00:04:06.362 user 0m0.137s 00:04:06.362 sys 0m0.009s 00:04:06.362 03:04:40 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:06.362 03:04:40 -- common/autotest_common.sh@10 -- # set +x 00:04:06.362 ************************************ 00:04:06.362 END TEST env_memory 00:04:06.362 ************************************ 00:04:06.362 03:04:40 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:06.362 03:04:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:06.362 03:04:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:06.362 03:04:40 -- common/autotest_common.sh@10 -- # set +x 00:04:06.621 ************************************ 00:04:06.621 START TEST env_vtophys 00:04:06.621 ************************************ 00:04:06.621 03:04:40 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:06.621 EAL: lib.eal log level changed from notice to debug 00:04:06.621 EAL: Detected lcore 0 as core 0 on socket 0 00:04:06.621 EAL: Detected lcore 1 as core 1 on socket 0 00:04:06.621 EAL: Detected lcore 2 as core 2 on socket 0 00:04:06.621 EAL: Detected lcore 3 as core 3 on socket 0 00:04:06.621 EAL: Detected lcore 4 as core 4 on socket 0 00:04:06.621 EAL: Detected lcore 5 as core 5 on socket 0 00:04:06.621 EAL: Detected lcore 6 as core 6 on socket 0 00:04:06.621 EAL: Detected lcore 7 as core 8 on socket 0 00:04:06.621 EAL: Detected lcore 8 as core 9 on socket 0 00:04:06.621 EAL: Detected lcore 9 as core 10 on socket 0 00:04:06.621 EAL: Detected lcore 10 as core 11 on socket 0 00:04:06.621 EAL: Detected lcore 11 as core 12 on socket 0 00:04:06.621 EAL: Detected lcore 12 as core 13 on socket 0 00:04:06.621 EAL: Detected lcore 13 as core 16 on socket 0 00:04:06.621 EAL: Detected lcore 14 as core 17 on socket 0 00:04:06.621 EAL: Detected lcore 15 as core 18 on socket 0 00:04:06.621 EAL: Detected lcore 16 as core 19 on socket 0 00:04:06.621 EAL: Detected lcore 17 as core 20 on socket 0 00:04:06.621 EAL: Detected lcore 18 as core 21 on socket 0 00:04:06.621 EAL: Detected lcore 19 as core 25 on socket 0 00:04:06.621 EAL: Detected lcore 20 as core 26 on socket 0 00:04:06.621 EAL: Detected lcore 21 as core 27 on socket 0 00:04:06.621 EAL: Detected lcore 22 as core 28 on socket 0 00:04:06.621 EAL: Detected lcore 23 as core 29 on socket 0 00:04:06.621 EAL: Detected lcore 24 as core 0 on socket 1 00:04:06.621 EAL: Detected lcore 25 as core 1 on socket 1 00:04:06.621 EAL: Detected lcore 26 as core 2 on socket 1 00:04:06.621 EAL: Detected lcore 27 as core 3 on socket 1 00:04:06.621 EAL: Detected lcore 28 as core 4 on socket 1 00:04:06.621 EAL: Detected lcore 29 as core 5 on socket 1 00:04:06.621 EAL: Detected lcore 30 as core 6 on socket 1 00:04:06.621 EAL: Detected lcore 31 as core 8 on socket 1 00:04:06.621 EAL: Detected lcore 32 as core 9 on socket 1 00:04:06.621 EAL: Detected lcore 33 as core 10 on socket 1 00:04:06.621 EAL: Detected lcore 34 as core 11 on socket 1 00:04:06.621 EAL: Detected lcore 35 as core 12 on socket 1 00:04:06.621 EAL: Detected lcore 36 as core 13 on socket 1 00:04:06.621 EAL: Detected lcore 37 as core 16 on socket 1 00:04:06.621 EAL: Detected lcore 38 as core 17 on socket 1 00:04:06.621 EAL: Detected lcore 39 as core 18 on socket 1 00:04:06.621 EAL: Detected lcore 40 as core 19 on socket 1 00:04:06.621 EAL: Detected lcore 41 as core 20 on socket 1 00:04:06.621 EAL: Detected lcore 42 as core 21 on socket 1 00:04:06.621 EAL: Detected lcore 43 as core 25 on socket 1 00:04:06.621 EAL: Detected lcore 44 as core 26 on socket 1 00:04:06.621 EAL: Detected lcore 45 as core 27 on socket 1 00:04:06.621 EAL: Detected lcore 46 as core 28 on socket 1 00:04:06.621 EAL: Detected lcore 47 as core 29 on socket 1 00:04:06.621 EAL: Detected lcore 48 as core 0 on socket 0 00:04:06.621 EAL: Detected lcore 49 as core 1 on socket 0 00:04:06.621 EAL: Detected lcore 50 as core 2 on socket 0 00:04:06.622 EAL: Detected lcore 51 as core 3 on socket 0 00:04:06.622 EAL: Detected lcore 52 as core 4 on socket 0 00:04:06.622 EAL: Detected lcore 53 as core 5 on socket 0 00:04:06.622 EAL: Detected lcore 54 as core 6 on socket 0 00:04:06.622 EAL: Detected lcore 55 as core 8 on socket 0 00:04:06.622 EAL: Detected lcore 56 as core 9 on socket 0 00:04:06.622 EAL: Detected lcore 57 as core 10 on socket 0 00:04:06.622 EAL: Detected lcore 58 as core 11 on socket 0 00:04:06.622 EAL: Detected lcore 59 as core 12 on socket 0 00:04:06.622 EAL: Detected lcore 60 as core 13 on socket 0 00:04:06.622 EAL: Detected lcore 61 as core 16 on socket 0 00:04:06.622 EAL: Detected lcore 62 as core 17 on socket 0 00:04:06.622 EAL: Detected lcore 63 as core 18 on socket 0 00:04:06.622 EAL: Detected lcore 64 as core 19 on socket 0 00:04:06.622 EAL: Detected lcore 65 as core 20 on socket 0 00:04:06.622 EAL: Detected lcore 66 as core 21 on socket 0 00:04:06.622 EAL: Detected lcore 67 as core 25 on socket 0 00:04:06.622 EAL: Detected lcore 68 as core 26 on socket 0 00:04:06.622 EAL: Detected lcore 69 as core 27 on socket 0 00:04:06.622 EAL: Detected lcore 70 as core 28 on socket 0 00:04:06.622 EAL: Detected lcore 71 as core 29 on socket 0 00:04:06.622 EAL: Detected lcore 72 as core 0 on socket 1 00:04:06.622 EAL: Detected lcore 73 as core 1 on socket 1 00:04:06.622 EAL: Detected lcore 74 as core 2 on socket 1 00:04:06.622 EAL: Detected lcore 75 as core 3 on socket 1 00:04:06.622 EAL: Detected lcore 76 as core 4 on socket 1 00:04:06.622 EAL: Detected lcore 77 as core 5 on socket 1 00:04:06.622 EAL: Detected lcore 78 as core 6 on socket 1 00:04:06.622 EAL: Detected lcore 79 as core 8 on socket 1 00:04:06.622 EAL: Detected lcore 80 as core 9 on socket 1 00:04:06.622 EAL: Detected lcore 81 as core 10 on socket 1 00:04:06.622 EAL: Detected lcore 82 as core 11 on socket 1 00:04:06.622 EAL: Detected lcore 83 as core 12 on socket 1 00:04:06.622 EAL: Detected lcore 84 as core 13 on socket 1 00:04:06.622 EAL: Detected lcore 85 as core 16 on socket 1 00:04:06.622 EAL: Detected lcore 86 as core 17 on socket 1 00:04:06.622 EAL: Detected lcore 87 as core 18 on socket 1 00:04:06.622 EAL: Detected lcore 88 as core 19 on socket 1 00:04:06.622 EAL: Detected lcore 89 as core 20 on socket 1 00:04:06.622 EAL: Detected lcore 90 as core 21 on socket 1 00:04:06.622 EAL: Detected lcore 91 as core 25 on socket 1 00:04:06.622 EAL: Detected lcore 92 as core 26 on socket 1 00:04:06.622 EAL: Detected lcore 93 as core 27 on socket 1 00:04:06.622 EAL: Detected lcore 94 as core 28 on socket 1 00:04:06.622 EAL: Detected lcore 95 as core 29 on socket 1 00:04:06.622 EAL: Maximum logical cores by configuration: 128 00:04:06.622 EAL: Detected CPU lcores: 96 00:04:06.622 EAL: Detected NUMA nodes: 2 00:04:06.622 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:04:06.622 EAL: Detected shared linkage of DPDK 00:04:06.622 EAL: No shared files mode enabled, IPC will be disabled 00:04:06.622 EAL: Bus pci wants IOVA as 'DC' 00:04:06.622 EAL: Buses did not request a specific IOVA mode. 00:04:06.622 EAL: IOMMU is available, selecting IOVA as VA mode. 00:04:06.622 EAL: Selected IOVA mode 'VA' 00:04:06.622 EAL: No free 2048 kB hugepages reported on node 1 00:04:06.622 EAL: Probing VFIO support... 00:04:06.622 EAL: IOMMU type 1 (Type 1) is supported 00:04:06.622 EAL: IOMMU type 7 (sPAPR) is not supported 00:04:06.622 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:04:06.622 EAL: VFIO support initialized 00:04:06.622 EAL: Ask a virtual area of 0x2e000 bytes 00:04:06.622 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:04:06.622 EAL: Setting up physically contiguous memory... 00:04:06.622 EAL: Setting maximum number of open files to 524288 00:04:06.622 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:04:06.622 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:04:06.622 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:04:06.622 EAL: Ask a virtual area of 0x61000 bytes 00:04:06.622 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:04:06.622 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:06.622 EAL: Ask a virtual area of 0x400000000 bytes 00:04:06.622 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:04:06.622 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:04:06.622 EAL: Ask a virtual area of 0x61000 bytes 00:04:06.622 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:04:06.622 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:06.622 EAL: Ask a virtual area of 0x400000000 bytes 00:04:06.622 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:04:06.622 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:04:06.622 EAL: Ask a virtual area of 0x61000 bytes 00:04:06.622 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:04:06.622 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:06.622 EAL: Ask a virtual area of 0x400000000 bytes 00:04:06.622 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:04:06.622 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:04:06.622 EAL: Ask a virtual area of 0x61000 bytes 00:04:06.622 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:04:06.622 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:06.622 EAL: Ask a virtual area of 0x400000000 bytes 00:04:06.622 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:04:06.622 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:04:06.622 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:04:06.622 EAL: Ask a virtual area of 0x61000 bytes 00:04:06.622 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:04:06.622 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:06.622 EAL: Ask a virtual area of 0x400000000 bytes 00:04:06.622 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:04:06.622 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:04:06.622 EAL: Ask a virtual area of 0x61000 bytes 00:04:06.622 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:04:06.622 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:06.622 EAL: Ask a virtual area of 0x400000000 bytes 00:04:06.622 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:04:06.622 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:04:06.622 EAL: Ask a virtual area of 0x61000 bytes 00:04:06.622 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:04:06.622 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:06.622 EAL: Ask a virtual area of 0x400000000 bytes 00:04:06.622 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:04:06.622 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:04:06.622 EAL: Ask a virtual area of 0x61000 bytes 00:04:06.622 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:04:06.622 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:06.622 EAL: Ask a virtual area of 0x400000000 bytes 00:04:06.622 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:04:06.622 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:04:06.622 EAL: Hugepages will be freed exactly as allocated. 00:04:06.622 EAL: No shared files mode enabled, IPC is disabled 00:04:06.622 EAL: No shared files mode enabled, IPC is disabled 00:04:06.622 EAL: TSC frequency is ~2100000 KHz 00:04:06.622 EAL: Main lcore 0 is ready (tid=7f4d29504a00;cpuset=[0]) 00:04:06.622 EAL: Trying to obtain current memory policy. 00:04:06.622 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:06.622 EAL: Restoring previous memory policy: 0 00:04:06.622 EAL: request: mp_malloc_sync 00:04:06.622 EAL: No shared files mode enabled, IPC is disabled 00:04:06.622 EAL: Heap on socket 0 was expanded by 2MB 00:04:06.622 EAL: No shared files mode enabled, IPC is disabled 00:04:06.622 EAL: No PCI address specified using 'addr=' in: bus=pci 00:04:06.622 EAL: Mem event callback 'spdk:(nil)' registered 00:04:06.622 00:04:06.622 00:04:06.622 CUnit - A unit testing framework for C - Version 2.1-3 00:04:06.622 http://cunit.sourceforge.net/ 00:04:06.622 00:04:06.622 00:04:06.622 Suite: components_suite 00:04:06.622 Test: vtophys_malloc_test ...passed 00:04:06.622 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:04:06.622 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:06.622 EAL: Restoring previous memory policy: 4 00:04:06.622 EAL: Calling mem event callback 'spdk:(nil)' 00:04:06.622 EAL: request: mp_malloc_sync 00:04:06.622 EAL: No shared files mode enabled, IPC is disabled 00:04:06.622 EAL: Heap on socket 0 was expanded by 4MB 00:04:06.622 EAL: Calling mem event callback 'spdk:(nil)' 00:04:06.622 EAL: request: mp_malloc_sync 00:04:06.622 EAL: No shared files mode enabled, IPC is disabled 00:04:06.622 EAL: Heap on socket 0 was shrunk by 4MB 00:04:06.622 EAL: Trying to obtain current memory policy. 00:04:06.622 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:06.622 EAL: Restoring previous memory policy: 4 00:04:06.622 EAL: Calling mem event callback 'spdk:(nil)' 00:04:06.622 EAL: request: mp_malloc_sync 00:04:06.622 EAL: No shared files mode enabled, IPC is disabled 00:04:06.622 EAL: Heap on socket 0 was expanded by 6MB 00:04:06.622 EAL: Calling mem event callback 'spdk:(nil)' 00:04:06.622 EAL: request: mp_malloc_sync 00:04:06.622 EAL: No shared files mode enabled, IPC is disabled 00:04:06.622 EAL: Heap on socket 0 was shrunk by 6MB 00:04:06.622 EAL: Trying to obtain current memory policy. 00:04:06.622 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:06.622 EAL: Restoring previous memory policy: 4 00:04:06.622 EAL: Calling mem event callback 'spdk:(nil)' 00:04:06.622 EAL: request: mp_malloc_sync 00:04:06.622 EAL: No shared files mode enabled, IPC is disabled 00:04:06.622 EAL: Heap on socket 0 was expanded by 10MB 00:04:06.622 EAL: Calling mem event callback 'spdk:(nil)' 00:04:06.622 EAL: request: mp_malloc_sync 00:04:06.622 EAL: No shared files mode enabled, IPC is disabled 00:04:06.622 EAL: Heap on socket 0 was shrunk by 10MB 00:04:06.622 EAL: Trying to obtain current memory policy. 00:04:06.622 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:06.622 EAL: Restoring previous memory policy: 4 00:04:06.622 EAL: Calling mem event callback 'spdk:(nil)' 00:04:06.622 EAL: request: mp_malloc_sync 00:04:06.622 EAL: No shared files mode enabled, IPC is disabled 00:04:06.622 EAL: Heap on socket 0 was expanded by 18MB 00:04:06.622 EAL: Calling mem event callback 'spdk:(nil)' 00:04:06.622 EAL: request: mp_malloc_sync 00:04:06.622 EAL: No shared files mode enabled, IPC is disabled 00:04:06.622 EAL: Heap on socket 0 was shrunk by 18MB 00:04:06.622 EAL: Trying to obtain current memory policy. 00:04:06.622 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:06.623 EAL: Restoring previous memory policy: 4 00:04:06.623 EAL: Calling mem event callback 'spdk:(nil)' 00:04:06.623 EAL: request: mp_malloc_sync 00:04:06.623 EAL: No shared files mode enabled, IPC is disabled 00:04:06.623 EAL: Heap on socket 0 was expanded by 34MB 00:04:06.623 EAL: Calling mem event callback 'spdk:(nil)' 00:04:06.623 EAL: request: mp_malloc_sync 00:04:06.623 EAL: No shared files mode enabled, IPC is disabled 00:04:06.623 EAL: Heap on socket 0 was shrunk by 34MB 00:04:06.623 EAL: Trying to obtain current memory policy. 00:04:06.623 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:06.623 EAL: Restoring previous memory policy: 4 00:04:06.623 EAL: Calling mem event callback 'spdk:(nil)' 00:04:06.623 EAL: request: mp_malloc_sync 00:04:06.623 EAL: No shared files mode enabled, IPC is disabled 00:04:06.623 EAL: Heap on socket 0 was expanded by 66MB 00:04:06.623 EAL: Calling mem event callback 'spdk:(nil)' 00:04:06.623 EAL: request: mp_malloc_sync 00:04:06.623 EAL: No shared files mode enabled, IPC is disabled 00:04:06.623 EAL: Heap on socket 0 was shrunk by 66MB 00:04:06.623 EAL: Trying to obtain current memory policy. 00:04:06.623 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:06.623 EAL: Restoring previous memory policy: 4 00:04:06.623 EAL: Calling mem event callback 'spdk:(nil)' 00:04:06.623 EAL: request: mp_malloc_sync 00:04:06.623 EAL: No shared files mode enabled, IPC is disabled 00:04:06.623 EAL: Heap on socket 0 was expanded by 130MB 00:04:06.623 EAL: Calling mem event callback 'spdk:(nil)' 00:04:06.623 EAL: request: mp_malloc_sync 00:04:06.623 EAL: No shared files mode enabled, IPC is disabled 00:04:06.623 EAL: Heap on socket 0 was shrunk by 130MB 00:04:06.623 EAL: Trying to obtain current memory policy. 00:04:06.623 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:06.880 EAL: Restoring previous memory policy: 4 00:04:06.880 EAL: Calling mem event callback 'spdk:(nil)' 00:04:06.880 EAL: request: mp_malloc_sync 00:04:06.880 EAL: No shared files mode enabled, IPC is disabled 00:04:06.880 EAL: Heap on socket 0 was expanded by 258MB 00:04:06.880 EAL: Calling mem event callback 'spdk:(nil)' 00:04:06.880 EAL: request: mp_malloc_sync 00:04:06.880 EAL: No shared files mode enabled, IPC is disabled 00:04:06.880 EAL: Heap on socket 0 was shrunk by 258MB 00:04:06.880 EAL: Trying to obtain current memory policy. 00:04:06.880 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:06.880 EAL: Restoring previous memory policy: 4 00:04:06.880 EAL: Calling mem event callback 'spdk:(nil)' 00:04:06.880 EAL: request: mp_malloc_sync 00:04:06.880 EAL: No shared files mode enabled, IPC is disabled 00:04:06.880 EAL: Heap on socket 0 was expanded by 514MB 00:04:06.880 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.139 EAL: request: mp_malloc_sync 00:04:07.139 EAL: No shared files mode enabled, IPC is disabled 00:04:07.139 EAL: Heap on socket 0 was shrunk by 514MB 00:04:07.139 EAL: Trying to obtain current memory policy. 00:04:07.139 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:07.397 EAL: Restoring previous memory policy: 4 00:04:07.397 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.397 EAL: request: mp_malloc_sync 00:04:07.397 EAL: No shared files mode enabled, IPC is disabled 00:04:07.397 EAL: Heap on socket 0 was expanded by 1026MB 00:04:07.397 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.656 EAL: request: mp_malloc_sync 00:04:07.656 EAL: No shared files mode enabled, IPC is disabled 00:04:07.656 EAL: Heap on socket 0 was shrunk by 1026MB 00:04:07.656 passed 00:04:07.656 00:04:07.656 Run Summary: Type Total Ran Passed Failed Inactive 00:04:07.656 suites 1 1 n/a 0 0 00:04:07.656 tests 2 2 2 0 0 00:04:07.656 asserts 497 497 497 0 n/a 00:04:07.656 00:04:07.656 Elapsed time = 0.956 seconds 00:04:07.656 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.656 EAL: request: mp_malloc_sync 00:04:07.656 EAL: No shared files mode enabled, IPC is disabled 00:04:07.656 EAL: Heap on socket 0 was shrunk by 2MB 00:04:07.656 EAL: No shared files mode enabled, IPC is disabled 00:04:07.656 EAL: No shared files mode enabled, IPC is disabled 00:04:07.656 EAL: No shared files mode enabled, IPC is disabled 00:04:07.656 00:04:07.656 real 0m1.067s 00:04:07.656 user 0m0.628s 00:04:07.656 sys 0m0.412s 00:04:07.656 03:04:41 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:07.656 03:04:41 -- common/autotest_common.sh@10 -- # set +x 00:04:07.656 ************************************ 00:04:07.656 END TEST env_vtophys 00:04:07.656 ************************************ 00:04:07.656 03:04:41 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/env/pci/pci_ut 00:04:07.656 03:04:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:07.656 03:04:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:07.656 03:04:41 -- common/autotest_common.sh@10 -- # set +x 00:04:07.656 ************************************ 00:04:07.656 START TEST env_pci 00:04:07.656 ************************************ 00:04:07.656 03:04:42 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/env/pci/pci_ut 00:04:07.656 00:04:07.656 00:04:07.656 CUnit - A unit testing framework for C - Version 2.1-3 00:04:07.656 http://cunit.sourceforge.net/ 00:04:07.656 00:04:07.656 00:04:07.656 Suite: pci 00:04:07.656 Test: pci_hook ...[2024-04-25 03:04:42.138430] /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 3894795 has claimed it 00:04:07.913 EAL: Cannot find device (10000:00:01.0) 00:04:07.913 EAL: Failed to attach device on primary process 00:04:07.913 passed 00:04:07.913 00:04:07.913 Run Summary: Type Total Ran Passed Failed Inactive 00:04:07.913 suites 1 1 n/a 0 0 00:04:07.913 tests 1 1 1 0 0 00:04:07.914 asserts 25 25 25 0 n/a 00:04:07.914 00:04:07.914 Elapsed time = 0.028 seconds 00:04:07.914 00:04:07.914 real 0m0.046s 00:04:07.914 user 0m0.016s 00:04:07.914 sys 0m0.030s 00:04:07.914 03:04:42 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:07.914 03:04:42 -- common/autotest_common.sh@10 -- # set +x 00:04:07.914 ************************************ 00:04:07.914 END TEST env_pci 00:04:07.914 ************************************ 00:04:07.914 03:04:42 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:04:07.914 03:04:42 -- env/env.sh@15 -- # uname 00:04:07.914 03:04:42 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:04:07.914 03:04:42 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:04:07.914 03:04:42 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:07.914 03:04:42 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:04:07.914 03:04:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:07.914 03:04:42 -- common/autotest_common.sh@10 -- # set +x 00:04:07.914 ************************************ 00:04:07.914 START TEST env_dpdk_post_init 00:04:07.914 ************************************ 00:04:07.914 03:04:42 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:07.914 EAL: Detected CPU lcores: 96 00:04:07.914 EAL: Detected NUMA nodes: 2 00:04:07.914 EAL: Detected shared linkage of DPDK 00:04:07.914 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:07.914 EAL: Selected IOVA mode 'VA' 00:04:07.914 EAL: No free 2048 kB hugepages reported on node 1 00:04:07.914 EAL: VFIO support initialized 00:04:07.914 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:08.170 EAL: Using IOMMU type 1 (Type 1) 00:04:08.170 EAL: Ignore mapping IO port bar(1) 00:04:08.170 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.0 (socket 0) 00:04:08.170 EAL: Ignore mapping IO port bar(1) 00:04:08.170 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.1 (socket 0) 00:04:08.170 EAL: Ignore mapping IO port bar(1) 00:04:08.170 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.2 (socket 0) 00:04:08.170 EAL: Ignore mapping IO port bar(1) 00:04:08.170 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.3 (socket 0) 00:04:08.170 EAL: Ignore mapping IO port bar(1) 00:04:08.170 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.4 (socket 0) 00:04:08.170 EAL: Ignore mapping IO port bar(1) 00:04:08.170 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.5 (socket 0) 00:04:08.170 EAL: Ignore mapping IO port bar(1) 00:04:08.170 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.6 (socket 0) 00:04:08.170 EAL: Ignore mapping IO port bar(1) 00:04:08.170 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.7 (socket 0) 00:04:09.104 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:5e:00.0 (socket 0) 00:04:09.104 EAL: Ignore mapping IO port bar(1) 00:04:09.104 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.0 (socket 1) 00:04:09.104 EAL: Ignore mapping IO port bar(1) 00:04:09.104 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.1 (socket 1) 00:04:09.104 EAL: Ignore mapping IO port bar(1) 00:04:09.104 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.2 (socket 1) 00:04:09.104 EAL: Ignore mapping IO port bar(1) 00:04:09.104 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.3 (socket 1) 00:04:09.104 EAL: Ignore mapping IO port bar(1) 00:04:09.104 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.4 (socket 1) 00:04:09.104 EAL: Ignore mapping IO port bar(1) 00:04:09.104 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.5 (socket 1) 00:04:09.104 EAL: Ignore mapping IO port bar(1) 00:04:09.104 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.6 (socket 1) 00:04:09.104 EAL: Ignore mapping IO port bar(1) 00:04:09.104 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.7 (socket 1) 00:04:12.386 EAL: Releasing PCI mapped resource for 0000:5e:00.0 00:04:12.386 EAL: Calling pci_unmap_resource for 0000:5e:00.0 at 0x202001020000 00:04:12.386 Starting DPDK initialization... 00:04:12.386 Starting SPDK post initialization... 00:04:12.386 SPDK NVMe probe 00:04:12.386 Attaching to 0000:5e:00.0 00:04:12.386 Attached to 0000:5e:00.0 00:04:12.386 Cleaning up... 00:04:12.386 00:04:12.386 real 0m4.309s 00:04:12.386 user 0m3.261s 00:04:12.386 sys 0m0.124s 00:04:12.386 03:04:46 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:12.386 03:04:46 -- common/autotest_common.sh@10 -- # set +x 00:04:12.386 ************************************ 00:04:12.386 END TEST env_dpdk_post_init 00:04:12.386 ************************************ 00:04:12.386 03:04:46 -- env/env.sh@26 -- # uname 00:04:12.386 03:04:46 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:04:12.386 03:04:46 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:12.386 03:04:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:12.386 03:04:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:12.386 03:04:46 -- common/autotest_common.sh@10 -- # set +x 00:04:12.386 ************************************ 00:04:12.386 START TEST env_mem_callbacks 00:04:12.386 ************************************ 00:04:12.386 03:04:46 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:12.386 EAL: Detected CPU lcores: 96 00:04:12.386 EAL: Detected NUMA nodes: 2 00:04:12.386 EAL: Detected shared linkage of DPDK 00:04:12.386 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:12.386 EAL: Selected IOVA mode 'VA' 00:04:12.386 EAL: No free 2048 kB hugepages reported on node 1 00:04:12.386 EAL: VFIO support initialized 00:04:12.386 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:12.386 00:04:12.386 00:04:12.386 CUnit - A unit testing framework for C - Version 2.1-3 00:04:12.386 http://cunit.sourceforge.net/ 00:04:12.386 00:04:12.386 00:04:12.386 Suite: memory 00:04:12.386 Test: test ... 00:04:12.386 register 0x200000200000 2097152 00:04:12.386 malloc 3145728 00:04:12.386 register 0x200000400000 4194304 00:04:12.386 buf 0x200000500000 len 3145728 PASSED 00:04:12.386 malloc 64 00:04:12.386 buf 0x2000004fff40 len 64 PASSED 00:04:12.386 malloc 4194304 00:04:12.386 register 0x200000800000 6291456 00:04:12.386 buf 0x200000a00000 len 4194304 PASSED 00:04:12.386 free 0x200000500000 3145728 00:04:12.386 free 0x2000004fff40 64 00:04:12.386 unregister 0x200000400000 4194304 PASSED 00:04:12.386 free 0x200000a00000 4194304 00:04:12.386 unregister 0x200000800000 6291456 PASSED 00:04:12.386 malloc 8388608 00:04:12.386 register 0x200000400000 10485760 00:04:12.386 buf 0x200000600000 len 8388608 PASSED 00:04:12.386 free 0x200000600000 8388608 00:04:12.386 unregister 0x200000400000 10485760 PASSED 00:04:12.386 passed 00:04:12.386 00:04:12.386 Run Summary: Type Total Ran Passed Failed Inactive 00:04:12.386 suites 1 1 n/a 0 0 00:04:12.386 tests 1 1 1 0 0 00:04:12.386 asserts 15 15 15 0 n/a 00:04:12.386 00:04:12.386 Elapsed time = 0.005 seconds 00:04:12.386 00:04:12.386 real 0m0.055s 00:04:12.386 user 0m0.013s 00:04:12.386 sys 0m0.042s 00:04:12.386 03:04:46 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:12.386 03:04:46 -- common/autotest_common.sh@10 -- # set +x 00:04:12.386 ************************************ 00:04:12.386 END TEST env_mem_callbacks 00:04:12.386 ************************************ 00:04:12.386 00:04:12.386 real 0m6.488s 00:04:12.386 user 0m4.410s 00:04:12.386 sys 0m1.099s 00:04:12.386 03:04:46 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:12.386 03:04:46 -- common/autotest_common.sh@10 -- # set +x 00:04:12.386 ************************************ 00:04:12.386 END TEST env 00:04:12.386 ************************************ 00:04:12.644 03:04:46 -- spdk/autotest.sh@165 -- # run_test rpc /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc/rpc.sh 00:04:12.644 03:04:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:12.644 03:04:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:12.644 03:04:46 -- common/autotest_common.sh@10 -- # set +x 00:04:12.644 ************************************ 00:04:12.644 START TEST rpc 00:04:12.644 ************************************ 00:04:12.644 03:04:47 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc/rpc.sh 00:04:12.644 * Looking for test storage... 00:04:12.644 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc 00:04:12.644 03:04:47 -- rpc/rpc.sh@65 -- # spdk_pid=3895836 00:04:12.644 03:04:47 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:12.644 03:04:47 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:04:12.644 03:04:47 -- rpc/rpc.sh@67 -- # waitforlisten 3895836 00:04:12.644 03:04:47 -- common/autotest_common.sh@817 -- # '[' -z 3895836 ']' 00:04:12.644 03:04:47 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:12.644 03:04:47 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:12.644 03:04:47 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:12.645 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:12.645 03:04:47 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:12.645 03:04:47 -- common/autotest_common.sh@10 -- # set +x 00:04:12.904 [2024-04-25 03:04:47.161169] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:04:12.904 [2024-04-25 03:04:47.161214] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3895836 ] 00:04:12.904 EAL: No free 2048 kB hugepages reported on node 1 00:04:12.904 [2024-04-25 03:04:47.220817] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:12.904 [2024-04-25 03:04:47.291128] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:04:12.904 [2024-04-25 03:04:47.291169] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 3895836' to capture a snapshot of events at runtime. 00:04:12.904 [2024-04-25 03:04:47.291175] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:04:12.904 [2024-04-25 03:04:47.291180] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:04:12.904 [2024-04-25 03:04:47.291185] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid3895836 for offline analysis/debug. 00:04:12.904 [2024-04-25 03:04:47.291217] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:13.471 03:04:47 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:13.471 03:04:47 -- common/autotest_common.sh@850 -- # return 0 00:04:13.471 03:04:47 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc 00:04:13.471 03:04:47 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc 00:04:13.471 03:04:47 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:04:13.471 03:04:47 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:04:13.471 03:04:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:13.471 03:04:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:13.471 03:04:47 -- common/autotest_common.sh@10 -- # set +x 00:04:13.730 ************************************ 00:04:13.730 START TEST rpc_integrity 00:04:13.730 ************************************ 00:04:13.730 03:04:48 -- common/autotest_common.sh@1111 -- # rpc_integrity 00:04:13.730 03:04:48 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:13.730 03:04:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:13.730 03:04:48 -- common/autotest_common.sh@10 -- # set +x 00:04:13.730 03:04:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:13.730 03:04:48 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:13.730 03:04:48 -- rpc/rpc.sh@13 -- # jq length 00:04:13.730 03:04:48 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:13.730 03:04:48 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:13.730 03:04:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:13.730 03:04:48 -- common/autotest_common.sh@10 -- # set +x 00:04:13.730 03:04:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:13.730 03:04:48 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:04:13.730 03:04:48 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:13.730 03:04:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:13.730 03:04:48 -- common/autotest_common.sh@10 -- # set +x 00:04:13.730 03:04:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:13.730 03:04:48 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:13.730 { 00:04:13.730 "name": "Malloc0", 00:04:13.730 "aliases": [ 00:04:13.730 "547e275a-2ae5-430e-b559-d09fbe92d92b" 00:04:13.730 ], 00:04:13.730 "product_name": "Malloc disk", 00:04:13.730 "block_size": 512, 00:04:13.730 "num_blocks": 16384, 00:04:13.730 "uuid": "547e275a-2ae5-430e-b559-d09fbe92d92b", 00:04:13.730 "assigned_rate_limits": { 00:04:13.730 "rw_ios_per_sec": 0, 00:04:13.730 "rw_mbytes_per_sec": 0, 00:04:13.730 "r_mbytes_per_sec": 0, 00:04:13.730 "w_mbytes_per_sec": 0 00:04:13.730 }, 00:04:13.730 "claimed": false, 00:04:13.730 "zoned": false, 00:04:13.730 "supported_io_types": { 00:04:13.730 "read": true, 00:04:13.730 "write": true, 00:04:13.730 "unmap": true, 00:04:13.730 "write_zeroes": true, 00:04:13.730 "flush": true, 00:04:13.730 "reset": true, 00:04:13.730 "compare": false, 00:04:13.730 "compare_and_write": false, 00:04:13.730 "abort": true, 00:04:13.730 "nvme_admin": false, 00:04:13.730 "nvme_io": false 00:04:13.730 }, 00:04:13.730 "memory_domains": [ 00:04:13.730 { 00:04:13.730 "dma_device_id": "system", 00:04:13.730 "dma_device_type": 1 00:04:13.730 }, 00:04:13.730 { 00:04:13.730 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:13.730 "dma_device_type": 2 00:04:13.730 } 00:04:13.730 ], 00:04:13.730 "driver_specific": {} 00:04:13.730 } 00:04:13.730 ]' 00:04:13.730 03:04:48 -- rpc/rpc.sh@17 -- # jq length 00:04:13.730 03:04:48 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:13.730 03:04:48 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:04:13.730 03:04:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:13.730 03:04:48 -- common/autotest_common.sh@10 -- # set +x 00:04:13.730 [2024-04-25 03:04:48.193246] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:04:13.730 [2024-04-25 03:04:48.193275] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:13.730 [2024-04-25 03:04:48.193288] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1f4f890 00:04:13.730 [2024-04-25 03:04:48.193294] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:13.730 [2024-04-25 03:04:48.194362] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:13.730 [2024-04-25 03:04:48.194382] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:13.730 Passthru0 00:04:13.730 03:04:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:13.730 03:04:48 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:13.730 03:04:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:13.730 03:04:48 -- common/autotest_common.sh@10 -- # set +x 00:04:13.730 03:04:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:13.730 03:04:48 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:13.730 { 00:04:13.730 "name": "Malloc0", 00:04:13.730 "aliases": [ 00:04:13.730 "547e275a-2ae5-430e-b559-d09fbe92d92b" 00:04:13.730 ], 00:04:13.730 "product_name": "Malloc disk", 00:04:13.730 "block_size": 512, 00:04:13.730 "num_blocks": 16384, 00:04:13.730 "uuid": "547e275a-2ae5-430e-b559-d09fbe92d92b", 00:04:13.730 "assigned_rate_limits": { 00:04:13.730 "rw_ios_per_sec": 0, 00:04:13.730 "rw_mbytes_per_sec": 0, 00:04:13.730 "r_mbytes_per_sec": 0, 00:04:13.730 "w_mbytes_per_sec": 0 00:04:13.730 }, 00:04:13.730 "claimed": true, 00:04:13.730 "claim_type": "exclusive_write", 00:04:13.730 "zoned": false, 00:04:13.730 "supported_io_types": { 00:04:13.730 "read": true, 00:04:13.730 "write": true, 00:04:13.730 "unmap": true, 00:04:13.730 "write_zeroes": true, 00:04:13.730 "flush": true, 00:04:13.730 "reset": true, 00:04:13.730 "compare": false, 00:04:13.730 "compare_and_write": false, 00:04:13.730 "abort": true, 00:04:13.730 "nvme_admin": false, 00:04:13.730 "nvme_io": false 00:04:13.730 }, 00:04:13.730 "memory_domains": [ 00:04:13.730 { 00:04:13.730 "dma_device_id": "system", 00:04:13.730 "dma_device_type": 1 00:04:13.730 }, 00:04:13.730 { 00:04:13.730 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:13.730 "dma_device_type": 2 00:04:13.730 } 00:04:13.730 ], 00:04:13.730 "driver_specific": {} 00:04:13.730 }, 00:04:13.730 { 00:04:13.730 "name": "Passthru0", 00:04:13.731 "aliases": [ 00:04:13.731 "e6339aab-1ca4-5219-b740-dba7d6498c48" 00:04:13.731 ], 00:04:13.731 "product_name": "passthru", 00:04:13.731 "block_size": 512, 00:04:13.731 "num_blocks": 16384, 00:04:13.731 "uuid": "e6339aab-1ca4-5219-b740-dba7d6498c48", 00:04:13.731 "assigned_rate_limits": { 00:04:13.731 "rw_ios_per_sec": 0, 00:04:13.731 "rw_mbytes_per_sec": 0, 00:04:13.731 "r_mbytes_per_sec": 0, 00:04:13.731 "w_mbytes_per_sec": 0 00:04:13.731 }, 00:04:13.731 "claimed": false, 00:04:13.731 "zoned": false, 00:04:13.731 "supported_io_types": { 00:04:13.731 "read": true, 00:04:13.731 "write": true, 00:04:13.731 "unmap": true, 00:04:13.731 "write_zeroes": true, 00:04:13.731 "flush": true, 00:04:13.731 "reset": true, 00:04:13.731 "compare": false, 00:04:13.731 "compare_and_write": false, 00:04:13.731 "abort": true, 00:04:13.731 "nvme_admin": false, 00:04:13.731 "nvme_io": false 00:04:13.731 }, 00:04:13.731 "memory_domains": [ 00:04:13.731 { 00:04:13.731 "dma_device_id": "system", 00:04:13.731 "dma_device_type": 1 00:04:13.731 }, 00:04:13.731 { 00:04:13.731 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:13.731 "dma_device_type": 2 00:04:13.731 } 00:04:13.731 ], 00:04:13.731 "driver_specific": { 00:04:13.731 "passthru": { 00:04:13.731 "name": "Passthru0", 00:04:13.731 "base_bdev_name": "Malloc0" 00:04:13.731 } 00:04:13.731 } 00:04:13.731 } 00:04:13.731 ]' 00:04:13.731 03:04:48 -- rpc/rpc.sh@21 -- # jq length 00:04:13.990 03:04:48 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:13.990 03:04:48 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:13.990 03:04:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:13.990 03:04:48 -- common/autotest_common.sh@10 -- # set +x 00:04:13.990 03:04:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:13.990 03:04:48 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:04:13.990 03:04:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:13.990 03:04:48 -- common/autotest_common.sh@10 -- # set +x 00:04:13.990 03:04:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:13.990 03:04:48 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:13.990 03:04:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:13.990 03:04:48 -- common/autotest_common.sh@10 -- # set +x 00:04:13.990 03:04:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:13.990 03:04:48 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:13.990 03:04:48 -- rpc/rpc.sh@26 -- # jq length 00:04:13.990 03:04:48 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:13.990 00:04:13.990 real 0m0.222s 00:04:13.990 user 0m0.132s 00:04:13.990 sys 0m0.025s 00:04:13.990 03:04:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:13.990 03:04:48 -- common/autotest_common.sh@10 -- # set +x 00:04:13.990 ************************************ 00:04:13.990 END TEST rpc_integrity 00:04:13.990 ************************************ 00:04:13.990 03:04:48 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:04:13.990 03:04:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:13.990 03:04:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:13.990 03:04:48 -- common/autotest_common.sh@10 -- # set +x 00:04:13.990 ************************************ 00:04:13.990 START TEST rpc_plugins 00:04:13.990 ************************************ 00:04:13.990 03:04:48 -- common/autotest_common.sh@1111 -- # rpc_plugins 00:04:13.990 03:04:48 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:04:13.990 03:04:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:13.990 03:04:48 -- common/autotest_common.sh@10 -- # set +x 00:04:13.990 03:04:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:13.990 03:04:48 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:04:13.990 03:04:48 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:04:13.990 03:04:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:13.990 03:04:48 -- common/autotest_common.sh@10 -- # set +x 00:04:13.990 03:04:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:13.990 03:04:48 -- rpc/rpc.sh@31 -- # bdevs='[ 00:04:13.990 { 00:04:13.990 "name": "Malloc1", 00:04:13.990 "aliases": [ 00:04:13.990 "c8c1cfe5-5b37-4296-b7f2-3cda297d1cd1" 00:04:13.990 ], 00:04:13.990 "product_name": "Malloc disk", 00:04:13.990 "block_size": 4096, 00:04:13.990 "num_blocks": 256, 00:04:13.990 "uuid": "c8c1cfe5-5b37-4296-b7f2-3cda297d1cd1", 00:04:13.990 "assigned_rate_limits": { 00:04:13.990 "rw_ios_per_sec": 0, 00:04:13.990 "rw_mbytes_per_sec": 0, 00:04:13.990 "r_mbytes_per_sec": 0, 00:04:13.990 "w_mbytes_per_sec": 0 00:04:13.990 }, 00:04:13.990 "claimed": false, 00:04:13.990 "zoned": false, 00:04:13.990 "supported_io_types": { 00:04:13.990 "read": true, 00:04:13.990 "write": true, 00:04:13.990 "unmap": true, 00:04:13.990 "write_zeroes": true, 00:04:13.990 "flush": true, 00:04:13.990 "reset": true, 00:04:13.990 "compare": false, 00:04:13.990 "compare_and_write": false, 00:04:13.990 "abort": true, 00:04:13.990 "nvme_admin": false, 00:04:13.990 "nvme_io": false 00:04:13.990 }, 00:04:13.990 "memory_domains": [ 00:04:13.990 { 00:04:13.990 "dma_device_id": "system", 00:04:13.990 "dma_device_type": 1 00:04:13.990 }, 00:04:13.990 { 00:04:13.990 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:13.990 "dma_device_type": 2 00:04:13.990 } 00:04:13.990 ], 00:04:13.990 "driver_specific": {} 00:04:13.990 } 00:04:13.990 ]' 00:04:13.990 03:04:48 -- rpc/rpc.sh@32 -- # jq length 00:04:13.990 03:04:48 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:04:13.990 03:04:48 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:04:13.990 03:04:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:13.990 03:04:48 -- common/autotest_common.sh@10 -- # set +x 00:04:14.249 03:04:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:14.249 03:04:48 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:04:14.249 03:04:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:14.249 03:04:48 -- common/autotest_common.sh@10 -- # set +x 00:04:14.249 03:04:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:14.249 03:04:48 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:04:14.249 03:04:48 -- rpc/rpc.sh@36 -- # jq length 00:04:14.249 03:04:48 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:04:14.249 00:04:14.249 real 0m0.104s 00:04:14.249 user 0m0.054s 00:04:14.249 sys 0m0.013s 00:04:14.249 03:04:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:14.249 03:04:48 -- common/autotest_common.sh@10 -- # set +x 00:04:14.249 ************************************ 00:04:14.249 END TEST rpc_plugins 00:04:14.249 ************************************ 00:04:14.249 03:04:48 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:04:14.249 03:04:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:14.249 03:04:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:14.249 03:04:48 -- common/autotest_common.sh@10 -- # set +x 00:04:14.249 ************************************ 00:04:14.249 START TEST rpc_trace_cmd_test 00:04:14.249 ************************************ 00:04:14.249 03:04:48 -- common/autotest_common.sh@1111 -- # rpc_trace_cmd_test 00:04:14.249 03:04:48 -- rpc/rpc.sh@40 -- # local info 00:04:14.249 03:04:48 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:04:14.249 03:04:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:14.249 03:04:48 -- common/autotest_common.sh@10 -- # set +x 00:04:14.249 03:04:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:14.249 03:04:48 -- rpc/rpc.sh@42 -- # info='{ 00:04:14.249 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid3895836", 00:04:14.249 "tpoint_group_mask": "0x8", 00:04:14.249 "iscsi_conn": { 00:04:14.249 "mask": "0x2", 00:04:14.249 "tpoint_mask": "0x0" 00:04:14.249 }, 00:04:14.249 "scsi": { 00:04:14.249 "mask": "0x4", 00:04:14.249 "tpoint_mask": "0x0" 00:04:14.249 }, 00:04:14.249 "bdev": { 00:04:14.249 "mask": "0x8", 00:04:14.249 "tpoint_mask": "0xffffffffffffffff" 00:04:14.249 }, 00:04:14.249 "nvmf_rdma": { 00:04:14.249 "mask": "0x10", 00:04:14.249 "tpoint_mask": "0x0" 00:04:14.249 }, 00:04:14.249 "nvmf_tcp": { 00:04:14.249 "mask": "0x20", 00:04:14.249 "tpoint_mask": "0x0" 00:04:14.249 }, 00:04:14.249 "ftl": { 00:04:14.249 "mask": "0x40", 00:04:14.249 "tpoint_mask": "0x0" 00:04:14.249 }, 00:04:14.249 "blobfs": { 00:04:14.249 "mask": "0x80", 00:04:14.249 "tpoint_mask": "0x0" 00:04:14.249 }, 00:04:14.249 "dsa": { 00:04:14.249 "mask": "0x200", 00:04:14.249 "tpoint_mask": "0x0" 00:04:14.249 }, 00:04:14.249 "thread": { 00:04:14.249 "mask": "0x400", 00:04:14.249 "tpoint_mask": "0x0" 00:04:14.249 }, 00:04:14.249 "nvme_pcie": { 00:04:14.249 "mask": "0x800", 00:04:14.249 "tpoint_mask": "0x0" 00:04:14.249 }, 00:04:14.249 "iaa": { 00:04:14.249 "mask": "0x1000", 00:04:14.249 "tpoint_mask": "0x0" 00:04:14.249 }, 00:04:14.249 "nvme_tcp": { 00:04:14.249 "mask": "0x2000", 00:04:14.249 "tpoint_mask": "0x0" 00:04:14.249 }, 00:04:14.249 "bdev_nvme": { 00:04:14.249 "mask": "0x4000", 00:04:14.249 "tpoint_mask": "0x0" 00:04:14.249 }, 00:04:14.249 "sock": { 00:04:14.249 "mask": "0x8000", 00:04:14.249 "tpoint_mask": "0x0" 00:04:14.249 } 00:04:14.249 }' 00:04:14.249 03:04:48 -- rpc/rpc.sh@43 -- # jq length 00:04:14.249 03:04:48 -- rpc/rpc.sh@43 -- # '[' 16 -gt 2 ']' 00:04:14.507 03:04:48 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:04:14.507 03:04:48 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:04:14.507 03:04:48 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:04:14.507 03:04:48 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:04:14.507 03:04:48 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:04:14.507 03:04:48 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:04:14.507 03:04:48 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:04:14.507 03:04:48 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:04:14.507 00:04:14.507 real 0m0.186s 00:04:14.507 user 0m0.157s 00:04:14.507 sys 0m0.023s 00:04:14.507 03:04:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:14.507 03:04:48 -- common/autotest_common.sh@10 -- # set +x 00:04:14.507 ************************************ 00:04:14.507 END TEST rpc_trace_cmd_test 00:04:14.507 ************************************ 00:04:14.507 03:04:48 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:04:14.507 03:04:48 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:04:14.507 03:04:48 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:04:14.507 03:04:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:14.507 03:04:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:14.507 03:04:48 -- common/autotest_common.sh@10 -- # set +x 00:04:14.766 ************************************ 00:04:14.766 START TEST rpc_daemon_integrity 00:04:14.766 ************************************ 00:04:14.766 03:04:49 -- common/autotest_common.sh@1111 -- # rpc_integrity 00:04:14.766 03:04:49 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:14.766 03:04:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:14.766 03:04:49 -- common/autotest_common.sh@10 -- # set +x 00:04:14.766 03:04:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:14.766 03:04:49 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:14.766 03:04:49 -- rpc/rpc.sh@13 -- # jq length 00:04:14.766 03:04:49 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:14.766 03:04:49 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:14.766 03:04:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:14.766 03:04:49 -- common/autotest_common.sh@10 -- # set +x 00:04:14.766 03:04:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:14.766 03:04:49 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:04:14.766 03:04:49 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:14.766 03:04:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:14.766 03:04:49 -- common/autotest_common.sh@10 -- # set +x 00:04:14.766 03:04:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:14.766 03:04:49 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:14.766 { 00:04:14.766 "name": "Malloc2", 00:04:14.766 "aliases": [ 00:04:14.766 "a30cca9c-f01c-4317-bd71-0fe8071d83d5" 00:04:14.766 ], 00:04:14.766 "product_name": "Malloc disk", 00:04:14.766 "block_size": 512, 00:04:14.766 "num_blocks": 16384, 00:04:14.766 "uuid": "a30cca9c-f01c-4317-bd71-0fe8071d83d5", 00:04:14.766 "assigned_rate_limits": { 00:04:14.766 "rw_ios_per_sec": 0, 00:04:14.766 "rw_mbytes_per_sec": 0, 00:04:14.766 "r_mbytes_per_sec": 0, 00:04:14.766 "w_mbytes_per_sec": 0 00:04:14.766 }, 00:04:14.766 "claimed": false, 00:04:14.766 "zoned": false, 00:04:14.766 "supported_io_types": { 00:04:14.766 "read": true, 00:04:14.766 "write": true, 00:04:14.766 "unmap": true, 00:04:14.766 "write_zeroes": true, 00:04:14.766 "flush": true, 00:04:14.766 "reset": true, 00:04:14.766 "compare": false, 00:04:14.766 "compare_and_write": false, 00:04:14.766 "abort": true, 00:04:14.766 "nvme_admin": false, 00:04:14.766 "nvme_io": false 00:04:14.766 }, 00:04:14.766 "memory_domains": [ 00:04:14.766 { 00:04:14.766 "dma_device_id": "system", 00:04:14.766 "dma_device_type": 1 00:04:14.766 }, 00:04:14.766 { 00:04:14.766 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:14.766 "dma_device_type": 2 00:04:14.766 } 00:04:14.766 ], 00:04:14.766 "driver_specific": {} 00:04:14.766 } 00:04:14.766 ]' 00:04:14.766 03:04:49 -- rpc/rpc.sh@17 -- # jq length 00:04:14.766 03:04:49 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:14.766 03:04:49 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:04:14.766 03:04:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:14.766 03:04:49 -- common/autotest_common.sh@10 -- # set +x 00:04:14.766 [2024-04-25 03:04:49.167896] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:04:14.766 [2024-04-25 03:04:49.167924] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:14.766 [2024-04-25 03:04:49.167936] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1f51120 00:04:14.766 [2024-04-25 03:04:49.167942] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:14.766 [2024-04-25 03:04:49.168898] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:14.766 [2024-04-25 03:04:49.168918] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:14.766 Passthru0 00:04:14.766 03:04:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:14.766 03:04:49 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:14.766 03:04:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:14.766 03:04:49 -- common/autotest_common.sh@10 -- # set +x 00:04:14.766 03:04:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:14.766 03:04:49 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:14.766 { 00:04:14.766 "name": "Malloc2", 00:04:14.766 "aliases": [ 00:04:14.766 "a30cca9c-f01c-4317-bd71-0fe8071d83d5" 00:04:14.766 ], 00:04:14.766 "product_name": "Malloc disk", 00:04:14.766 "block_size": 512, 00:04:14.766 "num_blocks": 16384, 00:04:14.766 "uuid": "a30cca9c-f01c-4317-bd71-0fe8071d83d5", 00:04:14.766 "assigned_rate_limits": { 00:04:14.766 "rw_ios_per_sec": 0, 00:04:14.766 "rw_mbytes_per_sec": 0, 00:04:14.766 "r_mbytes_per_sec": 0, 00:04:14.767 "w_mbytes_per_sec": 0 00:04:14.767 }, 00:04:14.767 "claimed": true, 00:04:14.767 "claim_type": "exclusive_write", 00:04:14.767 "zoned": false, 00:04:14.767 "supported_io_types": { 00:04:14.767 "read": true, 00:04:14.767 "write": true, 00:04:14.767 "unmap": true, 00:04:14.767 "write_zeroes": true, 00:04:14.767 "flush": true, 00:04:14.767 "reset": true, 00:04:14.767 "compare": false, 00:04:14.767 "compare_and_write": false, 00:04:14.767 "abort": true, 00:04:14.767 "nvme_admin": false, 00:04:14.767 "nvme_io": false 00:04:14.767 }, 00:04:14.767 "memory_domains": [ 00:04:14.767 { 00:04:14.767 "dma_device_id": "system", 00:04:14.767 "dma_device_type": 1 00:04:14.767 }, 00:04:14.767 { 00:04:14.767 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:14.767 "dma_device_type": 2 00:04:14.767 } 00:04:14.767 ], 00:04:14.767 "driver_specific": {} 00:04:14.767 }, 00:04:14.767 { 00:04:14.767 "name": "Passthru0", 00:04:14.767 "aliases": [ 00:04:14.767 "9b307a88-9541-5943-be6c-289e6170be85" 00:04:14.767 ], 00:04:14.767 "product_name": "passthru", 00:04:14.767 "block_size": 512, 00:04:14.767 "num_blocks": 16384, 00:04:14.767 "uuid": "9b307a88-9541-5943-be6c-289e6170be85", 00:04:14.767 "assigned_rate_limits": { 00:04:14.767 "rw_ios_per_sec": 0, 00:04:14.767 "rw_mbytes_per_sec": 0, 00:04:14.767 "r_mbytes_per_sec": 0, 00:04:14.767 "w_mbytes_per_sec": 0 00:04:14.767 }, 00:04:14.767 "claimed": false, 00:04:14.767 "zoned": false, 00:04:14.767 "supported_io_types": { 00:04:14.767 "read": true, 00:04:14.767 "write": true, 00:04:14.767 "unmap": true, 00:04:14.767 "write_zeroes": true, 00:04:14.767 "flush": true, 00:04:14.767 "reset": true, 00:04:14.767 "compare": false, 00:04:14.767 "compare_and_write": false, 00:04:14.767 "abort": true, 00:04:14.767 "nvme_admin": false, 00:04:14.767 "nvme_io": false 00:04:14.767 }, 00:04:14.767 "memory_domains": [ 00:04:14.767 { 00:04:14.767 "dma_device_id": "system", 00:04:14.767 "dma_device_type": 1 00:04:14.767 }, 00:04:14.767 { 00:04:14.767 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:14.767 "dma_device_type": 2 00:04:14.767 } 00:04:14.767 ], 00:04:14.767 "driver_specific": { 00:04:14.767 "passthru": { 00:04:14.767 "name": "Passthru0", 00:04:14.767 "base_bdev_name": "Malloc2" 00:04:14.767 } 00:04:14.767 } 00:04:14.767 } 00:04:14.767 ]' 00:04:14.767 03:04:49 -- rpc/rpc.sh@21 -- # jq length 00:04:14.767 03:04:49 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:14.767 03:04:49 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:14.767 03:04:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:14.767 03:04:49 -- common/autotest_common.sh@10 -- # set +x 00:04:14.767 03:04:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:14.767 03:04:49 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:04:14.767 03:04:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:14.767 03:04:49 -- common/autotest_common.sh@10 -- # set +x 00:04:14.767 03:04:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:14.767 03:04:49 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:14.767 03:04:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:14.767 03:04:49 -- common/autotest_common.sh@10 -- # set +x 00:04:14.767 03:04:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:14.767 03:04:49 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:14.767 03:04:49 -- rpc/rpc.sh@26 -- # jq length 00:04:15.026 03:04:49 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:15.026 00:04:15.026 real 0m0.232s 00:04:15.026 user 0m0.140s 00:04:15.026 sys 0m0.028s 00:04:15.026 03:04:49 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:15.026 03:04:49 -- common/autotest_common.sh@10 -- # set +x 00:04:15.026 ************************************ 00:04:15.026 END TEST rpc_daemon_integrity 00:04:15.026 ************************************ 00:04:15.026 03:04:49 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:04:15.026 03:04:49 -- rpc/rpc.sh@84 -- # killprocess 3895836 00:04:15.026 03:04:49 -- common/autotest_common.sh@936 -- # '[' -z 3895836 ']' 00:04:15.026 03:04:49 -- common/autotest_common.sh@940 -- # kill -0 3895836 00:04:15.026 03:04:49 -- common/autotest_common.sh@941 -- # uname 00:04:15.026 03:04:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:15.026 03:04:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3895836 00:04:15.026 03:04:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:15.026 03:04:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:15.026 03:04:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3895836' 00:04:15.026 killing process with pid 3895836 00:04:15.026 03:04:49 -- common/autotest_common.sh@955 -- # kill 3895836 00:04:15.026 03:04:49 -- common/autotest_common.sh@960 -- # wait 3895836 00:04:15.285 00:04:15.285 real 0m2.664s 00:04:15.285 user 0m3.367s 00:04:15.285 sys 0m0.807s 00:04:15.285 03:04:49 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:15.285 03:04:49 -- common/autotest_common.sh@10 -- # set +x 00:04:15.285 ************************************ 00:04:15.285 END TEST rpc 00:04:15.285 ************************************ 00:04:15.285 03:04:49 -- spdk/autotest.sh@166 -- # run_test skip_rpc /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc/skip_rpc.sh 00:04:15.285 03:04:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:15.285 03:04:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:15.285 03:04:49 -- common/autotest_common.sh@10 -- # set +x 00:04:15.543 ************************************ 00:04:15.543 START TEST skip_rpc 00:04:15.543 ************************************ 00:04:15.543 03:04:49 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc/skip_rpc.sh 00:04:15.543 * Looking for test storage... 00:04:15.543 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc 00:04:15.543 03:04:49 -- rpc/skip_rpc.sh@11 -- # CONFIG_PATH=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc/config.json 00:04:15.543 03:04:49 -- rpc/skip_rpc.sh@12 -- # LOG_PATH=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc/log.txt 00:04:15.543 03:04:49 -- rpc/skip_rpc.sh@73 -- # run_test skip_rpc test_skip_rpc 00:04:15.543 03:04:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:15.543 03:04:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:15.543 03:04:49 -- common/autotest_common.sh@10 -- # set +x 00:04:15.801 ************************************ 00:04:15.801 START TEST skip_rpc 00:04:15.801 ************************************ 00:04:15.801 03:04:50 -- common/autotest_common.sh@1111 -- # test_skip_rpc 00:04:15.801 03:04:50 -- rpc/skip_rpc.sh@16 -- # local spdk_pid=3896508 00:04:15.801 03:04:50 -- rpc/skip_rpc.sh@15 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 00:04:15.802 03:04:50 -- rpc/skip_rpc.sh@18 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:15.802 03:04:50 -- rpc/skip_rpc.sh@19 -- # sleep 5 00:04:15.802 [2024-04-25 03:04:50.106631] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:04:15.802 [2024-04-25 03:04:50.106665] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3896508 ] 00:04:15.802 EAL: No free 2048 kB hugepages reported on node 1 00:04:15.802 [2024-04-25 03:04:50.165199] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:15.802 [2024-04-25 03:04:50.235256] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:21.062 03:04:55 -- rpc/skip_rpc.sh@21 -- # NOT rpc_cmd spdk_get_version 00:04:21.062 03:04:55 -- common/autotest_common.sh@638 -- # local es=0 00:04:21.062 03:04:55 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd spdk_get_version 00:04:21.062 03:04:55 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:04:21.062 03:04:55 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:04:21.062 03:04:55 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:04:21.062 03:04:55 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:04:21.062 03:04:55 -- common/autotest_common.sh@641 -- # rpc_cmd spdk_get_version 00:04:21.062 03:04:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:21.062 03:04:55 -- common/autotest_common.sh@10 -- # set +x 00:04:21.062 03:04:55 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:04:21.062 03:04:55 -- common/autotest_common.sh@641 -- # es=1 00:04:21.062 03:04:55 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:04:21.062 03:04:55 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:04:21.062 03:04:55 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:04:21.062 03:04:55 -- rpc/skip_rpc.sh@22 -- # trap - SIGINT SIGTERM EXIT 00:04:21.062 03:04:55 -- rpc/skip_rpc.sh@23 -- # killprocess 3896508 00:04:21.062 03:04:55 -- common/autotest_common.sh@936 -- # '[' -z 3896508 ']' 00:04:21.062 03:04:55 -- common/autotest_common.sh@940 -- # kill -0 3896508 00:04:21.062 03:04:55 -- common/autotest_common.sh@941 -- # uname 00:04:21.062 03:04:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:21.062 03:04:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3896508 00:04:21.062 03:04:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:21.062 03:04:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:21.062 03:04:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3896508' 00:04:21.062 killing process with pid 3896508 00:04:21.062 03:04:55 -- common/autotest_common.sh@955 -- # kill 3896508 00:04:21.062 03:04:55 -- common/autotest_common.sh@960 -- # wait 3896508 00:04:21.062 00:04:21.062 real 0m5.382s 00:04:21.062 user 0m5.156s 00:04:21.062 sys 0m0.253s 00:04:21.062 03:04:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:21.062 03:04:55 -- common/autotest_common.sh@10 -- # set +x 00:04:21.062 ************************************ 00:04:21.062 END TEST skip_rpc 00:04:21.062 ************************************ 00:04:21.062 03:04:55 -- rpc/skip_rpc.sh@74 -- # run_test skip_rpc_with_json test_skip_rpc_with_json 00:04:21.062 03:04:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:21.062 03:04:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:21.062 03:04:55 -- common/autotest_common.sh@10 -- # set +x 00:04:21.320 ************************************ 00:04:21.320 START TEST skip_rpc_with_json 00:04:21.320 ************************************ 00:04:21.320 03:04:55 -- common/autotest_common.sh@1111 -- # test_skip_rpc_with_json 00:04:21.320 03:04:55 -- rpc/skip_rpc.sh@44 -- # gen_json_config 00:04:21.320 03:04:55 -- rpc/skip_rpc.sh@28 -- # local spdk_pid=3897451 00:04:21.320 03:04:55 -- rpc/skip_rpc.sh@30 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:21.320 03:04:55 -- rpc/skip_rpc.sh@31 -- # waitforlisten 3897451 00:04:21.320 03:04:55 -- rpc/skip_rpc.sh@27 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:21.320 03:04:55 -- common/autotest_common.sh@817 -- # '[' -z 3897451 ']' 00:04:21.320 03:04:55 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:21.320 03:04:55 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:21.320 03:04:55 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:21.320 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:21.320 03:04:55 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:21.320 03:04:55 -- common/autotest_common.sh@10 -- # set +x 00:04:21.320 [2024-04-25 03:04:55.659852] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:04:21.320 [2024-04-25 03:04:55.659896] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3897451 ] 00:04:21.320 EAL: No free 2048 kB hugepages reported on node 1 00:04:21.320 [2024-04-25 03:04:55.718407] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:21.320 [2024-04-25 03:04:55.794131] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:22.255 03:04:56 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:22.255 03:04:56 -- common/autotest_common.sh@850 -- # return 0 00:04:22.255 03:04:56 -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_get_transports --trtype tcp 00:04:22.255 03:04:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:22.255 03:04:56 -- common/autotest_common.sh@10 -- # set +x 00:04:22.255 [2024-04-25 03:04:56.462428] nvmf_rpc.c:2513:rpc_nvmf_get_transports: *ERROR*: transport 'tcp' does not exist 00:04:22.255 request: 00:04:22.255 { 00:04:22.255 "trtype": "tcp", 00:04:22.255 "method": "nvmf_get_transports", 00:04:22.255 "req_id": 1 00:04:22.255 } 00:04:22.255 Got JSON-RPC error response 00:04:22.255 response: 00:04:22.255 { 00:04:22.255 "code": -19, 00:04:22.255 "message": "No such device" 00:04:22.255 } 00:04:22.255 03:04:56 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:04:22.255 03:04:56 -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_create_transport -t tcp 00:04:22.255 03:04:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:22.255 03:04:56 -- common/autotest_common.sh@10 -- # set +x 00:04:22.255 [2024-04-25 03:04:56.470509] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:22.255 03:04:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:22.255 03:04:56 -- rpc/skip_rpc.sh@36 -- # rpc_cmd save_config 00:04:22.255 03:04:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:22.255 03:04:56 -- common/autotest_common.sh@10 -- # set +x 00:04:22.255 03:04:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:22.255 03:04:56 -- rpc/skip_rpc.sh@37 -- # cat /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc/config.json 00:04:22.255 { 00:04:22.255 "subsystems": [ 00:04:22.255 { 00:04:22.255 "subsystem": "keyring", 00:04:22.255 "config": [] 00:04:22.255 }, 00:04:22.255 { 00:04:22.255 "subsystem": "iobuf", 00:04:22.255 "config": [ 00:04:22.255 { 00:04:22.255 "method": "iobuf_set_options", 00:04:22.255 "params": { 00:04:22.255 "small_pool_count": 8192, 00:04:22.255 "large_pool_count": 1024, 00:04:22.255 "small_bufsize": 8192, 00:04:22.255 "large_bufsize": 135168 00:04:22.255 } 00:04:22.255 } 00:04:22.255 ] 00:04:22.255 }, 00:04:22.255 { 00:04:22.255 "subsystem": "sock", 00:04:22.255 "config": [ 00:04:22.255 { 00:04:22.255 "method": "sock_impl_set_options", 00:04:22.255 "params": { 00:04:22.255 "impl_name": "posix", 00:04:22.255 "recv_buf_size": 2097152, 00:04:22.255 "send_buf_size": 2097152, 00:04:22.255 "enable_recv_pipe": true, 00:04:22.255 "enable_quickack": false, 00:04:22.255 "enable_placement_id": 0, 00:04:22.255 "enable_zerocopy_send_server": true, 00:04:22.255 "enable_zerocopy_send_client": false, 00:04:22.255 "zerocopy_threshold": 0, 00:04:22.255 "tls_version": 0, 00:04:22.255 "enable_ktls": false 00:04:22.255 } 00:04:22.255 }, 00:04:22.255 { 00:04:22.255 "method": "sock_impl_set_options", 00:04:22.255 "params": { 00:04:22.255 "impl_name": "ssl", 00:04:22.255 "recv_buf_size": 4096, 00:04:22.255 "send_buf_size": 4096, 00:04:22.255 "enable_recv_pipe": true, 00:04:22.255 "enable_quickack": false, 00:04:22.255 "enable_placement_id": 0, 00:04:22.255 "enable_zerocopy_send_server": true, 00:04:22.255 "enable_zerocopy_send_client": false, 00:04:22.255 "zerocopy_threshold": 0, 00:04:22.255 "tls_version": 0, 00:04:22.255 "enable_ktls": false 00:04:22.255 } 00:04:22.255 } 00:04:22.255 ] 00:04:22.255 }, 00:04:22.255 { 00:04:22.255 "subsystem": "vmd", 00:04:22.255 "config": [] 00:04:22.255 }, 00:04:22.255 { 00:04:22.255 "subsystem": "accel", 00:04:22.255 "config": [ 00:04:22.255 { 00:04:22.255 "method": "accel_set_options", 00:04:22.255 "params": { 00:04:22.255 "small_cache_size": 128, 00:04:22.255 "large_cache_size": 16, 00:04:22.255 "task_count": 2048, 00:04:22.255 "sequence_count": 2048, 00:04:22.255 "buf_count": 2048 00:04:22.255 } 00:04:22.255 } 00:04:22.255 ] 00:04:22.255 }, 00:04:22.255 { 00:04:22.255 "subsystem": "bdev", 00:04:22.255 "config": [ 00:04:22.255 { 00:04:22.255 "method": "bdev_set_options", 00:04:22.255 "params": { 00:04:22.255 "bdev_io_pool_size": 65535, 00:04:22.255 "bdev_io_cache_size": 256, 00:04:22.255 "bdev_auto_examine": true, 00:04:22.255 "iobuf_small_cache_size": 128, 00:04:22.255 "iobuf_large_cache_size": 16 00:04:22.255 } 00:04:22.255 }, 00:04:22.255 { 00:04:22.255 "method": "bdev_raid_set_options", 00:04:22.255 "params": { 00:04:22.255 "process_window_size_kb": 1024 00:04:22.255 } 00:04:22.255 }, 00:04:22.255 { 00:04:22.255 "method": "bdev_iscsi_set_options", 00:04:22.255 "params": { 00:04:22.255 "timeout_sec": 30 00:04:22.255 } 00:04:22.255 }, 00:04:22.255 { 00:04:22.255 "method": "bdev_nvme_set_options", 00:04:22.255 "params": { 00:04:22.255 "action_on_timeout": "none", 00:04:22.255 "timeout_us": 0, 00:04:22.255 "timeout_admin_us": 0, 00:04:22.255 "keep_alive_timeout_ms": 10000, 00:04:22.255 "arbitration_burst": 0, 00:04:22.255 "low_priority_weight": 0, 00:04:22.255 "medium_priority_weight": 0, 00:04:22.255 "high_priority_weight": 0, 00:04:22.255 "nvme_adminq_poll_period_us": 10000, 00:04:22.255 "nvme_ioq_poll_period_us": 0, 00:04:22.255 "io_queue_requests": 0, 00:04:22.255 "delay_cmd_submit": true, 00:04:22.255 "transport_retry_count": 4, 00:04:22.255 "bdev_retry_count": 3, 00:04:22.255 "transport_ack_timeout": 0, 00:04:22.255 "ctrlr_loss_timeout_sec": 0, 00:04:22.255 "reconnect_delay_sec": 0, 00:04:22.255 "fast_io_fail_timeout_sec": 0, 00:04:22.255 "disable_auto_failback": false, 00:04:22.255 "generate_uuids": false, 00:04:22.255 "transport_tos": 0, 00:04:22.255 "nvme_error_stat": false, 00:04:22.255 "rdma_srq_size": 0, 00:04:22.255 "io_path_stat": false, 00:04:22.255 "allow_accel_sequence": false, 00:04:22.255 "rdma_max_cq_size": 0, 00:04:22.255 "rdma_cm_event_timeout_ms": 0, 00:04:22.255 "dhchap_digests": [ 00:04:22.255 "sha256", 00:04:22.255 "sha384", 00:04:22.255 "sha512" 00:04:22.255 ], 00:04:22.255 "dhchap_dhgroups": [ 00:04:22.255 "null", 00:04:22.255 "ffdhe2048", 00:04:22.255 "ffdhe3072", 00:04:22.255 "ffdhe4096", 00:04:22.255 "ffdhe6144", 00:04:22.255 "ffdhe8192" 00:04:22.255 ] 00:04:22.255 } 00:04:22.255 }, 00:04:22.255 { 00:04:22.255 "method": "bdev_nvme_set_hotplug", 00:04:22.255 "params": { 00:04:22.255 "period_us": 100000, 00:04:22.255 "enable": false 00:04:22.255 } 00:04:22.255 }, 00:04:22.255 { 00:04:22.255 "method": "bdev_wait_for_examine" 00:04:22.255 } 00:04:22.255 ] 00:04:22.255 }, 00:04:22.255 { 00:04:22.255 "subsystem": "scsi", 00:04:22.255 "config": null 00:04:22.255 }, 00:04:22.255 { 00:04:22.255 "subsystem": "scheduler", 00:04:22.255 "config": [ 00:04:22.255 { 00:04:22.255 "method": "framework_set_scheduler", 00:04:22.255 "params": { 00:04:22.255 "name": "static" 00:04:22.255 } 00:04:22.255 } 00:04:22.255 ] 00:04:22.255 }, 00:04:22.255 { 00:04:22.255 "subsystem": "vhost_scsi", 00:04:22.255 "config": [] 00:04:22.255 }, 00:04:22.255 { 00:04:22.255 "subsystem": "vhost_blk", 00:04:22.255 "config": [] 00:04:22.255 }, 00:04:22.255 { 00:04:22.255 "subsystem": "ublk", 00:04:22.255 "config": [] 00:04:22.255 }, 00:04:22.255 { 00:04:22.255 "subsystem": "nbd", 00:04:22.255 "config": [] 00:04:22.255 }, 00:04:22.255 { 00:04:22.255 "subsystem": "nvmf", 00:04:22.255 "config": [ 00:04:22.255 { 00:04:22.256 "method": "nvmf_set_config", 00:04:22.256 "params": { 00:04:22.256 "discovery_filter": "match_any", 00:04:22.256 "admin_cmd_passthru": { 00:04:22.256 "identify_ctrlr": false 00:04:22.256 } 00:04:22.256 } 00:04:22.256 }, 00:04:22.256 { 00:04:22.256 "method": "nvmf_set_max_subsystems", 00:04:22.256 "params": { 00:04:22.256 "max_subsystems": 1024 00:04:22.256 } 00:04:22.256 }, 00:04:22.256 { 00:04:22.256 "method": "nvmf_set_crdt", 00:04:22.256 "params": { 00:04:22.256 "crdt1": 0, 00:04:22.256 "crdt2": 0, 00:04:22.256 "crdt3": 0 00:04:22.256 } 00:04:22.256 }, 00:04:22.256 { 00:04:22.256 "method": "nvmf_create_transport", 00:04:22.256 "params": { 00:04:22.256 "trtype": "TCP", 00:04:22.256 "max_queue_depth": 128, 00:04:22.256 "max_io_qpairs_per_ctrlr": 127, 00:04:22.256 "in_capsule_data_size": 4096, 00:04:22.256 "max_io_size": 131072, 00:04:22.256 "io_unit_size": 131072, 00:04:22.256 "max_aq_depth": 128, 00:04:22.256 "num_shared_buffers": 511, 00:04:22.256 "buf_cache_size": 4294967295, 00:04:22.256 "dif_insert_or_strip": false, 00:04:22.256 "zcopy": false, 00:04:22.256 "c2h_success": true, 00:04:22.256 "sock_priority": 0, 00:04:22.256 "abort_timeout_sec": 1, 00:04:22.256 "ack_timeout": 0, 00:04:22.256 "data_wr_pool_size": 0 00:04:22.256 } 00:04:22.256 } 00:04:22.256 ] 00:04:22.256 }, 00:04:22.256 { 00:04:22.256 "subsystem": "iscsi", 00:04:22.256 "config": [ 00:04:22.256 { 00:04:22.256 "method": "iscsi_set_options", 00:04:22.256 "params": { 00:04:22.256 "node_base": "iqn.2016-06.io.spdk", 00:04:22.256 "max_sessions": 128, 00:04:22.256 "max_connections_per_session": 2, 00:04:22.256 "max_queue_depth": 64, 00:04:22.256 "default_time2wait": 2, 00:04:22.256 "default_time2retain": 20, 00:04:22.256 "first_burst_length": 8192, 00:04:22.256 "immediate_data": true, 00:04:22.256 "allow_duplicated_isid": false, 00:04:22.256 "error_recovery_level": 0, 00:04:22.256 "nop_timeout": 60, 00:04:22.256 "nop_in_interval": 30, 00:04:22.256 "disable_chap": false, 00:04:22.256 "require_chap": false, 00:04:22.256 "mutual_chap": false, 00:04:22.256 "chap_group": 0, 00:04:22.256 "max_large_datain_per_connection": 64, 00:04:22.256 "max_r2t_per_connection": 4, 00:04:22.256 "pdu_pool_size": 36864, 00:04:22.256 "immediate_data_pool_size": 16384, 00:04:22.256 "data_out_pool_size": 2048 00:04:22.256 } 00:04:22.256 } 00:04:22.256 ] 00:04:22.256 } 00:04:22.256 ] 00:04:22.256 } 00:04:22.256 03:04:56 -- rpc/skip_rpc.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:04:22.256 03:04:56 -- rpc/skip_rpc.sh@40 -- # killprocess 3897451 00:04:22.256 03:04:56 -- common/autotest_common.sh@936 -- # '[' -z 3897451 ']' 00:04:22.256 03:04:56 -- common/autotest_common.sh@940 -- # kill -0 3897451 00:04:22.256 03:04:56 -- common/autotest_common.sh@941 -- # uname 00:04:22.256 03:04:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:22.256 03:04:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3897451 00:04:22.256 03:04:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:22.256 03:04:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:22.256 03:04:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3897451' 00:04:22.256 killing process with pid 3897451 00:04:22.256 03:04:56 -- common/autotest_common.sh@955 -- # kill 3897451 00:04:22.256 03:04:56 -- common/autotest_common.sh@960 -- # wait 3897451 00:04:22.514 03:04:56 -- rpc/skip_rpc.sh@47 -- # local spdk_pid=3897692 00:04:22.514 03:04:56 -- rpc/skip_rpc.sh@48 -- # sleep 5 00:04:22.514 03:04:56 -- rpc/skip_rpc.sh@46 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --json /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc/config.json 00:04:27.804 03:05:02 -- rpc/skip_rpc.sh@50 -- # killprocess 3897692 00:04:27.804 03:05:02 -- common/autotest_common.sh@936 -- # '[' -z 3897692 ']' 00:04:27.804 03:05:02 -- common/autotest_common.sh@940 -- # kill -0 3897692 00:04:27.804 03:05:02 -- common/autotest_common.sh@941 -- # uname 00:04:27.804 03:05:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:27.804 03:05:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3897692 00:04:27.804 03:05:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:27.804 03:05:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:27.804 03:05:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3897692' 00:04:27.804 killing process with pid 3897692 00:04:27.804 03:05:02 -- common/autotest_common.sh@955 -- # kill 3897692 00:04:27.804 03:05:02 -- common/autotest_common.sh@960 -- # wait 3897692 00:04:28.062 03:05:02 -- rpc/skip_rpc.sh@51 -- # grep -q 'TCP Transport Init' /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc/log.txt 00:04:28.062 03:05:02 -- rpc/skip_rpc.sh@52 -- # rm /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc/log.txt 00:04:28.062 00:04:28.062 real 0m6.769s 00:04:28.062 user 0m6.609s 00:04:28.062 sys 0m0.565s 00:04:28.062 03:05:02 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:28.062 03:05:02 -- common/autotest_common.sh@10 -- # set +x 00:04:28.062 ************************************ 00:04:28.062 END TEST skip_rpc_with_json 00:04:28.062 ************************************ 00:04:28.062 03:05:02 -- rpc/skip_rpc.sh@75 -- # run_test skip_rpc_with_delay test_skip_rpc_with_delay 00:04:28.062 03:05:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:28.062 03:05:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:28.062 03:05:02 -- common/autotest_common.sh@10 -- # set +x 00:04:28.062 ************************************ 00:04:28.062 START TEST skip_rpc_with_delay 00:04:28.062 ************************************ 00:04:28.062 03:05:02 -- common/autotest_common.sh@1111 -- # test_skip_rpc_with_delay 00:04:28.062 03:05:02 -- rpc/skip_rpc.sh@57 -- # NOT /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:04:28.062 03:05:02 -- common/autotest_common.sh@638 -- # local es=0 00:04:28.063 03:05:02 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:04:28.063 03:05:02 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt 00:04:28.063 03:05:02 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:04:28.063 03:05:02 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt 00:04:28.063 03:05:02 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:04:28.063 03:05:02 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt 00:04:28.063 03:05:02 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:04:28.063 03:05:02 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt 00:04:28.063 03:05:02 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt ]] 00:04:28.063 03:05:02 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:04:28.063 [2024-04-25 03:05:02.552312] app.c: 751:spdk_app_start: *ERROR*: Cannot use '--wait-for-rpc' if no RPC server is going to be started. 00:04:28.063 [2024-04-25 03:05:02.552373] app.c: 630:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 0, errno: 2 00:04:28.063 03:05:02 -- common/autotest_common.sh@641 -- # es=1 00:04:28.063 03:05:02 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:04:28.063 03:05:02 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:04:28.063 03:05:02 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:04:28.063 00:04:28.063 real 0m0.065s 00:04:28.063 user 0m0.043s 00:04:28.063 sys 0m0.022s 00:04:28.063 03:05:02 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:28.063 03:05:02 -- common/autotest_common.sh@10 -- # set +x 00:04:28.321 ************************************ 00:04:28.321 END TEST skip_rpc_with_delay 00:04:28.321 ************************************ 00:04:28.321 03:05:02 -- rpc/skip_rpc.sh@77 -- # uname 00:04:28.321 03:05:02 -- rpc/skip_rpc.sh@77 -- # '[' Linux '!=' FreeBSD ']' 00:04:28.321 03:05:02 -- rpc/skip_rpc.sh@78 -- # run_test exit_on_failed_rpc_init test_exit_on_failed_rpc_init 00:04:28.321 03:05:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:28.321 03:05:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:28.321 03:05:02 -- common/autotest_common.sh@10 -- # set +x 00:04:28.321 ************************************ 00:04:28.321 START TEST exit_on_failed_rpc_init 00:04:28.321 ************************************ 00:04:28.321 03:05:02 -- common/autotest_common.sh@1111 -- # test_exit_on_failed_rpc_init 00:04:28.321 03:05:02 -- rpc/skip_rpc.sh@62 -- # local spdk_pid=3898693 00:04:28.321 03:05:02 -- rpc/skip_rpc.sh@63 -- # waitforlisten 3898693 00:04:28.321 03:05:02 -- rpc/skip_rpc.sh@61 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:28.321 03:05:02 -- common/autotest_common.sh@817 -- # '[' -z 3898693 ']' 00:04:28.321 03:05:02 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:28.321 03:05:02 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:28.321 03:05:02 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:28.321 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:28.321 03:05:02 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:28.321 03:05:02 -- common/autotest_common.sh@10 -- # set +x 00:04:28.321 [2024-04-25 03:05:02.767035] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:04:28.321 [2024-04-25 03:05:02.767074] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3898693 ] 00:04:28.321 EAL: No free 2048 kB hugepages reported on node 1 00:04:28.578 [2024-04-25 03:05:02.826229] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:28.578 [2024-04-25 03:05:02.895735] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:29.142 03:05:03 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:29.142 03:05:03 -- common/autotest_common.sh@850 -- # return 0 00:04:29.142 03:05:03 -- rpc/skip_rpc.sh@65 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:29.142 03:05:03 -- rpc/skip_rpc.sh@67 -- # NOT /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:04:29.142 03:05:03 -- common/autotest_common.sh@638 -- # local es=0 00:04:29.142 03:05:03 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:04:29.142 03:05:03 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt 00:04:29.142 03:05:03 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:04:29.142 03:05:03 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt 00:04:29.142 03:05:03 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:04:29.142 03:05:03 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt 00:04:29.142 03:05:03 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:04:29.142 03:05:03 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt 00:04:29.142 03:05:03 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt ]] 00:04:29.142 03:05:03 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:04:29.142 [2024-04-25 03:05:03.594616] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:04:29.142 [2024-04-25 03:05:03.594659] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3898895 ] 00:04:29.142 EAL: No free 2048 kB hugepages reported on node 1 00:04:29.400 [2024-04-25 03:05:03.653493] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:29.400 [2024-04-25 03:05:03.723108] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:29.400 [2024-04-25 03:05:03.723188] rpc.c: 180:_spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:04:29.400 [2024-04-25 03:05:03.723198] rpc.c: 166:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:04:29.400 [2024-04-25 03:05:03.723204] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:04:29.400 03:05:03 -- common/autotest_common.sh@641 -- # es=234 00:04:29.400 03:05:03 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:04:29.400 03:05:03 -- common/autotest_common.sh@650 -- # es=106 00:04:29.400 03:05:03 -- common/autotest_common.sh@651 -- # case "$es" in 00:04:29.400 03:05:03 -- common/autotest_common.sh@658 -- # es=1 00:04:29.400 03:05:03 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:04:29.400 03:05:03 -- rpc/skip_rpc.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:04:29.400 03:05:03 -- rpc/skip_rpc.sh@70 -- # killprocess 3898693 00:04:29.400 03:05:03 -- common/autotest_common.sh@936 -- # '[' -z 3898693 ']' 00:04:29.400 03:05:03 -- common/autotest_common.sh@940 -- # kill -0 3898693 00:04:29.400 03:05:03 -- common/autotest_common.sh@941 -- # uname 00:04:29.400 03:05:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:29.400 03:05:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3898693 00:04:29.400 03:05:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:29.400 03:05:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:29.400 03:05:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3898693' 00:04:29.400 killing process with pid 3898693 00:04:29.400 03:05:03 -- common/autotest_common.sh@955 -- # kill 3898693 00:04:29.400 03:05:03 -- common/autotest_common.sh@960 -- # wait 3898693 00:04:29.966 00:04:29.966 real 0m1.471s 00:04:29.966 user 0m1.690s 00:04:29.966 sys 0m0.389s 00:04:29.966 03:05:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:29.966 03:05:04 -- common/autotest_common.sh@10 -- # set +x 00:04:29.966 ************************************ 00:04:29.966 END TEST exit_on_failed_rpc_init 00:04:29.966 ************************************ 00:04:29.966 03:05:04 -- rpc/skip_rpc.sh@81 -- # rm /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc/config.json 00:04:29.966 00:04:29.966 real 0m14.367s 00:04:29.966 user 0m13.761s 00:04:29.966 sys 0m1.610s 00:04:29.966 03:05:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:29.966 03:05:04 -- common/autotest_common.sh@10 -- # set +x 00:04:29.966 ************************************ 00:04:29.966 END TEST skip_rpc 00:04:29.966 ************************************ 00:04:29.966 03:05:04 -- spdk/autotest.sh@167 -- # run_test rpc_client /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:29.966 03:05:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:29.966 03:05:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:29.966 03:05:04 -- common/autotest_common.sh@10 -- # set +x 00:04:29.966 ************************************ 00:04:29.966 START TEST rpc_client 00:04:29.966 ************************************ 00:04:29.966 03:05:04 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:30.226 * Looking for test storage... 00:04:30.226 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_client 00:04:30.226 03:05:04 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:04:30.226 OK 00:04:30.226 03:05:04 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:04:30.226 00:04:30.226 real 0m0.112s 00:04:30.226 user 0m0.040s 00:04:30.226 sys 0m0.079s 00:04:30.226 03:05:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:30.226 03:05:04 -- common/autotest_common.sh@10 -- # set +x 00:04:30.226 ************************************ 00:04:30.226 END TEST rpc_client 00:04:30.226 ************************************ 00:04:30.226 03:05:04 -- spdk/autotest.sh@168 -- # run_test json_config /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/json_config.sh 00:04:30.226 03:05:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:30.226 03:05:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:30.226 03:05:04 -- common/autotest_common.sh@10 -- # set +x 00:04:30.226 ************************************ 00:04:30.226 START TEST json_config 00:04:30.226 ************************************ 00:04:30.226 03:05:04 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/json_config.sh 00:04:30.484 03:05:04 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:04:30.484 03:05:04 -- nvmf/common.sh@7 -- # uname -s 00:04:30.484 03:05:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:30.484 03:05:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:30.484 03:05:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:30.484 03:05:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:30.484 03:05:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:30.484 03:05:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:30.484 03:05:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:30.484 03:05:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:30.484 03:05:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:30.484 03:05:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:30.485 03:05:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:04:30.485 03:05:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:04:30.485 03:05:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:30.485 03:05:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:30.485 03:05:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:30.485 03:05:04 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:04:30.485 03:05:04 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:04:30.485 03:05:04 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:30.485 03:05:04 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:30.485 03:05:04 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:30.485 03:05:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:30.485 03:05:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:30.485 03:05:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:30.485 03:05:04 -- paths/export.sh@5 -- # export PATH 00:04:30.485 03:05:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:30.485 03:05:04 -- nvmf/common.sh@47 -- # : 0 00:04:30.485 03:05:04 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:04:30.485 03:05:04 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:04:30.485 03:05:04 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:04:30.485 03:05:04 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:30.485 03:05:04 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:30.485 03:05:04 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:04:30.485 03:05:04 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:04:30.485 03:05:04 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:04:30.485 03:05:04 -- json_config/json_config.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/common.sh 00:04:30.485 03:05:04 -- json_config/json_config.sh@11 -- # [[ 0 -eq 1 ]] 00:04:30.485 03:05:04 -- json_config/json_config.sh@15 -- # [[ 0 -ne 1 ]] 00:04:30.485 03:05:04 -- json_config/json_config.sh@15 -- # [[ 0 -eq 1 ]] 00:04:30.485 03:05:04 -- json_config/json_config.sh@26 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:04:30.485 03:05:04 -- json_config/json_config.sh@31 -- # app_pid=(['target']='' ['initiator']='') 00:04:30.485 03:05:04 -- json_config/json_config.sh@31 -- # declare -A app_pid 00:04:30.485 03:05:04 -- json_config/json_config.sh@32 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:04:30.485 03:05:04 -- json_config/json_config.sh@32 -- # declare -A app_socket 00:04:30.485 03:05:04 -- json_config/json_config.sh@33 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:04:30.485 03:05:04 -- json_config/json_config.sh@33 -- # declare -A app_params 00:04:30.485 03:05:04 -- json_config/json_config.sh@34 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/spdk_initiator_config.json') 00:04:30.485 03:05:04 -- json_config/json_config.sh@34 -- # declare -A configs_path 00:04:30.485 03:05:04 -- json_config/json_config.sh@40 -- # last_event_id=0 00:04:30.485 03:05:04 -- json_config/json_config.sh@355 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:30.485 03:05:04 -- json_config/json_config.sh@356 -- # echo 'INFO: JSON configuration test init' 00:04:30.485 INFO: JSON configuration test init 00:04:30.485 03:05:04 -- json_config/json_config.sh@357 -- # json_config_test_init 00:04:30.485 03:05:04 -- json_config/json_config.sh@262 -- # timing_enter json_config_test_init 00:04:30.485 03:05:04 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:30.485 03:05:04 -- common/autotest_common.sh@10 -- # set +x 00:04:30.485 03:05:04 -- json_config/json_config.sh@263 -- # timing_enter json_config_setup_target 00:04:30.485 03:05:04 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:30.485 03:05:04 -- common/autotest_common.sh@10 -- # set +x 00:04:30.485 03:05:04 -- json_config/json_config.sh@265 -- # json_config_test_start_app target --wait-for-rpc 00:04:30.485 03:05:04 -- json_config/common.sh@9 -- # local app=target 00:04:30.485 03:05:04 -- json_config/common.sh@10 -- # shift 00:04:30.485 03:05:04 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:04:30.485 03:05:04 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:04:30.485 03:05:04 -- json_config/common.sh@15 -- # local app_extra_params= 00:04:30.485 03:05:04 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:30.485 03:05:04 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:30.485 03:05:04 -- json_config/common.sh@22 -- # app_pid["$app"]=3899244 00:04:30.485 03:05:04 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:04:30.485 Waiting for target to run... 00:04:30.485 03:05:04 -- json_config/common.sh@25 -- # waitforlisten 3899244 /var/tmp/spdk_tgt.sock 00:04:30.485 03:05:04 -- common/autotest_common.sh@817 -- # '[' -z 3899244 ']' 00:04:30.485 03:05:04 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:30.485 03:05:04 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:30.485 03:05:04 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:04:30.485 03:05:04 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:30.485 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:30.485 03:05:04 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:30.485 03:05:04 -- common/autotest_common.sh@10 -- # set +x 00:04:30.485 [2024-04-25 03:05:04.822951] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:04:30.485 [2024-04-25 03:05:04.822994] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3899244 ] 00:04:30.485 EAL: No free 2048 kB hugepages reported on node 1 00:04:31.051 [2024-04-25 03:05:05.254783] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:31.051 [2024-04-25 03:05:05.344701] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:31.309 03:05:05 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:31.309 03:05:05 -- common/autotest_common.sh@850 -- # return 0 00:04:31.309 03:05:05 -- json_config/common.sh@26 -- # echo '' 00:04:31.309 00:04:31.309 03:05:05 -- json_config/json_config.sh@269 -- # create_accel_config 00:04:31.309 03:05:05 -- json_config/json_config.sh@93 -- # timing_enter create_accel_config 00:04:31.309 03:05:05 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:31.309 03:05:05 -- common/autotest_common.sh@10 -- # set +x 00:04:31.309 03:05:05 -- json_config/json_config.sh@95 -- # [[ 0 -eq 1 ]] 00:04:31.309 03:05:05 -- json_config/json_config.sh@101 -- # timing_exit create_accel_config 00:04:31.309 03:05:05 -- common/autotest_common.sh@716 -- # xtrace_disable 00:04:31.309 03:05:05 -- common/autotest_common.sh@10 -- # set +x 00:04:31.309 03:05:05 -- json_config/json_config.sh@273 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:04:31.309 03:05:05 -- json_config/json_config.sh@274 -- # tgt_rpc load_config 00:04:31.309 03:05:05 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:04:34.593 03:05:08 -- json_config/json_config.sh@276 -- # tgt_check_notification_types 00:04:34.593 03:05:08 -- json_config/json_config.sh@43 -- # timing_enter tgt_check_notification_types 00:04:34.593 03:05:08 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:34.593 03:05:08 -- common/autotest_common.sh@10 -- # set +x 00:04:34.593 03:05:08 -- json_config/json_config.sh@45 -- # local ret=0 00:04:34.593 03:05:08 -- json_config/json_config.sh@46 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:04:34.593 03:05:08 -- json_config/json_config.sh@46 -- # local enabled_types 00:04:34.593 03:05:08 -- json_config/json_config.sh@48 -- # tgt_rpc notify_get_types 00:04:34.594 03:05:08 -- json_config/json_config.sh@48 -- # jq -r '.[]' 00:04:34.594 03:05:08 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:04:34.594 03:05:08 -- json_config/json_config.sh@48 -- # get_types=('bdev_register' 'bdev_unregister') 00:04:34.594 03:05:08 -- json_config/json_config.sh@48 -- # local get_types 00:04:34.594 03:05:08 -- json_config/json_config.sh@49 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:04:34.594 03:05:08 -- json_config/json_config.sh@54 -- # timing_exit tgt_check_notification_types 00:04:34.594 03:05:08 -- common/autotest_common.sh@716 -- # xtrace_disable 00:04:34.594 03:05:08 -- common/autotest_common.sh@10 -- # set +x 00:04:34.594 03:05:08 -- json_config/json_config.sh@55 -- # return 0 00:04:34.594 03:05:08 -- json_config/json_config.sh@278 -- # [[ 0 -eq 1 ]] 00:04:34.594 03:05:08 -- json_config/json_config.sh@282 -- # [[ 0 -eq 1 ]] 00:04:34.594 03:05:08 -- json_config/json_config.sh@286 -- # [[ 0 -eq 1 ]] 00:04:34.594 03:05:08 -- json_config/json_config.sh@290 -- # [[ 1 -eq 1 ]] 00:04:34.594 03:05:08 -- json_config/json_config.sh@291 -- # create_nvmf_subsystem_config 00:04:34.594 03:05:08 -- json_config/json_config.sh@230 -- # timing_enter create_nvmf_subsystem_config 00:04:34.594 03:05:08 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:34.594 03:05:08 -- common/autotest_common.sh@10 -- # set +x 00:04:34.594 03:05:08 -- json_config/json_config.sh@232 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:04:34.594 03:05:08 -- json_config/json_config.sh@233 -- # [[ rdma == \r\d\m\a ]] 00:04:34.594 03:05:08 -- json_config/json_config.sh@234 -- # TEST_TRANSPORT=rdma 00:04:34.594 03:05:08 -- json_config/json_config.sh@234 -- # nvmftestinit 00:04:34.594 03:05:08 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:04:34.594 03:05:08 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:04:34.594 03:05:08 -- nvmf/common.sh@437 -- # prepare_net_devs 00:04:34.594 03:05:08 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:04:34.594 03:05:08 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:04:34.594 03:05:08 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:04:34.594 03:05:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:04:34.594 03:05:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:04:34.594 03:05:08 -- nvmf/common.sh@403 -- # [[ phy-fallback != virt ]] 00:04:34.594 03:05:08 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:04:34.594 03:05:08 -- nvmf/common.sh@285 -- # xtrace_disable 00:04:34.594 03:05:08 -- common/autotest_common.sh@10 -- # set +x 00:04:41.149 03:05:14 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:04:41.149 03:05:14 -- nvmf/common.sh@291 -- # pci_devs=() 00:04:41.149 03:05:14 -- nvmf/common.sh@291 -- # local -a pci_devs 00:04:41.149 03:05:15 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:04:41.149 03:05:15 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:04:41.149 03:05:15 -- nvmf/common.sh@293 -- # pci_drivers=() 00:04:41.149 03:05:15 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:04:41.149 03:05:15 -- nvmf/common.sh@295 -- # net_devs=() 00:04:41.149 03:05:15 -- nvmf/common.sh@295 -- # local -ga net_devs 00:04:41.149 03:05:15 -- nvmf/common.sh@296 -- # e810=() 00:04:41.149 03:05:15 -- nvmf/common.sh@296 -- # local -ga e810 00:04:41.149 03:05:15 -- nvmf/common.sh@297 -- # x722=() 00:04:41.149 03:05:15 -- nvmf/common.sh@297 -- # local -ga x722 00:04:41.149 03:05:15 -- nvmf/common.sh@298 -- # mlx=() 00:04:41.149 03:05:15 -- nvmf/common.sh@298 -- # local -ga mlx 00:04:41.149 03:05:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:04:41.149 03:05:15 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:04:41.149 03:05:15 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:04:41.150 03:05:15 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:04:41.150 03:05:15 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:04:41.150 03:05:15 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:04:41.150 03:05:15 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:04:41.150 03:05:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:04:41.150 03:05:15 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:04:41.150 03:05:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:04:41.150 03:05:15 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:04:41.150 03:05:15 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:04:41.150 03:05:15 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:04:41.150 03:05:15 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:04:41.150 03:05:15 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:04:41.150 03:05:15 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:04:41.150 03:05:15 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:04:41.150 03:05:15 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:04:41.150 03:05:15 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:04:41.150 03:05:15 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:04:41.150 03:05:15 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:04:41.150 Found 0000:af:00.0 (0x8086 - 0x159b) 00:04:41.150 03:05:15 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:04:41.150 03:05:15 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:04:41.150 03:05:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:04:41.150 03:05:15 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:04:41.150 03:05:15 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:04:41.150 03:05:15 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:04:41.150 03:05:15 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:04:41.150 03:05:15 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:04:41.150 Found 0000:af:00.1 (0x8086 - 0x159b) 00:04:41.150 03:05:15 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:04:41.150 03:05:15 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:04:41.150 03:05:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:04:41.150 03:05:15 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:04:41.150 03:05:15 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:04:41.150 03:05:15 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:04:41.150 03:05:15 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:04:41.150 03:05:15 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:04:41.150 03:05:15 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:04:41.150 03:05:15 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:04:41.150 03:05:15 -- nvmf/common.sh@375 -- # (( 0 != 1 )) 00:04:41.150 03:05:15 -- nvmf/common.sh@375 -- # modprobe -r irdma 00:04:41.150 03:05:15 -- nvmf/common.sh@377 -- # modinfo irdma 00:04:41.150 03:05:15 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:04:41.150 03:05:15 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:04:41.150 03:05:15 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:04:41.150 03:05:15 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:04:41.150 03:05:15 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:04:41.150 03:05:15 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:04:41.150 Found net devices under 0000:af:00.0: cvl_0_0 00:04:41.150 03:05:15 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:04:41.150 03:05:15 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:04:41.150 03:05:15 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:04:41.150 03:05:15 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:04:41.150 03:05:15 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:04:41.150 03:05:15 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:04:41.150 Found net devices under 0000:af:00.1: cvl_0_1 00:04:41.150 03:05:15 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:04:41.150 03:05:15 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:04:41.150 03:05:15 -- nvmf/common.sh@403 -- # is_hw=yes 00:04:41.150 03:05:15 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:04:41.150 03:05:15 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:04:41.150 03:05:15 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:04:41.150 03:05:15 -- nvmf/common.sh@409 -- # rdma_device_init 00:04:41.150 03:05:15 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:04:41.150 03:05:15 -- nvmf/common.sh@58 -- # uname 00:04:41.150 03:05:15 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:04:41.150 03:05:15 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:04:41.150 03:05:15 -- nvmf/common.sh@63 -- # modprobe ib_core 00:04:41.150 03:05:15 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:04:41.150 03:05:15 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:04:41.150 03:05:15 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:04:41.150 03:05:15 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:04:41.150 03:05:15 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:04:41.150 03:05:15 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:04:41.150 03:05:15 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:04:41.150 03:05:15 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:04:41.150 03:05:15 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:04:41.150 03:05:15 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:04:41.150 03:05:15 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:04:41.150 03:05:15 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:04:41.150 03:05:15 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:04:41.150 03:05:15 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:04:41.150 03:05:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:04:41.150 03:05:15 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:04:41.150 03:05:15 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:04:41.150 03:05:15 -- nvmf/common.sh@105 -- # continue 2 00:04:41.150 03:05:15 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:04:41.150 03:05:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:04:41.150 03:05:15 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:04:41.150 03:05:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:04:41.150 03:05:15 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:04:41.150 03:05:15 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:04:41.150 03:05:15 -- nvmf/common.sh@105 -- # continue 2 00:04:41.150 03:05:15 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:04:41.150 03:05:15 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:04:41.150 03:05:15 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:04:41.150 03:05:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:04:41.150 03:05:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:04:41.150 03:05:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:04:41.150 03:05:15 -- nvmf/common.sh@74 -- # ip= 00:04:41.150 03:05:15 -- nvmf/common.sh@75 -- # [[ -z '' ]] 00:04:41.150 03:05:15 -- nvmf/common.sh@76 -- # ip addr add 192.168.100.8/24 dev cvl_0_0 00:04:41.150 03:05:15 -- nvmf/common.sh@77 -- # ip link set cvl_0_0 up 00:04:41.150 03:05:15 -- nvmf/common.sh@78 -- # (( count = count + 1 )) 00:04:41.150 03:05:15 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:04:41.150 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:04:41.150 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:04:41.150 altname enp175s0f0np0 00:04:41.150 altname ens801f0np0 00:04:41.150 inet 192.168.100.8/24 scope global cvl_0_0 00:04:41.150 valid_lft forever preferred_lft forever 00:04:41.150 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:04:41.150 valid_lft forever preferred_lft forever 00:04:41.150 03:05:15 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:04:41.150 03:05:15 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:04:41.150 03:05:15 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:04:41.150 03:05:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:04:41.150 03:05:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:04:41.150 03:05:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:04:41.150 03:05:15 -- nvmf/common.sh@74 -- # ip= 00:04:41.150 03:05:15 -- nvmf/common.sh@75 -- # [[ -z '' ]] 00:04:41.150 03:05:15 -- nvmf/common.sh@76 -- # ip addr add 192.168.100.9/24 dev cvl_0_1 00:04:41.150 03:05:15 -- nvmf/common.sh@77 -- # ip link set cvl_0_1 up 00:04:41.150 03:05:15 -- nvmf/common.sh@78 -- # (( count = count + 1 )) 00:04:41.150 03:05:15 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:04:41.150 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:04:41.150 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:04:41.150 altname enp175s0f1np1 00:04:41.150 altname ens801f1np1 00:04:41.150 inet 192.168.100.9/24 scope global cvl_0_1 00:04:41.150 valid_lft forever preferred_lft forever 00:04:41.150 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:04:41.150 valid_lft forever preferred_lft forever 00:04:41.150 03:05:15 -- nvmf/common.sh@411 -- # return 0 00:04:41.150 03:05:15 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:04:41.150 03:05:15 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:04:41.150 03:05:15 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:04:41.150 03:05:15 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:04:41.150 03:05:15 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:04:41.150 03:05:15 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:04:41.150 03:05:15 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:04:41.150 03:05:15 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:04:41.150 03:05:15 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:04:41.150 03:05:15 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:04:41.150 03:05:15 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:04:41.150 03:05:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:04:41.150 03:05:15 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:04:41.150 03:05:15 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:04:41.150 03:05:15 -- nvmf/common.sh@105 -- # continue 2 00:04:41.150 03:05:15 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:04:41.150 03:05:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:04:41.150 03:05:15 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:04:41.150 03:05:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:04:41.150 03:05:15 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:04:41.150 03:05:15 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:04:41.150 03:05:15 -- nvmf/common.sh@105 -- # continue 2 00:04:41.150 03:05:15 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:04:41.150 03:05:15 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:04:41.150 03:05:15 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:04:41.150 03:05:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:04:41.150 03:05:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:04:41.150 03:05:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:04:41.151 03:05:15 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:04:41.151 03:05:15 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:04:41.151 03:05:15 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:04:41.151 03:05:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:04:41.151 03:05:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:04:41.151 03:05:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:04:41.151 03:05:15 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:04:41.151 192.168.100.9' 00:04:41.151 03:05:15 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:04:41.151 192.168.100.9' 00:04:41.151 03:05:15 -- nvmf/common.sh@446 -- # head -n 1 00:04:41.151 03:05:15 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:04:41.151 03:05:15 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:04:41.151 192.168.100.9' 00:04:41.151 03:05:15 -- nvmf/common.sh@447 -- # tail -n +2 00:04:41.151 03:05:15 -- nvmf/common.sh@447 -- # head -n 1 00:04:41.151 03:05:15 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:04:41.151 03:05:15 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:04:41.151 03:05:15 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:04:41.151 03:05:15 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:04:41.151 03:05:15 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:04:41.151 03:05:15 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:04:41.151 03:05:15 -- json_config/json_config.sh@237 -- # [[ -z 192.168.100.8 ]] 00:04:41.151 03:05:15 -- json_config/json_config.sh@242 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:41.151 03:05:15 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:41.409 MallocForNvmf0 00:04:41.409 03:05:15 -- json_config/json_config.sh@243 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:41.409 03:05:15 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:41.409 MallocForNvmf1 00:04:41.409 03:05:15 -- json_config/json_config.sh@245 -- # tgt_rpc nvmf_create_transport -t rdma -u 8192 -c 0 00:04:41.409 03:05:15 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t rdma -u 8192 -c 0 00:04:41.667 [2024-04-25 03:05:16.021607] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:04:41.667 [2024-04-25 03:05:16.055780] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x9af130/0x9ae770) succeed. 00:04:41.667 [2024-04-25 03:05:16.065469] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x9b1270/0x9aecf0) succeed. 00:04:41.667 [2024-04-25 03:05:16.065498] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:04:41.667 [2024-04-25 03:05:16.068344] iobuf.c: 323:spdk_iobuf_channel_init: *ERROR*: Failed to populate 'nvmf_RDMA' iobuf large buffer cache at 1024/3071 entries. You may need to increase spdk_iobuf_opts.large_pool_count (1024) 00:04:41.667 [2024-04-25 03:05:16.068355] iobuf.c: 326:spdk_iobuf_channel_init: *ERROR*: See scripts/calc-iobuf.py for guidance on how to calculate this value. 00:04:41.667 [2024-04-25 03:05:16.070067] transport.c: 629:nvmf_transport_poll_group_create: *ERROR*: Unable to reserve the full number of buffers for the pg buffer cache. 00:04:41.667 03:05:16 -- json_config/json_config.sh@246 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:41.667 03:05:16 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:41.925 03:05:16 -- json_config/json_config.sh@247 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:41.925 03:05:16 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:42.183 03:05:16 -- json_config/json_config.sh@248 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:42.183 03:05:16 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:42.183 03:05:16 -- json_config/json_config.sh@249 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:04:42.183 03:05:16 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:04:42.441 [2024-04-25 03:05:16.760191] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:04:42.441 03:05:16 -- json_config/json_config.sh@251 -- # timing_exit create_nvmf_subsystem_config 00:04:42.441 03:05:16 -- common/autotest_common.sh@716 -- # xtrace_disable 00:04:42.441 03:05:16 -- common/autotest_common.sh@10 -- # set +x 00:04:42.441 03:05:16 -- json_config/json_config.sh@293 -- # timing_exit json_config_setup_target 00:04:42.441 03:05:16 -- common/autotest_common.sh@716 -- # xtrace_disable 00:04:42.441 03:05:16 -- common/autotest_common.sh@10 -- # set +x 00:04:42.441 03:05:16 -- json_config/json_config.sh@295 -- # [[ 0 -eq 1 ]] 00:04:42.441 03:05:16 -- json_config/json_config.sh@300 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:42.441 03:05:16 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:42.699 MallocBdevForConfigChangeCheck 00:04:42.699 03:05:17 -- json_config/json_config.sh@302 -- # timing_exit json_config_test_init 00:04:42.699 03:05:17 -- common/autotest_common.sh@716 -- # xtrace_disable 00:04:42.699 03:05:17 -- common/autotest_common.sh@10 -- # set +x 00:04:42.699 03:05:17 -- json_config/json_config.sh@359 -- # tgt_rpc save_config 00:04:42.699 03:05:17 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:42.957 03:05:17 -- json_config/json_config.sh@361 -- # echo 'INFO: shutting down applications...' 00:04:42.957 INFO: shutting down applications... 00:04:42.957 03:05:17 -- json_config/json_config.sh@362 -- # [[ 0 -eq 1 ]] 00:04:42.957 03:05:17 -- json_config/json_config.sh@368 -- # json_config_clear target 00:04:42.957 03:05:17 -- json_config/json_config.sh@332 -- # [[ -n 22 ]] 00:04:42.957 03:05:17 -- json_config/json_config.sh@333 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:04:44.858 Calling clear_iscsi_subsystem 00:04:44.858 Calling clear_nvmf_subsystem 00:04:44.858 Calling clear_nbd_subsystem 00:04:44.858 Calling clear_ublk_subsystem 00:04:44.858 Calling clear_vhost_blk_subsystem 00:04:44.858 Calling clear_vhost_scsi_subsystem 00:04:44.858 Calling clear_bdev_subsystem 00:04:44.858 03:05:18 -- json_config/json_config.sh@337 -- # local config_filter=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/config_filter.py 00:04:44.858 03:05:18 -- json_config/json_config.sh@343 -- # count=100 00:04:44.858 03:05:18 -- json_config/json_config.sh@344 -- # '[' 100 -gt 0 ']' 00:04:44.858 03:05:18 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:44.858 03:05:18 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:04:44.858 03:05:18 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:04:44.858 03:05:19 -- json_config/json_config.sh@345 -- # break 00:04:44.858 03:05:19 -- json_config/json_config.sh@350 -- # '[' 100 -eq 0 ']' 00:04:44.858 03:05:19 -- json_config/json_config.sh@369 -- # json_config_test_shutdown_app target 00:04:44.858 03:05:19 -- json_config/common.sh@31 -- # local app=target 00:04:44.858 03:05:19 -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:04:44.858 03:05:19 -- json_config/common.sh@35 -- # [[ -n 3899244 ]] 00:04:44.858 03:05:19 -- json_config/common.sh@38 -- # kill -SIGINT 3899244 00:04:44.858 03:05:19 -- json_config/common.sh@40 -- # (( i = 0 )) 00:04:44.858 03:05:19 -- json_config/common.sh@40 -- # (( i < 30 )) 00:04:44.858 03:05:19 -- json_config/common.sh@41 -- # kill -0 3899244 00:04:44.858 03:05:19 -- json_config/common.sh@45 -- # sleep 0.5 00:04:44.858 [2024-04-25 03:05:19.329344] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:04:45.425 03:05:19 -- json_config/common.sh@40 -- # (( i++ )) 00:04:45.425 03:05:19 -- json_config/common.sh@40 -- # (( i < 30 )) 00:04:45.425 03:05:19 -- json_config/common.sh@41 -- # kill -0 3899244 00:04:45.425 03:05:19 -- json_config/common.sh@42 -- # app_pid["$app"]= 00:04:45.425 03:05:19 -- json_config/common.sh@43 -- # break 00:04:45.425 03:05:19 -- json_config/common.sh@48 -- # [[ -n '' ]] 00:04:45.425 03:05:19 -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:04:45.425 SPDK target shutdown done 00:04:45.425 03:05:19 -- json_config/json_config.sh@371 -- # echo 'INFO: relaunching applications...' 00:04:45.425 INFO: relaunching applications... 00:04:45.425 03:05:19 -- json_config/json_config.sh@372 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/spdk_tgt_config.json 00:04:45.425 03:05:19 -- json_config/common.sh@9 -- # local app=target 00:04:45.425 03:05:19 -- json_config/common.sh@10 -- # shift 00:04:45.425 03:05:19 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:04:45.425 03:05:19 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:04:45.425 03:05:19 -- json_config/common.sh@15 -- # local app_extra_params= 00:04:45.425 03:05:19 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:45.425 03:05:19 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:45.425 03:05:19 -- json_config/common.sh@22 -- # app_pid["$app"]=3904239 00:04:45.425 03:05:19 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:04:45.425 Waiting for target to run... 00:04:45.425 03:05:19 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/spdk_tgt_config.json 00:04:45.425 03:05:19 -- json_config/common.sh@25 -- # waitforlisten 3904239 /var/tmp/spdk_tgt.sock 00:04:45.425 03:05:19 -- common/autotest_common.sh@817 -- # '[' -z 3904239 ']' 00:04:45.425 03:05:19 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:45.425 03:05:19 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:45.425 03:05:19 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:45.425 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:45.425 03:05:19 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:45.425 03:05:19 -- common/autotest_common.sh@10 -- # set +x 00:04:45.425 [2024-04-25 03:05:19.792600] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:04:45.425 [2024-04-25 03:05:19.792657] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3904239 ] 00:04:45.425 EAL: No free 2048 kB hugepages reported on node 1 00:04:45.992 [2024-04-25 03:05:20.241728] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:45.992 [2024-04-25 03:05:20.324027] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:49.273 [2024-04-25 03:05:23.329706] transport.c: 288:nvmf_transport_create: *WARNING*: The num_shared_buffers value (4095) is larger than the available iobuf pool size (1024). Please increase the iobuf pool sizes. 00:04:49.274 [2024-04-25 03:05:23.343747] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x216d040/0x216c680) succeed. 00:04:49.274 [2024-04-25 03:05:23.353772] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x216f180/0x216cc00) succeed. 00:04:49.274 [2024-04-25 03:05:23.355923] iobuf.c: 323:spdk_iobuf_channel_init: *ERROR*: Failed to populate 'nvmf_RDMA' iobuf large buffer cache at 1024/3071 entries. You may need to increase spdk_iobuf_opts.large_pool_count (1024) 00:04:49.274 [2024-04-25 03:05:23.355936] iobuf.c: 326:spdk_iobuf_channel_init: *ERROR*: See scripts/calc-iobuf.py for guidance on how to calculate this value. 00:04:49.274 [2024-04-25 03:05:23.357593] transport.c: 629:nvmf_transport_poll_group_create: *ERROR*: Unable to reserve the full number of buffers for the pg buffer cache. 00:04:49.274 [2024-04-25 03:05:23.385804] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:04:49.556 03:05:23 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:49.556 03:05:23 -- common/autotest_common.sh@850 -- # return 0 00:04:49.556 03:05:23 -- json_config/common.sh@26 -- # echo '' 00:04:49.557 00:04:49.557 03:05:23 -- json_config/json_config.sh@373 -- # [[ 0 -eq 1 ]] 00:04:49.557 03:05:23 -- json_config/json_config.sh@377 -- # echo 'INFO: Checking if target configuration is the same...' 00:04:49.557 INFO: Checking if target configuration is the same... 00:04:49.557 03:05:23 -- json_config/json_config.sh@378 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/spdk_tgt_config.json 00:04:49.557 03:05:23 -- json_config/json_config.sh@378 -- # tgt_rpc save_config 00:04:49.557 03:05:23 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:49.557 + '[' 2 -ne 2 ']' 00:04:49.557 +++ dirname /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:49.557 ++ readlink -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/../.. 00:04:49.557 + rootdir=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:04:49.557 +++ basename /dev/fd/62 00:04:49.557 ++ mktemp /tmp/62.XXX 00:04:49.557 + tmp_file_1=/tmp/62.oCJ 00:04:49.557 +++ basename /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/spdk_tgt_config.json 00:04:49.557 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:49.557 + tmp_file_2=/tmp/spdk_tgt_config.json.Ddb 00:04:49.557 + ret=0 00:04:49.557 + /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:49.825 + /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:49.825 + diff -u /tmp/62.oCJ /tmp/spdk_tgt_config.json.Ddb 00:04:49.825 + echo 'INFO: JSON config files are the same' 00:04:49.825 INFO: JSON config files are the same 00:04:49.825 + rm /tmp/62.oCJ /tmp/spdk_tgt_config.json.Ddb 00:04:49.825 + exit 0 00:04:49.825 03:05:24 -- json_config/json_config.sh@379 -- # [[ 0 -eq 1 ]] 00:04:49.825 03:05:24 -- json_config/json_config.sh@384 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:04:49.825 INFO: changing configuration and checking if this can be detected... 00:04:49.825 03:05:24 -- json_config/json_config.sh@386 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:49.825 03:05:24 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:50.084 03:05:24 -- json_config/json_config.sh@387 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/spdk_tgt_config.json 00:04:50.084 03:05:24 -- json_config/json_config.sh@387 -- # tgt_rpc save_config 00:04:50.084 03:05:24 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:50.084 + '[' 2 -ne 2 ']' 00:04:50.084 +++ dirname /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:50.084 ++ readlink -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/../.. 00:04:50.084 + rootdir=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:04:50.084 +++ basename /dev/fd/62 00:04:50.084 ++ mktemp /tmp/62.XXX 00:04:50.084 + tmp_file_1=/tmp/62.qtW 00:04:50.084 +++ basename /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/spdk_tgt_config.json 00:04:50.084 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:50.084 + tmp_file_2=/tmp/spdk_tgt_config.json.d2P 00:04:50.084 + ret=0 00:04:50.084 + /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:50.342 + /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:50.342 + diff -u /tmp/62.qtW /tmp/spdk_tgt_config.json.d2P 00:04:50.342 + ret=1 00:04:50.342 + echo '=== Start of file: /tmp/62.qtW ===' 00:04:50.342 + cat /tmp/62.qtW 00:04:50.342 + echo '=== End of file: /tmp/62.qtW ===' 00:04:50.342 + echo '' 00:04:50.343 + echo '=== Start of file: /tmp/spdk_tgt_config.json.d2P ===' 00:04:50.343 + cat /tmp/spdk_tgt_config.json.d2P 00:04:50.343 + echo '=== End of file: /tmp/spdk_tgt_config.json.d2P ===' 00:04:50.343 + echo '' 00:04:50.343 + rm /tmp/62.qtW /tmp/spdk_tgt_config.json.d2P 00:04:50.343 + exit 1 00:04:50.343 03:05:24 -- json_config/json_config.sh@391 -- # echo 'INFO: configuration change detected.' 00:04:50.343 INFO: configuration change detected. 00:04:50.343 03:05:24 -- json_config/json_config.sh@394 -- # json_config_test_fini 00:04:50.343 03:05:24 -- json_config/json_config.sh@306 -- # timing_enter json_config_test_fini 00:04:50.343 03:05:24 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:50.343 03:05:24 -- common/autotest_common.sh@10 -- # set +x 00:04:50.343 03:05:24 -- json_config/json_config.sh@307 -- # local ret=0 00:04:50.343 03:05:24 -- json_config/json_config.sh@309 -- # [[ -n '' ]] 00:04:50.343 03:05:24 -- json_config/json_config.sh@317 -- # [[ -n 3904239 ]] 00:04:50.343 03:05:24 -- json_config/json_config.sh@320 -- # cleanup_bdev_subsystem_config 00:04:50.343 03:05:24 -- json_config/json_config.sh@184 -- # timing_enter cleanup_bdev_subsystem_config 00:04:50.343 03:05:24 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:50.343 03:05:24 -- common/autotest_common.sh@10 -- # set +x 00:04:50.343 03:05:24 -- json_config/json_config.sh@186 -- # [[ 0 -eq 1 ]] 00:04:50.343 03:05:24 -- json_config/json_config.sh@193 -- # uname -s 00:04:50.343 03:05:24 -- json_config/json_config.sh@193 -- # [[ Linux = Linux ]] 00:04:50.343 03:05:24 -- json_config/json_config.sh@194 -- # rm -f /sample_aio 00:04:50.343 03:05:24 -- json_config/json_config.sh@197 -- # [[ 0 -eq 1 ]] 00:04:50.343 03:05:24 -- json_config/json_config.sh@201 -- # timing_exit cleanup_bdev_subsystem_config 00:04:50.343 03:05:24 -- common/autotest_common.sh@716 -- # xtrace_disable 00:04:50.343 03:05:24 -- common/autotest_common.sh@10 -- # set +x 00:04:50.601 03:05:24 -- json_config/json_config.sh@323 -- # killprocess 3904239 00:04:50.601 03:05:24 -- common/autotest_common.sh@936 -- # '[' -z 3904239 ']' 00:04:50.601 03:05:24 -- common/autotest_common.sh@940 -- # kill -0 3904239 00:04:50.601 03:05:24 -- common/autotest_common.sh@941 -- # uname 00:04:50.601 03:05:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:50.601 03:05:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3904239 00:04:50.601 03:05:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:50.601 03:05:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:50.601 03:05:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3904239' 00:04:50.601 killing process with pid 3904239 00:04:50.601 03:05:24 -- common/autotest_common.sh@955 -- # kill 3904239 00:04:50.601 03:05:24 -- common/autotest_common.sh@960 -- # wait 3904239 00:04:50.601 [2024-04-25 03:05:25.001331] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:04:51.977 03:05:26 -- json_config/json_config.sh@326 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/spdk_tgt_config.json 00:04:51.977 03:05:26 -- json_config/json_config.sh@327 -- # timing_exit json_config_test_fini 00:04:51.977 03:05:26 -- common/autotest_common.sh@716 -- # xtrace_disable 00:04:51.977 03:05:26 -- common/autotest_common.sh@10 -- # set +x 00:04:51.977 03:05:26 -- json_config/json_config.sh@328 -- # return 0 00:04:51.977 03:05:26 -- json_config/json_config.sh@396 -- # echo 'INFO: Success' 00:04:51.977 INFO: Success 00:04:51.977 03:05:26 -- json_config/json_config.sh@1 -- # nvmftestfini 00:04:51.977 03:05:26 -- nvmf/common.sh@477 -- # nvmfcleanup 00:04:51.977 03:05:26 -- nvmf/common.sh@117 -- # sync 00:04:51.977 03:05:26 -- nvmf/common.sh@119 -- # '[' '' == tcp ']' 00:04:51.977 03:05:26 -- nvmf/common.sh@119 -- # '[' '' == rdma ']' 00:04:51.977 03:05:26 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:04:51.977 03:05:26 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:04:51.977 03:05:26 -- nvmf/common.sh@484 -- # [[ '' == \t\c\p ]] 00:04:51.977 00:04:51.977 real 0m21.795s 00:04:51.977 user 0m24.022s 00:04:51.977 sys 0m7.037s 00:04:51.977 03:05:26 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:51.977 03:05:26 -- common/autotest_common.sh@10 -- # set +x 00:04:51.977 ************************************ 00:04:51.977 END TEST json_config 00:04:51.977 ************************************ 00:04:52.235 03:05:26 -- spdk/autotest.sh@169 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:52.235 03:05:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:52.235 03:05:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:52.235 03:05:26 -- common/autotest_common.sh@10 -- # set +x 00:04:52.235 ************************************ 00:04:52.235 START TEST json_config_extra_key 00:04:52.235 ************************************ 00:04:52.235 03:05:26 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:52.235 03:05:26 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:04:52.235 03:05:26 -- nvmf/common.sh@7 -- # uname -s 00:04:52.235 03:05:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:52.235 03:05:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:52.235 03:05:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:52.235 03:05:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:52.235 03:05:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:52.235 03:05:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:52.235 03:05:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:52.235 03:05:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:52.235 03:05:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:52.235 03:05:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:52.235 03:05:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:04:52.235 03:05:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:04:52.235 03:05:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:52.235 03:05:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:52.236 03:05:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:52.236 03:05:26 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:04:52.236 03:05:26 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:04:52.236 03:05:26 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:52.236 03:05:26 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:52.236 03:05:26 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:52.236 03:05:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:52.236 03:05:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:52.236 03:05:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:52.236 03:05:26 -- paths/export.sh@5 -- # export PATH 00:04:52.236 03:05:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:52.236 03:05:26 -- nvmf/common.sh@47 -- # : 0 00:04:52.236 03:05:26 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:04:52.236 03:05:26 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:04:52.236 03:05:26 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:04:52.236 03:05:26 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:52.236 03:05:26 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:52.236 03:05:26 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:04:52.236 03:05:26 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:04:52.236 03:05:26 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:04:52.236 03:05:26 -- json_config/json_config_extra_key.sh@10 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/common.sh 00:04:52.236 03:05:26 -- json_config/json_config_extra_key.sh@17 -- # app_pid=(['target']='') 00:04:52.236 03:05:26 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_pid 00:04:52.236 03:05:26 -- json_config/json_config_extra_key.sh@18 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:04:52.236 03:05:26 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_socket 00:04:52.236 03:05:26 -- json_config/json_config_extra_key.sh@19 -- # app_params=(['target']='-m 0x1 -s 1024') 00:04:52.236 03:05:26 -- json_config/json_config_extra_key.sh@19 -- # declare -A app_params 00:04:52.236 03:05:26 -- json_config/json_config_extra_key.sh@20 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/extra_key.json') 00:04:52.236 03:05:26 -- json_config/json_config_extra_key.sh@20 -- # declare -A configs_path 00:04:52.236 03:05:26 -- json_config/json_config_extra_key.sh@22 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:52.236 03:05:26 -- json_config/json_config_extra_key.sh@24 -- # echo 'INFO: launching applications...' 00:04:52.236 INFO: launching applications... 00:04:52.236 03:05:26 -- json_config/json_config_extra_key.sh@25 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/extra_key.json 00:04:52.236 03:05:26 -- json_config/common.sh@9 -- # local app=target 00:04:52.236 03:05:26 -- json_config/common.sh@10 -- # shift 00:04:52.236 03:05:26 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:04:52.236 03:05:26 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:04:52.236 03:05:26 -- json_config/common.sh@15 -- # local app_extra_params= 00:04:52.236 03:05:26 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:52.236 03:05:26 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:52.236 03:05:26 -- json_config/common.sh@22 -- # app_pid["$app"]=3905505 00:04:52.236 03:05:26 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:04:52.236 Waiting for target to run... 00:04:52.236 03:05:26 -- json_config/common.sh@25 -- # waitforlisten 3905505 /var/tmp/spdk_tgt.sock 00:04:52.236 03:05:26 -- common/autotest_common.sh@817 -- # '[' -z 3905505 ']' 00:04:52.236 03:05:26 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/extra_key.json 00:04:52.236 03:05:26 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:52.236 03:05:26 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:52.236 03:05:26 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:52.236 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:52.236 03:05:26 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:52.236 03:05:26 -- common/autotest_common.sh@10 -- # set +x 00:04:52.494 [2024-04-25 03:05:26.775943] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:04:52.495 [2024-04-25 03:05:26.775988] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3905505 ] 00:04:52.495 EAL: No free 2048 kB hugepages reported on node 1 00:04:52.753 [2024-04-25 03:05:27.053526] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:52.753 [2024-04-25 03:05:27.119866] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:53.320 03:05:27 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:53.320 03:05:27 -- common/autotest_common.sh@850 -- # return 0 00:04:53.320 03:05:27 -- json_config/common.sh@26 -- # echo '' 00:04:53.320 00:04:53.320 03:05:27 -- json_config/json_config_extra_key.sh@27 -- # echo 'INFO: shutting down applications...' 00:04:53.320 INFO: shutting down applications... 00:04:53.320 03:05:27 -- json_config/json_config_extra_key.sh@28 -- # json_config_test_shutdown_app target 00:04:53.320 03:05:27 -- json_config/common.sh@31 -- # local app=target 00:04:53.320 03:05:27 -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:04:53.320 03:05:27 -- json_config/common.sh@35 -- # [[ -n 3905505 ]] 00:04:53.320 03:05:27 -- json_config/common.sh@38 -- # kill -SIGINT 3905505 00:04:53.320 03:05:27 -- json_config/common.sh@40 -- # (( i = 0 )) 00:04:53.320 03:05:27 -- json_config/common.sh@40 -- # (( i < 30 )) 00:04:53.320 03:05:27 -- json_config/common.sh@41 -- # kill -0 3905505 00:04:53.320 03:05:27 -- json_config/common.sh@45 -- # sleep 0.5 00:04:53.579 03:05:28 -- json_config/common.sh@40 -- # (( i++ )) 00:04:53.579 03:05:28 -- json_config/common.sh@40 -- # (( i < 30 )) 00:04:53.579 03:05:28 -- json_config/common.sh@41 -- # kill -0 3905505 00:04:53.579 03:05:28 -- json_config/common.sh@42 -- # app_pid["$app"]= 00:04:53.579 03:05:28 -- json_config/common.sh@43 -- # break 00:04:53.579 03:05:28 -- json_config/common.sh@48 -- # [[ -n '' ]] 00:04:53.579 03:05:28 -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:04:53.579 SPDK target shutdown done 00:04:53.579 03:05:28 -- json_config/json_config_extra_key.sh@30 -- # echo Success 00:04:53.579 Success 00:04:53.579 00:04:53.579 real 0m1.423s 00:04:53.579 user 0m1.225s 00:04:53.579 sys 0m0.353s 00:04:53.579 03:05:28 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:53.579 03:05:28 -- common/autotest_common.sh@10 -- # set +x 00:04:53.579 ************************************ 00:04:53.579 END TEST json_config_extra_key 00:04:53.579 ************************************ 00:04:53.838 03:05:28 -- spdk/autotest.sh@170 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:53.838 03:05:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:53.838 03:05:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:53.838 03:05:28 -- common/autotest_common.sh@10 -- # set +x 00:04:53.838 ************************************ 00:04:53.838 START TEST alias_rpc 00:04:53.838 ************************************ 00:04:53.838 03:05:28 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:53.838 * Looking for test storage... 00:04:53.838 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/alias_rpc 00:04:53.838 03:05:28 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:53.838 03:05:28 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=3905790 00:04:53.838 03:05:28 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 3905790 00:04:53.838 03:05:28 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt 00:04:53.838 03:05:28 -- common/autotest_common.sh@817 -- # '[' -z 3905790 ']' 00:04:53.838 03:05:28 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:53.838 03:05:28 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:53.838 03:05:28 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:53.838 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:53.838 03:05:28 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:53.838 03:05:28 -- common/autotest_common.sh@10 -- # set +x 00:04:54.096 [2024-04-25 03:05:28.356550] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:04:54.096 [2024-04-25 03:05:28.356598] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3905790 ] 00:04:54.096 EAL: No free 2048 kB hugepages reported on node 1 00:04:54.096 [2024-04-25 03:05:28.418663] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:54.096 [2024-04-25 03:05:28.494712] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:54.663 03:05:29 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:54.663 03:05:29 -- common/autotest_common.sh@850 -- # return 0 00:04:54.663 03:05:29 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py load_config -i 00:04:54.922 03:05:29 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 3905790 00:04:54.922 03:05:29 -- common/autotest_common.sh@936 -- # '[' -z 3905790 ']' 00:04:54.922 03:05:29 -- common/autotest_common.sh@940 -- # kill -0 3905790 00:04:54.922 03:05:29 -- common/autotest_common.sh@941 -- # uname 00:04:54.922 03:05:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:54.922 03:05:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3905790 00:04:54.922 03:05:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:54.922 03:05:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:54.922 03:05:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3905790' 00:04:54.922 killing process with pid 3905790 00:04:54.922 03:05:29 -- common/autotest_common.sh@955 -- # kill 3905790 00:04:54.922 03:05:29 -- common/autotest_common.sh@960 -- # wait 3905790 00:04:55.489 00:04:55.489 real 0m1.476s 00:04:55.489 user 0m1.591s 00:04:55.489 sys 0m0.388s 00:04:55.489 03:05:29 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:55.489 03:05:29 -- common/autotest_common.sh@10 -- # set +x 00:04:55.489 ************************************ 00:04:55.489 END TEST alias_rpc 00:04:55.489 ************************************ 00:04:55.489 03:05:29 -- spdk/autotest.sh@172 -- # [[ 0 -eq 0 ]] 00:04:55.489 03:05:29 -- spdk/autotest.sh@173 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:55.489 03:05:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:55.489 03:05:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:55.489 03:05:29 -- common/autotest_common.sh@10 -- # set +x 00:04:55.489 ************************************ 00:04:55.489 START TEST spdkcli_tcp 00:04:55.489 ************************************ 00:04:55.489 03:05:29 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:55.489 * Looking for test storage... 00:04:55.489 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/spdkcli 00:04:55.489 03:05:29 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/spdkcli/common.sh 00:04:55.489 03:05:29 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:04:55.489 03:05:29 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/clear_config.py 00:04:55.489 03:05:29 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:04:55.489 03:05:29 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:04:55.489 03:05:29 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:04:55.489 03:05:29 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:04:55.489 03:05:29 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:55.489 03:05:29 -- common/autotest_common.sh@10 -- # set +x 00:04:55.489 03:05:29 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=3906241 00:04:55.489 03:05:29 -- spdkcli/tcp.sh@27 -- # waitforlisten 3906241 00:04:55.489 03:05:29 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:04:55.489 03:05:29 -- common/autotest_common.sh@817 -- # '[' -z 3906241 ']' 00:04:55.489 03:05:29 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:55.489 03:05:29 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:55.489 03:05:29 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:55.489 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:55.489 03:05:29 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:55.489 03:05:29 -- common/autotest_common.sh@10 -- # set +x 00:04:55.754 [2024-04-25 03:05:29.992737] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:04:55.755 [2024-04-25 03:05:29.992786] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3906241 ] 00:04:55.755 EAL: No free 2048 kB hugepages reported on node 1 00:04:55.755 [2024-04-25 03:05:30.059171] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:55.755 [2024-04-25 03:05:30.139782] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:55.755 [2024-04-25 03:05:30.139786] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:56.326 03:05:30 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:56.326 03:05:30 -- common/autotest_common.sh@850 -- # return 0 00:04:56.326 03:05:30 -- spdkcli/tcp.sh@31 -- # socat_pid=3906309 00:04:56.326 03:05:30 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:04:56.326 03:05:30 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:04:56.585 [ 00:04:56.585 "bdev_malloc_delete", 00:04:56.585 "bdev_malloc_create", 00:04:56.585 "bdev_null_resize", 00:04:56.585 "bdev_null_delete", 00:04:56.585 "bdev_null_create", 00:04:56.585 "bdev_nvme_cuse_unregister", 00:04:56.585 "bdev_nvme_cuse_register", 00:04:56.585 "bdev_opal_new_user", 00:04:56.585 "bdev_opal_set_lock_state", 00:04:56.585 "bdev_opal_delete", 00:04:56.585 "bdev_opal_get_info", 00:04:56.585 "bdev_opal_create", 00:04:56.585 "bdev_nvme_opal_revert", 00:04:56.585 "bdev_nvme_opal_init", 00:04:56.585 "bdev_nvme_send_cmd", 00:04:56.585 "bdev_nvme_get_path_iostat", 00:04:56.585 "bdev_nvme_get_mdns_discovery_info", 00:04:56.585 "bdev_nvme_stop_mdns_discovery", 00:04:56.585 "bdev_nvme_start_mdns_discovery", 00:04:56.585 "bdev_nvme_set_multipath_policy", 00:04:56.585 "bdev_nvme_set_preferred_path", 00:04:56.585 "bdev_nvme_get_io_paths", 00:04:56.585 "bdev_nvme_remove_error_injection", 00:04:56.585 "bdev_nvme_add_error_injection", 00:04:56.585 "bdev_nvme_get_discovery_info", 00:04:56.585 "bdev_nvme_stop_discovery", 00:04:56.585 "bdev_nvme_start_discovery", 00:04:56.585 "bdev_nvme_get_controller_health_info", 00:04:56.585 "bdev_nvme_disable_controller", 00:04:56.585 "bdev_nvme_enable_controller", 00:04:56.585 "bdev_nvme_reset_controller", 00:04:56.585 "bdev_nvme_get_transport_statistics", 00:04:56.585 "bdev_nvme_apply_firmware", 00:04:56.585 "bdev_nvme_detach_controller", 00:04:56.585 "bdev_nvme_get_controllers", 00:04:56.585 "bdev_nvme_attach_controller", 00:04:56.585 "bdev_nvme_set_hotplug", 00:04:56.585 "bdev_nvme_set_options", 00:04:56.585 "bdev_passthru_delete", 00:04:56.585 "bdev_passthru_create", 00:04:56.585 "bdev_lvol_grow_lvstore", 00:04:56.585 "bdev_lvol_get_lvols", 00:04:56.585 "bdev_lvol_get_lvstores", 00:04:56.585 "bdev_lvol_delete", 00:04:56.585 "bdev_lvol_set_read_only", 00:04:56.585 "bdev_lvol_resize", 00:04:56.585 "bdev_lvol_decouple_parent", 00:04:56.585 "bdev_lvol_inflate", 00:04:56.585 "bdev_lvol_rename", 00:04:56.585 "bdev_lvol_clone_bdev", 00:04:56.585 "bdev_lvol_clone", 00:04:56.585 "bdev_lvol_snapshot", 00:04:56.585 "bdev_lvol_create", 00:04:56.585 "bdev_lvol_delete_lvstore", 00:04:56.585 "bdev_lvol_rename_lvstore", 00:04:56.585 "bdev_lvol_create_lvstore", 00:04:56.585 "bdev_raid_set_options", 00:04:56.585 "bdev_raid_remove_base_bdev", 00:04:56.585 "bdev_raid_add_base_bdev", 00:04:56.585 "bdev_raid_delete", 00:04:56.585 "bdev_raid_create", 00:04:56.585 "bdev_raid_get_bdevs", 00:04:56.585 "bdev_error_inject_error", 00:04:56.585 "bdev_error_delete", 00:04:56.585 "bdev_error_create", 00:04:56.585 "bdev_split_delete", 00:04:56.585 "bdev_split_create", 00:04:56.585 "bdev_delay_delete", 00:04:56.585 "bdev_delay_create", 00:04:56.585 "bdev_delay_update_latency", 00:04:56.585 "bdev_zone_block_delete", 00:04:56.585 "bdev_zone_block_create", 00:04:56.585 "blobfs_create", 00:04:56.585 "blobfs_detect", 00:04:56.585 "blobfs_set_cache_size", 00:04:56.585 "bdev_aio_delete", 00:04:56.585 "bdev_aio_rescan", 00:04:56.586 "bdev_aio_create", 00:04:56.586 "bdev_ftl_set_property", 00:04:56.586 "bdev_ftl_get_properties", 00:04:56.586 "bdev_ftl_get_stats", 00:04:56.586 "bdev_ftl_unmap", 00:04:56.586 "bdev_ftl_unload", 00:04:56.586 "bdev_ftl_delete", 00:04:56.586 "bdev_ftl_load", 00:04:56.586 "bdev_ftl_create", 00:04:56.586 "bdev_virtio_attach_controller", 00:04:56.586 "bdev_virtio_scsi_get_devices", 00:04:56.586 "bdev_virtio_detach_controller", 00:04:56.586 "bdev_virtio_blk_set_hotplug", 00:04:56.586 "bdev_iscsi_delete", 00:04:56.586 "bdev_iscsi_create", 00:04:56.586 "bdev_iscsi_set_options", 00:04:56.586 "accel_error_inject_error", 00:04:56.586 "ioat_scan_accel_module", 00:04:56.586 "dsa_scan_accel_module", 00:04:56.586 "iaa_scan_accel_module", 00:04:56.586 "keyring_file_remove_key", 00:04:56.586 "keyring_file_add_key", 00:04:56.586 "iscsi_get_histogram", 00:04:56.586 "iscsi_enable_histogram", 00:04:56.586 "iscsi_set_options", 00:04:56.586 "iscsi_get_auth_groups", 00:04:56.586 "iscsi_auth_group_remove_secret", 00:04:56.586 "iscsi_auth_group_add_secret", 00:04:56.586 "iscsi_delete_auth_group", 00:04:56.586 "iscsi_create_auth_group", 00:04:56.586 "iscsi_set_discovery_auth", 00:04:56.586 "iscsi_get_options", 00:04:56.586 "iscsi_target_node_request_logout", 00:04:56.586 "iscsi_target_node_set_redirect", 00:04:56.586 "iscsi_target_node_set_auth", 00:04:56.586 "iscsi_target_node_add_lun", 00:04:56.586 "iscsi_get_stats", 00:04:56.586 "iscsi_get_connections", 00:04:56.586 "iscsi_portal_group_set_auth", 00:04:56.586 "iscsi_start_portal_group", 00:04:56.586 "iscsi_delete_portal_group", 00:04:56.586 "iscsi_create_portal_group", 00:04:56.586 "iscsi_get_portal_groups", 00:04:56.586 "iscsi_delete_target_node", 00:04:56.586 "iscsi_target_node_remove_pg_ig_maps", 00:04:56.586 "iscsi_target_node_add_pg_ig_maps", 00:04:56.586 "iscsi_create_target_node", 00:04:56.586 "iscsi_get_target_nodes", 00:04:56.586 "iscsi_delete_initiator_group", 00:04:56.586 "iscsi_initiator_group_remove_initiators", 00:04:56.586 "iscsi_initiator_group_add_initiators", 00:04:56.586 "iscsi_create_initiator_group", 00:04:56.586 "iscsi_get_initiator_groups", 00:04:56.586 "nvmf_set_crdt", 00:04:56.586 "nvmf_set_config", 00:04:56.586 "nvmf_set_max_subsystems", 00:04:56.586 "nvmf_subsystem_get_listeners", 00:04:56.586 "nvmf_subsystem_get_qpairs", 00:04:56.586 "nvmf_subsystem_get_controllers", 00:04:56.586 "nvmf_get_stats", 00:04:56.586 "nvmf_get_transports", 00:04:56.586 "nvmf_create_transport", 00:04:56.586 "nvmf_get_targets", 00:04:56.586 "nvmf_delete_target", 00:04:56.586 "nvmf_create_target", 00:04:56.586 "nvmf_subsystem_allow_any_host", 00:04:56.586 "nvmf_subsystem_remove_host", 00:04:56.586 "nvmf_subsystem_add_host", 00:04:56.586 "nvmf_ns_remove_host", 00:04:56.586 "nvmf_ns_add_host", 00:04:56.586 "nvmf_subsystem_remove_ns", 00:04:56.586 "nvmf_subsystem_add_ns", 00:04:56.586 "nvmf_subsystem_listener_set_ana_state", 00:04:56.586 "nvmf_discovery_get_referrals", 00:04:56.586 "nvmf_discovery_remove_referral", 00:04:56.586 "nvmf_discovery_add_referral", 00:04:56.586 "nvmf_subsystem_remove_listener", 00:04:56.586 "nvmf_subsystem_add_listener", 00:04:56.586 "nvmf_delete_subsystem", 00:04:56.586 "nvmf_create_subsystem", 00:04:56.586 "nvmf_get_subsystems", 00:04:56.586 "env_dpdk_get_mem_stats", 00:04:56.586 "nbd_get_disks", 00:04:56.586 "nbd_stop_disk", 00:04:56.586 "nbd_start_disk", 00:04:56.586 "ublk_recover_disk", 00:04:56.586 "ublk_get_disks", 00:04:56.586 "ublk_stop_disk", 00:04:56.586 "ublk_start_disk", 00:04:56.586 "ublk_destroy_target", 00:04:56.586 "ublk_create_target", 00:04:56.586 "virtio_blk_create_transport", 00:04:56.586 "virtio_blk_get_transports", 00:04:56.586 "vhost_controller_set_coalescing", 00:04:56.586 "vhost_get_controllers", 00:04:56.586 "vhost_delete_controller", 00:04:56.586 "vhost_create_blk_controller", 00:04:56.586 "vhost_scsi_controller_remove_target", 00:04:56.586 "vhost_scsi_controller_add_target", 00:04:56.586 "vhost_start_scsi_controller", 00:04:56.586 "vhost_create_scsi_controller", 00:04:56.586 "thread_set_cpumask", 00:04:56.586 "framework_get_scheduler", 00:04:56.586 "framework_set_scheduler", 00:04:56.586 "framework_get_reactors", 00:04:56.586 "thread_get_io_channels", 00:04:56.586 "thread_get_pollers", 00:04:56.586 "thread_get_stats", 00:04:56.586 "framework_monitor_context_switch", 00:04:56.586 "spdk_kill_instance", 00:04:56.586 "log_enable_timestamps", 00:04:56.586 "log_get_flags", 00:04:56.586 "log_clear_flag", 00:04:56.586 "log_set_flag", 00:04:56.586 "log_get_level", 00:04:56.586 "log_set_level", 00:04:56.586 "log_get_print_level", 00:04:56.586 "log_set_print_level", 00:04:56.586 "framework_enable_cpumask_locks", 00:04:56.586 "framework_disable_cpumask_locks", 00:04:56.586 "framework_wait_init", 00:04:56.586 "framework_start_init", 00:04:56.586 "scsi_get_devices", 00:04:56.586 "bdev_get_histogram", 00:04:56.586 "bdev_enable_histogram", 00:04:56.586 "bdev_set_qos_limit", 00:04:56.586 "bdev_set_qd_sampling_period", 00:04:56.586 "bdev_get_bdevs", 00:04:56.586 "bdev_reset_iostat", 00:04:56.586 "bdev_get_iostat", 00:04:56.586 "bdev_examine", 00:04:56.586 "bdev_wait_for_examine", 00:04:56.586 "bdev_set_options", 00:04:56.586 "notify_get_notifications", 00:04:56.586 "notify_get_types", 00:04:56.586 "accel_get_stats", 00:04:56.586 "accel_set_options", 00:04:56.586 "accel_set_driver", 00:04:56.586 "accel_crypto_key_destroy", 00:04:56.586 "accel_crypto_keys_get", 00:04:56.586 "accel_crypto_key_create", 00:04:56.586 "accel_assign_opc", 00:04:56.586 "accel_get_module_info", 00:04:56.586 "accel_get_opc_assignments", 00:04:56.586 "vmd_rescan", 00:04:56.586 "vmd_remove_device", 00:04:56.586 "vmd_enable", 00:04:56.586 "sock_set_default_impl", 00:04:56.586 "sock_impl_set_options", 00:04:56.586 "sock_impl_get_options", 00:04:56.586 "iobuf_get_stats", 00:04:56.586 "iobuf_set_options", 00:04:56.586 "framework_get_pci_devices", 00:04:56.586 "framework_get_config", 00:04:56.586 "framework_get_subsystems", 00:04:56.586 "trace_get_info", 00:04:56.586 "trace_get_tpoint_group_mask", 00:04:56.586 "trace_disable_tpoint_group", 00:04:56.586 "trace_enable_tpoint_group", 00:04:56.586 "trace_clear_tpoint_mask", 00:04:56.586 "trace_set_tpoint_mask", 00:04:56.586 "keyring_get_keys", 00:04:56.586 "spdk_get_version", 00:04:56.586 "rpc_get_methods" 00:04:56.586 ] 00:04:56.586 03:05:30 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:04:56.586 03:05:30 -- common/autotest_common.sh@716 -- # xtrace_disable 00:04:56.586 03:05:30 -- common/autotest_common.sh@10 -- # set +x 00:04:56.586 03:05:30 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:04:56.586 03:05:30 -- spdkcli/tcp.sh@38 -- # killprocess 3906241 00:04:56.586 03:05:30 -- common/autotest_common.sh@936 -- # '[' -z 3906241 ']' 00:04:56.586 03:05:30 -- common/autotest_common.sh@940 -- # kill -0 3906241 00:04:56.586 03:05:30 -- common/autotest_common.sh@941 -- # uname 00:04:56.586 03:05:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:56.586 03:05:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3906241 00:04:56.586 03:05:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:56.586 03:05:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:56.586 03:05:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3906241' 00:04:56.586 killing process with pid 3906241 00:04:56.586 03:05:31 -- common/autotest_common.sh@955 -- # kill 3906241 00:04:56.586 03:05:31 -- common/autotest_common.sh@960 -- # wait 3906241 00:04:57.153 00:04:57.153 real 0m1.527s 00:04:57.153 user 0m2.771s 00:04:57.153 sys 0m0.467s 00:04:57.153 03:05:31 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:57.153 03:05:31 -- common/autotest_common.sh@10 -- # set +x 00:04:57.153 ************************************ 00:04:57.153 END TEST spdkcli_tcp 00:04:57.153 ************************************ 00:04:57.153 03:05:31 -- spdk/autotest.sh@176 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:57.153 03:05:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:57.154 03:05:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:57.154 03:05:31 -- common/autotest_common.sh@10 -- # set +x 00:04:57.154 ************************************ 00:04:57.154 START TEST dpdk_mem_utility 00:04:57.154 ************************************ 00:04:57.154 03:05:31 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:57.154 * Looking for test storage... 00:04:57.154 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/dpdk_memory_utility 00:04:57.154 03:05:31 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:57.154 03:05:31 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=3906603 00:04:57.154 03:05:31 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 3906603 00:04:57.154 03:05:31 -- common/autotest_common.sh@817 -- # '[' -z 3906603 ']' 00:04:57.154 03:05:31 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:57.154 03:05:31 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:57.154 03:05:31 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:57.154 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:57.154 03:05:31 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt 00:04:57.154 03:05:31 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:57.154 03:05:31 -- common/autotest_common.sh@10 -- # set +x 00:04:57.413 [2024-04-25 03:05:31.672794] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:04:57.413 [2024-04-25 03:05:31.672839] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3906603 ] 00:04:57.413 EAL: No free 2048 kB hugepages reported on node 1 00:04:57.413 [2024-04-25 03:05:31.732969] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:57.413 [2024-04-25 03:05:31.809144] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:57.981 03:05:32 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:57.981 03:05:32 -- common/autotest_common.sh@850 -- # return 0 00:04:57.981 03:05:32 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:04:57.981 03:05:32 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:04:57.981 03:05:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:57.981 03:05:32 -- common/autotest_common.sh@10 -- # set +x 00:04:57.981 { 00:04:57.981 "filename": "/tmp/spdk_mem_dump.txt" 00:04:57.981 } 00:04:57.981 03:05:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:57.981 03:05:32 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:58.240 DPDK memory size 814.000000 MiB in 1 heap(s) 00:04:58.240 1 heaps totaling size 814.000000 MiB 00:04:58.240 size: 814.000000 MiB heap id: 0 00:04:58.240 end heaps---------- 00:04:58.240 8 mempools totaling size 598.116089 MiB 00:04:58.240 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:04:58.240 size: 158.602051 MiB name: PDU_data_out_Pool 00:04:58.240 size: 84.521057 MiB name: bdev_io_3906603 00:04:58.240 size: 51.011292 MiB name: evtpool_3906603 00:04:58.240 size: 50.003479 MiB name: msgpool_3906603 00:04:58.240 size: 21.763794 MiB name: PDU_Pool 00:04:58.240 size: 19.513306 MiB name: SCSI_TASK_Pool 00:04:58.240 size: 0.026123 MiB name: Session_Pool 00:04:58.240 end mempools------- 00:04:58.240 6 memzones totaling size 4.142822 MiB 00:04:58.240 size: 1.000366 MiB name: RG_ring_0_3906603 00:04:58.240 size: 1.000366 MiB name: RG_ring_1_3906603 00:04:58.240 size: 1.000366 MiB name: RG_ring_4_3906603 00:04:58.240 size: 1.000366 MiB name: RG_ring_5_3906603 00:04:58.240 size: 0.125366 MiB name: RG_ring_2_3906603 00:04:58.240 size: 0.015991 MiB name: RG_ring_3_3906603 00:04:58.240 end memzones------- 00:04:58.240 03:05:32 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:04:58.240 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:04:58.240 list of free elements. size: 12.519348 MiB 00:04:58.240 element at address: 0x200000400000 with size: 1.999512 MiB 00:04:58.240 element at address: 0x200018e00000 with size: 0.999878 MiB 00:04:58.240 element at address: 0x200019000000 with size: 0.999878 MiB 00:04:58.240 element at address: 0x200003e00000 with size: 0.996277 MiB 00:04:58.240 element at address: 0x200031c00000 with size: 0.994446 MiB 00:04:58.240 element at address: 0x200013800000 with size: 0.978699 MiB 00:04:58.240 element at address: 0x200007000000 with size: 0.959839 MiB 00:04:58.240 element at address: 0x200019200000 with size: 0.936584 MiB 00:04:58.240 element at address: 0x200000200000 with size: 0.841614 MiB 00:04:58.240 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:04:58.240 element at address: 0x20000b200000 with size: 0.490723 MiB 00:04:58.240 element at address: 0x200000800000 with size: 0.487793 MiB 00:04:58.240 element at address: 0x200019400000 with size: 0.485657 MiB 00:04:58.240 element at address: 0x200027e00000 with size: 0.410034 MiB 00:04:58.240 element at address: 0x200003a00000 with size: 0.355530 MiB 00:04:58.240 list of standard malloc elements. size: 199.218079 MiB 00:04:58.240 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:04:58.240 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:04:58.240 element at address: 0x200018efff80 with size: 1.000122 MiB 00:04:58.240 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:04:58.240 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:04:58.240 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:04:58.240 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:04:58.240 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:04:58.240 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:04:58.240 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:04:58.240 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:04:58.240 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:04:58.240 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:04:58.240 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:04:58.240 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:04:58.240 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:04:58.240 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:04:58.240 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:04:58.240 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:04:58.240 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:04:58.240 element at address: 0x200003adb300 with size: 0.000183 MiB 00:04:58.240 element at address: 0x200003adb500 with size: 0.000183 MiB 00:04:58.240 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:04:58.240 element at address: 0x200003affa80 with size: 0.000183 MiB 00:04:58.240 element at address: 0x200003affb40 with size: 0.000183 MiB 00:04:58.240 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:04:58.240 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:04:58.240 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:04:58.240 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:04:58.240 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:04:58.240 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:04:58.240 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:04:58.240 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:04:58.240 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:04:58.240 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:04:58.240 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:04:58.240 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:04:58.240 element at address: 0x200027e69040 with size: 0.000183 MiB 00:04:58.240 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:04:58.240 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:04:58.240 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:04:58.240 list of memzone associated elements. size: 602.262573 MiB 00:04:58.240 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:04:58.240 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:04:58.240 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:04:58.240 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:04:58.240 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:04:58.240 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_3906603_0 00:04:58.240 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:04:58.240 associated memzone info: size: 48.002930 MiB name: MP_evtpool_3906603_0 00:04:58.240 element at address: 0x200003fff380 with size: 48.003052 MiB 00:04:58.240 associated memzone info: size: 48.002930 MiB name: MP_msgpool_3906603_0 00:04:58.240 element at address: 0x2000195be940 with size: 20.255554 MiB 00:04:58.240 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:04:58.240 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:04:58.240 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:04:58.240 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:04:58.240 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_3906603 00:04:58.240 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:04:58.240 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_3906603 00:04:58.240 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:04:58.240 associated memzone info: size: 1.007996 MiB name: MP_evtpool_3906603 00:04:58.240 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:04:58.240 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:04:58.240 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:04:58.240 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:04:58.240 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:04:58.240 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:04:58.240 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:04:58.240 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:04:58.240 element at address: 0x200003eff180 with size: 1.000488 MiB 00:04:58.240 associated memzone info: size: 1.000366 MiB name: RG_ring_0_3906603 00:04:58.240 element at address: 0x200003affc00 with size: 1.000488 MiB 00:04:58.240 associated memzone info: size: 1.000366 MiB name: RG_ring_1_3906603 00:04:58.240 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:04:58.240 associated memzone info: size: 1.000366 MiB name: RG_ring_4_3906603 00:04:58.240 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:04:58.240 associated memzone info: size: 1.000366 MiB name: RG_ring_5_3906603 00:04:58.240 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:04:58.240 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_3906603 00:04:58.240 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:04:58.240 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:04:58.240 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:04:58.240 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:04:58.240 element at address: 0x20001947c540 with size: 0.250488 MiB 00:04:58.240 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:04:58.240 element at address: 0x200003adf880 with size: 0.125488 MiB 00:04:58.240 associated memzone info: size: 0.125366 MiB name: RG_ring_2_3906603 00:04:58.240 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:04:58.241 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:04:58.241 element at address: 0x200027e69100 with size: 0.023743 MiB 00:04:58.241 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:04:58.241 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:04:58.241 associated memzone info: size: 0.015991 MiB name: RG_ring_3_3906603 00:04:58.241 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:04:58.241 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:04:58.241 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:04:58.241 associated memzone info: size: 0.000183 MiB name: MP_msgpool_3906603 00:04:58.241 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:04:58.241 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_3906603 00:04:58.241 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:04:58.241 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:04:58.241 03:05:32 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:04:58.241 03:05:32 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 3906603 00:04:58.241 03:05:32 -- common/autotest_common.sh@936 -- # '[' -z 3906603 ']' 00:04:58.241 03:05:32 -- common/autotest_common.sh@940 -- # kill -0 3906603 00:04:58.241 03:05:32 -- common/autotest_common.sh@941 -- # uname 00:04:58.241 03:05:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:58.241 03:05:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3906603 00:04:58.241 03:05:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:58.241 03:05:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:58.241 03:05:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3906603' 00:04:58.241 killing process with pid 3906603 00:04:58.241 03:05:32 -- common/autotest_common.sh@955 -- # kill 3906603 00:04:58.241 03:05:32 -- common/autotest_common.sh@960 -- # wait 3906603 00:04:58.499 00:04:58.499 real 0m1.389s 00:04:58.499 user 0m1.452s 00:04:58.499 sys 0m0.382s 00:04:58.499 03:05:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:58.499 03:05:32 -- common/autotest_common.sh@10 -- # set +x 00:04:58.499 ************************************ 00:04:58.499 END TEST dpdk_mem_utility 00:04:58.499 ************************************ 00:04:58.499 03:05:32 -- spdk/autotest.sh@177 -- # run_test event /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/event.sh 00:04:58.499 03:05:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:58.499 03:05:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:58.499 03:05:32 -- common/autotest_common.sh@10 -- # set +x 00:04:58.756 ************************************ 00:04:58.756 START TEST event 00:04:58.756 ************************************ 00:04:58.756 03:05:33 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/event.sh 00:04:58.756 * Looking for test storage... 00:04:58.756 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event 00:04:58.756 03:05:33 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/bdev/nbd_common.sh 00:04:58.756 03:05:33 -- bdev/nbd_common.sh@6 -- # set -e 00:04:58.756 03:05:33 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:58.756 03:05:33 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:04:58.756 03:05:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:58.756 03:05:33 -- common/autotest_common.sh@10 -- # set +x 00:04:59.013 ************************************ 00:04:59.013 START TEST event_perf 00:04:59.013 ************************************ 00:04:59.013 03:05:33 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:59.013 Running I/O for 1 seconds...[2024-04-25 03:05:33.342460] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:04:59.013 [2024-04-25 03:05:33.342525] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3906900 ] 00:04:59.013 EAL: No free 2048 kB hugepages reported on node 1 00:04:59.013 [2024-04-25 03:05:33.407499] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:59.013 [2024-04-25 03:05:33.477204] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:59.013 [2024-04-25 03:05:33.477302] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:59.013 [2024-04-25 03:05:33.477378] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:59.013 [2024-04-25 03:05:33.477380] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:00.387 Running I/O for 1 seconds... 00:05:00.387 lcore 0: 203799 00:05:00.387 lcore 1: 203799 00:05:00.387 lcore 2: 203798 00:05:00.387 lcore 3: 203798 00:05:00.387 done. 00:05:00.387 00:05:00.387 real 0m1.244s 00:05:00.387 user 0m4.157s 00:05:00.387 sys 0m0.083s 00:05:00.387 03:05:34 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:00.387 03:05:34 -- common/autotest_common.sh@10 -- # set +x 00:05:00.387 ************************************ 00:05:00.387 END TEST event_perf 00:05:00.387 ************************************ 00:05:00.387 03:05:34 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:05:00.387 03:05:34 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:05:00.387 03:05:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:00.387 03:05:34 -- common/autotest_common.sh@10 -- # set +x 00:05:00.387 ************************************ 00:05:00.387 START TEST event_reactor 00:05:00.387 ************************************ 00:05:00.387 03:05:34 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:05:00.387 [2024-04-25 03:05:34.745287] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:00.387 [2024-04-25 03:05:34.745347] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3907168 ] 00:05:00.387 EAL: No free 2048 kB hugepages reported on node 1 00:05:00.387 [2024-04-25 03:05:34.809341] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:00.387 [2024-04-25 03:05:34.877395] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:01.759 test_start 00:05:01.759 oneshot 00:05:01.759 tick 100 00:05:01.759 tick 100 00:05:01.759 tick 250 00:05:01.759 tick 100 00:05:01.759 tick 100 00:05:01.759 tick 100 00:05:01.759 tick 250 00:05:01.759 tick 500 00:05:01.759 tick 100 00:05:01.759 tick 100 00:05:01.759 tick 250 00:05:01.759 tick 100 00:05:01.759 tick 100 00:05:01.759 test_end 00:05:01.759 00:05:01.759 real 0m1.236s 00:05:01.759 user 0m1.150s 00:05:01.759 sys 0m0.081s 00:05:01.759 03:05:35 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:01.759 03:05:35 -- common/autotest_common.sh@10 -- # set +x 00:05:01.759 ************************************ 00:05:01.759 END TEST event_reactor 00:05:01.759 ************************************ 00:05:01.759 03:05:35 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:05:01.759 03:05:35 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:05:01.759 03:05:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:01.759 03:05:35 -- common/autotest_common.sh@10 -- # set +x 00:05:01.759 ************************************ 00:05:01.759 START TEST event_reactor_perf 00:05:01.759 ************************************ 00:05:01.759 03:05:36 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:05:01.759 [2024-04-25 03:05:36.138143] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:01.759 [2024-04-25 03:05:36.138217] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3907419 ] 00:05:01.759 EAL: No free 2048 kB hugepages reported on node 1 00:05:01.759 [2024-04-25 03:05:36.200995] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:02.017 [2024-04-25 03:05:36.276154] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:02.956 test_start 00:05:02.956 test_end 00:05:02.956 Performance: 510361 events per second 00:05:02.956 00:05:02.956 real 0m1.239s 00:05:02.956 user 0m1.159s 00:05:02.956 sys 0m0.075s 00:05:02.956 03:05:37 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:02.956 03:05:37 -- common/autotest_common.sh@10 -- # set +x 00:05:02.956 ************************************ 00:05:02.956 END TEST event_reactor_perf 00:05:02.956 ************************************ 00:05:02.956 03:05:37 -- event/event.sh@49 -- # uname -s 00:05:02.956 03:05:37 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:05:02.956 03:05:37 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:05:02.956 03:05:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:02.956 03:05:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:02.956 03:05:37 -- common/autotest_common.sh@10 -- # set +x 00:05:03.214 ************************************ 00:05:03.214 START TEST event_scheduler 00:05:03.214 ************************************ 00:05:03.214 03:05:37 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:05:03.214 * Looking for test storage... 00:05:03.214 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/scheduler 00:05:03.214 03:05:37 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:05:03.214 03:05:37 -- scheduler/scheduler.sh@35 -- # scheduler_pid=3907698 00:05:03.214 03:05:37 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:05:03.215 03:05:37 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:05:03.215 03:05:37 -- scheduler/scheduler.sh@37 -- # waitforlisten 3907698 00:05:03.215 03:05:37 -- common/autotest_common.sh@817 -- # '[' -z 3907698 ']' 00:05:03.215 03:05:37 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:03.215 03:05:37 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:03.215 03:05:37 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:03.215 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:03.215 03:05:37 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:03.215 03:05:37 -- common/autotest_common.sh@10 -- # set +x 00:05:03.215 [2024-04-25 03:05:37.649889] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:03.215 [2024-04-25 03:05:37.649939] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3907698 ] 00:05:03.215 EAL: No free 2048 kB hugepages reported on node 1 00:05:03.215 [2024-04-25 03:05:37.705835] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:03.473 [2024-04-25 03:05:37.778752] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:03.473 [2024-04-25 03:05:37.778841] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:03.473 [2024-04-25 03:05:37.778927] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:03.473 [2024-04-25 03:05:37.778928] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:04.042 03:05:38 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:04.042 03:05:38 -- common/autotest_common.sh@850 -- # return 0 00:05:04.042 03:05:38 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:05:04.042 03:05:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:04.042 03:05:38 -- common/autotest_common.sh@10 -- # set +x 00:05:04.042 POWER: Env isn't set yet! 00:05:04.042 POWER: Attempting to initialise ACPI cpufreq power management... 00:05:04.042 POWER: Failed to write /sys/devices/system/cpu/cpu%u/cpufreq/scaling_governor 00:05:04.042 POWER: Cannot set governor of lcore 0 to userspace 00:05:04.042 POWER: Attempting to initialise PSTAT power management... 00:05:04.042 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:05:04.042 POWER: Initialized successfully for lcore 0 power management 00:05:04.042 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:05:04.042 POWER: Initialized successfully for lcore 1 power management 00:05:04.042 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:05:04.042 POWER: Initialized successfully for lcore 2 power management 00:05:04.042 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:05:04.042 POWER: Initialized successfully for lcore 3 power management 00:05:04.042 03:05:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:04.042 03:05:38 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:05:04.042 03:05:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:04.042 03:05:38 -- common/autotest_common.sh@10 -- # set +x 00:05:04.301 [2024-04-25 03:05:38.567806] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:05:04.301 03:05:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:04.301 03:05:38 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:05:04.301 03:05:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:04.301 03:05:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:04.301 03:05:38 -- common/autotest_common.sh@10 -- # set +x 00:05:04.301 ************************************ 00:05:04.301 START TEST scheduler_create_thread 00:05:04.301 ************************************ 00:05:04.301 03:05:38 -- common/autotest_common.sh@1111 -- # scheduler_create_thread 00:05:04.301 03:05:38 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:05:04.301 03:05:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:04.301 03:05:38 -- common/autotest_common.sh@10 -- # set +x 00:05:04.301 2 00:05:04.301 03:05:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:04.301 03:05:38 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:05:04.301 03:05:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:04.301 03:05:38 -- common/autotest_common.sh@10 -- # set +x 00:05:04.301 3 00:05:04.301 03:05:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:04.301 03:05:38 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:05:04.301 03:05:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:04.301 03:05:38 -- common/autotest_common.sh@10 -- # set +x 00:05:04.301 4 00:05:04.301 03:05:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:04.301 03:05:38 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:05:04.301 03:05:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:04.301 03:05:38 -- common/autotest_common.sh@10 -- # set +x 00:05:04.301 5 00:05:04.301 03:05:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:04.301 03:05:38 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:05:04.301 03:05:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:04.301 03:05:38 -- common/autotest_common.sh@10 -- # set +x 00:05:04.301 6 00:05:04.301 03:05:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:04.301 03:05:38 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:05:04.301 03:05:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:04.301 03:05:38 -- common/autotest_common.sh@10 -- # set +x 00:05:04.301 7 00:05:04.301 03:05:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:04.301 03:05:38 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:05:04.301 03:05:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:04.301 03:05:38 -- common/autotest_common.sh@10 -- # set +x 00:05:04.301 8 00:05:04.301 03:05:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:04.301 03:05:38 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:05:04.301 03:05:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:04.301 03:05:38 -- common/autotest_common.sh@10 -- # set +x 00:05:04.301 9 00:05:04.301 03:05:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:04.301 03:05:38 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:05:04.301 03:05:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:04.301 03:05:38 -- common/autotest_common.sh@10 -- # set +x 00:05:04.559 10 00:05:04.559 03:05:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:04.559 03:05:38 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:05:04.559 03:05:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:04.559 03:05:38 -- common/autotest_common.sh@10 -- # set +x 00:05:04.559 03:05:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:04.559 03:05:38 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:05:04.559 03:05:38 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:05:04.559 03:05:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:04.559 03:05:38 -- common/autotest_common.sh@10 -- # set +x 00:05:05.495 03:05:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:05.495 03:05:39 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:05:05.495 03:05:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:05.495 03:05:39 -- common/autotest_common.sh@10 -- # set +x 00:05:06.868 03:05:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:06.868 03:05:41 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:05:06.868 03:05:41 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:05:06.868 03:05:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:06.868 03:05:41 -- common/autotest_common.sh@10 -- # set +x 00:05:07.822 03:05:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:07.822 00:05:07.822 real 0m3.481s 00:05:07.822 user 0m0.025s 00:05:07.822 sys 0m0.003s 00:05:07.822 03:05:42 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:07.822 03:05:42 -- common/autotest_common.sh@10 -- # set +x 00:05:07.822 ************************************ 00:05:07.822 END TEST scheduler_create_thread 00:05:07.822 ************************************ 00:05:07.822 03:05:42 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:05:07.822 03:05:42 -- scheduler/scheduler.sh@46 -- # killprocess 3907698 00:05:07.822 03:05:42 -- common/autotest_common.sh@936 -- # '[' -z 3907698 ']' 00:05:07.822 03:05:42 -- common/autotest_common.sh@940 -- # kill -0 3907698 00:05:07.822 03:05:42 -- common/autotest_common.sh@941 -- # uname 00:05:07.822 03:05:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:07.822 03:05:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3907698 00:05:07.822 03:05:42 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:05:07.822 03:05:42 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:05:07.822 03:05:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3907698' 00:05:07.822 killing process with pid 3907698 00:05:07.822 03:05:42 -- common/autotest_common.sh@955 -- # kill 3907698 00:05:07.822 03:05:42 -- common/autotest_common.sh@960 -- # wait 3907698 00:05:08.406 [2024-04-25 03:05:42.669000] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:05:08.406 POWER: Power management governor of lcore 0 has been set to 'powersave' successfully 00:05:08.406 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:05:08.406 POWER: Power management governor of lcore 1 has been set to 'powersave' successfully 00:05:08.406 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:05:08.406 POWER: Power management governor of lcore 2 has been set to 'powersave' successfully 00:05:08.406 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:05:08.406 POWER: Power management governor of lcore 3 has been set to 'powersave' successfully 00:05:08.406 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:05:08.406 00:05:08.406 real 0m5.346s 00:05:08.406 user 0m8.818s 00:05:08.406 sys 0m0.417s 00:05:08.406 03:05:42 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:08.406 03:05:42 -- common/autotest_common.sh@10 -- # set +x 00:05:08.406 ************************************ 00:05:08.406 END TEST event_scheduler 00:05:08.406 ************************************ 00:05:08.406 03:05:42 -- event/event.sh@51 -- # modprobe -n nbd 00:05:08.670 03:05:42 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:05:08.670 03:05:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:08.670 03:05:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:08.670 03:05:42 -- common/autotest_common.sh@10 -- # set +x 00:05:08.670 ************************************ 00:05:08.670 START TEST app_repeat 00:05:08.670 ************************************ 00:05:08.670 03:05:43 -- common/autotest_common.sh@1111 -- # app_repeat_test 00:05:08.670 03:05:43 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:08.670 03:05:43 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:08.670 03:05:43 -- event/event.sh@13 -- # local nbd_list 00:05:08.670 03:05:43 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:08.670 03:05:43 -- event/event.sh@14 -- # local bdev_list 00:05:08.670 03:05:43 -- event/event.sh@15 -- # local repeat_times=4 00:05:08.670 03:05:43 -- event/event.sh@17 -- # modprobe nbd 00:05:08.670 03:05:43 -- event/event.sh@19 -- # repeat_pid=3908672 00:05:08.670 03:05:43 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:05:08.670 03:05:43 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:05:08.670 03:05:43 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 3908672' 00:05:08.670 Process app_repeat pid: 3908672 00:05:08.670 03:05:43 -- event/event.sh@23 -- # for i in {0..2} 00:05:08.670 03:05:43 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:05:08.670 spdk_app_start Round 0 00:05:08.670 03:05:43 -- event/event.sh@25 -- # waitforlisten 3908672 /var/tmp/spdk-nbd.sock 00:05:08.670 03:05:43 -- common/autotest_common.sh@817 -- # '[' -z 3908672 ']' 00:05:08.670 03:05:43 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:08.670 03:05:43 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:08.670 03:05:43 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:08.670 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:08.670 03:05:43 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:08.670 03:05:43 -- common/autotest_common.sh@10 -- # set +x 00:05:08.670 [2024-04-25 03:05:43.086140] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:08.670 [2024-04-25 03:05:43.086195] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3908672 ] 00:05:08.670 EAL: No free 2048 kB hugepages reported on node 1 00:05:08.670 [2024-04-25 03:05:43.149892] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:08.933 [2024-04-25 03:05:43.229361] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:08.933 [2024-04-25 03:05:43.229364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:09.499 03:05:43 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:09.499 03:05:43 -- common/autotest_common.sh@850 -- # return 0 00:05:09.499 03:05:43 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:09.757 Malloc0 00:05:09.757 03:05:44 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:09.757 Malloc1 00:05:09.757 03:05:44 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:09.757 03:05:44 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:09.757 03:05:44 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:09.757 03:05:44 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:09.757 03:05:44 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:09.757 03:05:44 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:09.757 03:05:44 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:09.757 03:05:44 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:09.757 03:05:44 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:09.757 03:05:44 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:09.757 03:05:44 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:09.757 03:05:44 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:09.757 03:05:44 -- bdev/nbd_common.sh@12 -- # local i 00:05:09.757 03:05:44 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:09.757 03:05:44 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:09.757 03:05:44 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:10.016 /dev/nbd0 00:05:10.016 03:05:44 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:10.016 03:05:44 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:10.016 03:05:44 -- common/autotest_common.sh@854 -- # local nbd_name=nbd0 00:05:10.016 03:05:44 -- common/autotest_common.sh@855 -- # local i 00:05:10.016 03:05:44 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:05:10.016 03:05:44 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:05:10.016 03:05:44 -- common/autotest_common.sh@858 -- # grep -q -w nbd0 /proc/partitions 00:05:10.016 03:05:44 -- common/autotest_common.sh@859 -- # break 00:05:10.016 03:05:44 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:05:10.016 03:05:44 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:05:10.016 03:05:44 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:10.016 1+0 records in 00:05:10.016 1+0 records out 00:05:10.016 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000213686 s, 19.2 MB/s 00:05:10.016 03:05:44 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest 00:05:10.016 03:05:44 -- common/autotest_common.sh@872 -- # size=4096 00:05:10.016 03:05:44 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest 00:05:10.016 03:05:44 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:05:10.016 03:05:44 -- common/autotest_common.sh@875 -- # return 0 00:05:10.016 03:05:44 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:10.016 03:05:44 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:10.016 03:05:44 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:10.275 /dev/nbd1 00:05:10.275 03:05:44 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:10.275 03:05:44 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:10.275 03:05:44 -- common/autotest_common.sh@854 -- # local nbd_name=nbd1 00:05:10.275 03:05:44 -- common/autotest_common.sh@855 -- # local i 00:05:10.275 03:05:44 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:05:10.275 03:05:44 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:05:10.275 03:05:44 -- common/autotest_common.sh@858 -- # grep -q -w nbd1 /proc/partitions 00:05:10.275 03:05:44 -- common/autotest_common.sh@859 -- # break 00:05:10.275 03:05:44 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:05:10.275 03:05:44 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:05:10.275 03:05:44 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:10.275 1+0 records in 00:05:10.275 1+0 records out 00:05:10.275 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000229263 s, 17.9 MB/s 00:05:10.275 03:05:44 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest 00:05:10.275 03:05:44 -- common/autotest_common.sh@872 -- # size=4096 00:05:10.275 03:05:44 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest 00:05:10.275 03:05:44 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:05:10.275 03:05:44 -- common/autotest_common.sh@875 -- # return 0 00:05:10.275 03:05:44 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:10.275 03:05:44 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:10.275 03:05:44 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:10.275 03:05:44 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:10.275 03:05:44 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:10.534 { 00:05:10.534 "nbd_device": "/dev/nbd0", 00:05:10.534 "bdev_name": "Malloc0" 00:05:10.534 }, 00:05:10.534 { 00:05:10.534 "nbd_device": "/dev/nbd1", 00:05:10.534 "bdev_name": "Malloc1" 00:05:10.534 } 00:05:10.534 ]' 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:10.534 { 00:05:10.534 "nbd_device": "/dev/nbd0", 00:05:10.534 "bdev_name": "Malloc0" 00:05:10.534 }, 00:05:10.534 { 00:05:10.534 "nbd_device": "/dev/nbd1", 00:05:10.534 "bdev_name": "Malloc1" 00:05:10.534 } 00:05:10.534 ]' 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:10.534 /dev/nbd1' 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:10.534 /dev/nbd1' 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@65 -- # count=2 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@95 -- # count=2 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:10.534 256+0 records in 00:05:10.534 256+0 records out 00:05:10.534 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103446 s, 101 MB/s 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:10.534 256+0 records in 00:05:10.534 256+0 records out 00:05:10.534 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134867 s, 77.7 MB/s 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:10.534 256+0 records in 00:05:10.534 256+0 records out 00:05:10.534 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145686 s, 72.0 MB/s 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@51 -- # local i 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:10.534 03:05:44 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:10.793 03:05:45 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:10.793 03:05:45 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:10.793 03:05:45 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:10.793 03:05:45 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:10.793 03:05:45 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:10.793 03:05:45 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:10.793 03:05:45 -- bdev/nbd_common.sh@41 -- # break 00:05:10.793 03:05:45 -- bdev/nbd_common.sh@45 -- # return 0 00:05:10.793 03:05:45 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:10.793 03:05:45 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:11.051 03:05:45 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:11.051 03:05:45 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:11.051 03:05:45 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:11.051 03:05:45 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:11.051 03:05:45 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:11.051 03:05:45 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:11.051 03:05:45 -- bdev/nbd_common.sh@41 -- # break 00:05:11.051 03:05:45 -- bdev/nbd_common.sh@45 -- # return 0 00:05:11.051 03:05:45 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:11.051 03:05:45 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:11.051 03:05:45 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:11.051 03:05:45 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:11.051 03:05:45 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:11.052 03:05:45 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:11.052 03:05:45 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:11.052 03:05:45 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:11.052 03:05:45 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:11.052 03:05:45 -- bdev/nbd_common.sh@65 -- # true 00:05:11.052 03:05:45 -- bdev/nbd_common.sh@65 -- # count=0 00:05:11.052 03:05:45 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:11.052 03:05:45 -- bdev/nbd_common.sh@104 -- # count=0 00:05:11.052 03:05:45 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:11.052 03:05:45 -- bdev/nbd_common.sh@109 -- # return 0 00:05:11.052 03:05:45 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:11.310 03:05:45 -- event/event.sh@35 -- # sleep 3 00:05:11.569 [2024-04-25 03:05:45.934144] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:11.569 [2024-04-25 03:05:45.998595] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:11.569 [2024-04-25 03:05:45.998597] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:11.569 [2024-04-25 03:05:46.039616] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:11.569 [2024-04-25 03:05:46.039661] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:14.856 03:05:48 -- event/event.sh@23 -- # for i in {0..2} 00:05:14.856 03:05:48 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:05:14.856 spdk_app_start Round 1 00:05:14.856 03:05:48 -- event/event.sh@25 -- # waitforlisten 3908672 /var/tmp/spdk-nbd.sock 00:05:14.856 03:05:48 -- common/autotest_common.sh@817 -- # '[' -z 3908672 ']' 00:05:14.856 03:05:48 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:14.856 03:05:48 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:14.856 03:05:48 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:14.856 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:14.856 03:05:48 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:14.856 03:05:48 -- common/autotest_common.sh@10 -- # set +x 00:05:14.856 03:05:48 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:14.856 03:05:48 -- common/autotest_common.sh@850 -- # return 0 00:05:14.856 03:05:48 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:14.856 Malloc0 00:05:14.856 03:05:49 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:14.856 Malloc1 00:05:14.856 03:05:49 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:14.856 03:05:49 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:14.856 03:05:49 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:14.856 03:05:49 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:14.856 03:05:49 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:14.856 03:05:49 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:14.856 03:05:49 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:14.856 03:05:49 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:14.856 03:05:49 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:14.856 03:05:49 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:14.856 03:05:49 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:14.856 03:05:49 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:14.856 03:05:49 -- bdev/nbd_common.sh@12 -- # local i 00:05:14.856 03:05:49 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:14.856 03:05:49 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:14.856 03:05:49 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:15.115 /dev/nbd0 00:05:15.115 03:05:49 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:15.115 03:05:49 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:15.115 03:05:49 -- common/autotest_common.sh@854 -- # local nbd_name=nbd0 00:05:15.115 03:05:49 -- common/autotest_common.sh@855 -- # local i 00:05:15.115 03:05:49 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:05:15.115 03:05:49 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:05:15.115 03:05:49 -- common/autotest_common.sh@858 -- # grep -q -w nbd0 /proc/partitions 00:05:15.115 03:05:49 -- common/autotest_common.sh@859 -- # break 00:05:15.115 03:05:49 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:05:15.115 03:05:49 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:05:15.115 03:05:49 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:15.115 1+0 records in 00:05:15.115 1+0 records out 00:05:15.115 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000229056 s, 17.9 MB/s 00:05:15.115 03:05:49 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest 00:05:15.115 03:05:49 -- common/autotest_common.sh@872 -- # size=4096 00:05:15.115 03:05:49 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest 00:05:15.115 03:05:49 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:05:15.115 03:05:49 -- common/autotest_common.sh@875 -- # return 0 00:05:15.115 03:05:49 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:15.115 03:05:49 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:15.115 03:05:49 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:15.115 /dev/nbd1 00:05:15.374 03:05:49 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:15.374 03:05:49 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:15.374 03:05:49 -- common/autotest_common.sh@854 -- # local nbd_name=nbd1 00:05:15.374 03:05:49 -- common/autotest_common.sh@855 -- # local i 00:05:15.374 03:05:49 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:05:15.374 03:05:49 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:05:15.374 03:05:49 -- common/autotest_common.sh@858 -- # grep -q -w nbd1 /proc/partitions 00:05:15.374 03:05:49 -- common/autotest_common.sh@859 -- # break 00:05:15.374 03:05:49 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:05:15.374 03:05:49 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:05:15.374 03:05:49 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:15.374 1+0 records in 00:05:15.374 1+0 records out 00:05:15.374 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000218177 s, 18.8 MB/s 00:05:15.374 03:05:49 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest 00:05:15.374 03:05:49 -- common/autotest_common.sh@872 -- # size=4096 00:05:15.374 03:05:49 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest 00:05:15.374 03:05:49 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:05:15.374 03:05:49 -- common/autotest_common.sh@875 -- # return 0 00:05:15.374 03:05:49 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:15.374 03:05:49 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:15.374 03:05:49 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:15.374 03:05:49 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:15.374 03:05:49 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:15.374 03:05:49 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:15.374 { 00:05:15.374 "nbd_device": "/dev/nbd0", 00:05:15.374 "bdev_name": "Malloc0" 00:05:15.374 }, 00:05:15.374 { 00:05:15.374 "nbd_device": "/dev/nbd1", 00:05:15.374 "bdev_name": "Malloc1" 00:05:15.374 } 00:05:15.374 ]' 00:05:15.374 03:05:49 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:15.374 { 00:05:15.374 "nbd_device": "/dev/nbd0", 00:05:15.374 "bdev_name": "Malloc0" 00:05:15.374 }, 00:05:15.374 { 00:05:15.374 "nbd_device": "/dev/nbd1", 00:05:15.374 "bdev_name": "Malloc1" 00:05:15.374 } 00:05:15.374 ]' 00:05:15.374 03:05:49 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:15.374 03:05:49 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:15.374 /dev/nbd1' 00:05:15.374 03:05:49 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:15.374 /dev/nbd1' 00:05:15.374 03:05:49 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:15.374 03:05:49 -- bdev/nbd_common.sh@65 -- # count=2 00:05:15.374 03:05:49 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:15.374 03:05:49 -- bdev/nbd_common.sh@95 -- # count=2 00:05:15.374 03:05:49 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:15.374 03:05:49 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:15.374 03:05:49 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:15.374 03:05:49 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:15.374 03:05:49 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:15.633 03:05:49 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest 00:05:15.633 03:05:49 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:15.633 03:05:49 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:15.633 256+0 records in 00:05:15.633 256+0 records out 00:05:15.633 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646152 s, 162 MB/s 00:05:15.633 03:05:49 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:15.633 03:05:49 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:15.633 256+0 records in 00:05:15.633 256+0 records out 00:05:15.633 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136252 s, 77.0 MB/s 00:05:15.633 03:05:49 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:15.633 03:05:49 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:15.633 256+0 records in 00:05:15.633 256+0 records out 00:05:15.633 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143635 s, 73.0 MB/s 00:05:15.633 03:05:49 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:15.633 03:05:49 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:15.633 03:05:49 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:15.633 03:05:49 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:15.633 03:05:49 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest 00:05:15.633 03:05:49 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:15.633 03:05:49 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:15.633 03:05:49 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:15.633 03:05:49 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:15.633 03:05:49 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:15.633 03:05:49 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:15.633 03:05:49 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest 00:05:15.633 03:05:49 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:15.633 03:05:49 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:15.633 03:05:49 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:15.633 03:05:49 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:15.633 03:05:49 -- bdev/nbd_common.sh@51 -- # local i 00:05:15.633 03:05:49 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:15.633 03:05:49 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:15.633 03:05:50 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:15.633 03:05:50 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:15.633 03:05:50 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:15.633 03:05:50 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:15.633 03:05:50 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:15.633 03:05:50 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:15.633 03:05:50 -- bdev/nbd_common.sh@41 -- # break 00:05:15.633 03:05:50 -- bdev/nbd_common.sh@45 -- # return 0 00:05:15.633 03:05:50 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:15.633 03:05:50 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:15.891 03:05:50 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:15.892 03:05:50 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:15.892 03:05:50 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:15.892 03:05:50 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:15.892 03:05:50 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:15.892 03:05:50 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:15.892 03:05:50 -- bdev/nbd_common.sh@41 -- # break 00:05:15.892 03:05:50 -- bdev/nbd_common.sh@45 -- # return 0 00:05:15.892 03:05:50 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:15.892 03:05:50 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:15.892 03:05:50 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:16.150 03:05:50 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:16.150 03:05:50 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:16.150 03:05:50 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:16.150 03:05:50 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:16.150 03:05:50 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:16.150 03:05:50 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:16.150 03:05:50 -- bdev/nbd_common.sh@65 -- # true 00:05:16.150 03:05:50 -- bdev/nbd_common.sh@65 -- # count=0 00:05:16.150 03:05:50 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:16.150 03:05:50 -- bdev/nbd_common.sh@104 -- # count=0 00:05:16.150 03:05:50 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:16.150 03:05:50 -- bdev/nbd_common.sh@109 -- # return 0 00:05:16.150 03:05:50 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:16.409 03:05:50 -- event/event.sh@35 -- # sleep 3 00:05:16.667 [2024-04-25 03:05:50.930388] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:16.667 [2024-04-25 03:05:50.995139] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:16.667 [2024-04-25 03:05:50.995141] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:16.667 [2024-04-25 03:05:51.037123] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:16.668 [2024-04-25 03:05:51.037164] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:19.949 03:05:53 -- event/event.sh@23 -- # for i in {0..2} 00:05:19.949 03:05:53 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:05:19.949 spdk_app_start Round 2 00:05:19.949 03:05:53 -- event/event.sh@25 -- # waitforlisten 3908672 /var/tmp/spdk-nbd.sock 00:05:19.949 03:05:53 -- common/autotest_common.sh@817 -- # '[' -z 3908672 ']' 00:05:19.949 03:05:53 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:19.949 03:05:53 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:19.949 03:05:53 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:19.949 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:19.949 03:05:53 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:19.949 03:05:53 -- common/autotest_common.sh@10 -- # set +x 00:05:19.949 03:05:53 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:19.949 03:05:53 -- common/autotest_common.sh@850 -- # return 0 00:05:19.949 03:05:53 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:19.949 Malloc0 00:05:19.949 03:05:54 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:19.949 Malloc1 00:05:19.949 03:05:54 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:19.949 03:05:54 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:19.949 03:05:54 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:19.949 03:05:54 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:19.949 03:05:54 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:19.949 03:05:54 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:19.949 03:05:54 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:19.949 03:05:54 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:19.949 03:05:54 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:19.949 03:05:54 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:19.949 03:05:54 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:19.949 03:05:54 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:19.949 03:05:54 -- bdev/nbd_common.sh@12 -- # local i 00:05:19.949 03:05:54 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:19.949 03:05:54 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:19.949 03:05:54 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:19.949 /dev/nbd0 00:05:19.949 03:05:54 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:19.949 03:05:54 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:19.949 03:05:54 -- common/autotest_common.sh@854 -- # local nbd_name=nbd0 00:05:19.949 03:05:54 -- common/autotest_common.sh@855 -- # local i 00:05:19.949 03:05:54 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:05:19.949 03:05:54 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:05:19.949 03:05:54 -- common/autotest_common.sh@858 -- # grep -q -w nbd0 /proc/partitions 00:05:19.949 03:05:54 -- common/autotest_common.sh@859 -- # break 00:05:19.949 03:05:54 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:05:19.949 03:05:54 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:05:19.949 03:05:54 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:19.949 1+0 records in 00:05:19.949 1+0 records out 00:05:19.949 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000209741 s, 19.5 MB/s 00:05:19.949 03:05:54 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest 00:05:19.949 03:05:54 -- common/autotest_common.sh@872 -- # size=4096 00:05:19.949 03:05:54 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest 00:05:19.949 03:05:54 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:05:19.949 03:05:54 -- common/autotest_common.sh@875 -- # return 0 00:05:19.949 03:05:54 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:19.949 03:05:54 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:19.949 03:05:54 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:20.206 /dev/nbd1 00:05:20.206 03:05:54 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:20.206 03:05:54 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:20.206 03:05:54 -- common/autotest_common.sh@854 -- # local nbd_name=nbd1 00:05:20.206 03:05:54 -- common/autotest_common.sh@855 -- # local i 00:05:20.206 03:05:54 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:05:20.206 03:05:54 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:05:20.206 03:05:54 -- common/autotest_common.sh@858 -- # grep -q -w nbd1 /proc/partitions 00:05:20.206 03:05:54 -- common/autotest_common.sh@859 -- # break 00:05:20.206 03:05:54 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:05:20.206 03:05:54 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:05:20.206 03:05:54 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:20.206 1+0 records in 00:05:20.206 1+0 records out 00:05:20.206 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000240243 s, 17.0 MB/s 00:05:20.206 03:05:54 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest 00:05:20.206 03:05:54 -- common/autotest_common.sh@872 -- # size=4096 00:05:20.206 03:05:54 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest 00:05:20.206 03:05:54 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:05:20.206 03:05:54 -- common/autotest_common.sh@875 -- # return 0 00:05:20.206 03:05:54 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:20.206 03:05:54 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:20.206 03:05:54 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:20.206 03:05:54 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:20.206 03:05:54 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:20.463 03:05:54 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:20.463 { 00:05:20.463 "nbd_device": "/dev/nbd0", 00:05:20.463 "bdev_name": "Malloc0" 00:05:20.463 }, 00:05:20.463 { 00:05:20.463 "nbd_device": "/dev/nbd1", 00:05:20.463 "bdev_name": "Malloc1" 00:05:20.464 } 00:05:20.464 ]' 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:20.464 { 00:05:20.464 "nbd_device": "/dev/nbd0", 00:05:20.464 "bdev_name": "Malloc0" 00:05:20.464 }, 00:05:20.464 { 00:05:20.464 "nbd_device": "/dev/nbd1", 00:05:20.464 "bdev_name": "Malloc1" 00:05:20.464 } 00:05:20.464 ]' 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:20.464 /dev/nbd1' 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:20.464 /dev/nbd1' 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@65 -- # count=2 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@95 -- # count=2 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:20.464 256+0 records in 00:05:20.464 256+0 records out 00:05:20.464 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960453 s, 109 MB/s 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:20.464 256+0 records in 00:05:20.464 256+0 records out 00:05:20.464 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133452 s, 78.6 MB/s 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:20.464 256+0 records in 00:05:20.464 256+0 records out 00:05:20.464 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151538 s, 69.2 MB/s 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@51 -- # local i 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:20.464 03:05:54 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:20.721 03:05:55 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:20.721 03:05:55 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:20.721 03:05:55 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:20.721 03:05:55 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:20.721 03:05:55 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:20.721 03:05:55 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:20.721 03:05:55 -- bdev/nbd_common.sh@41 -- # break 00:05:20.721 03:05:55 -- bdev/nbd_common.sh@45 -- # return 0 00:05:20.721 03:05:55 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:20.721 03:05:55 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:20.979 03:05:55 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:20.979 03:05:55 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:20.979 03:05:55 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:20.979 03:05:55 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:20.979 03:05:55 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:20.979 03:05:55 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:20.979 03:05:55 -- bdev/nbd_common.sh@41 -- # break 00:05:20.979 03:05:55 -- bdev/nbd_common.sh@45 -- # return 0 00:05:20.979 03:05:55 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:20.979 03:05:55 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:20.979 03:05:55 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:21.237 03:05:55 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:21.237 03:05:55 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:21.237 03:05:55 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:21.237 03:05:55 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:21.237 03:05:55 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:21.237 03:05:55 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:21.237 03:05:55 -- bdev/nbd_common.sh@65 -- # true 00:05:21.237 03:05:55 -- bdev/nbd_common.sh@65 -- # count=0 00:05:21.237 03:05:55 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:21.237 03:05:55 -- bdev/nbd_common.sh@104 -- # count=0 00:05:21.237 03:05:55 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:21.237 03:05:55 -- bdev/nbd_common.sh@109 -- # return 0 00:05:21.237 03:05:55 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:21.237 03:05:55 -- event/event.sh@35 -- # sleep 3 00:05:21.495 [2024-04-25 03:05:55.946207] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:21.754 [2024-04-25 03:05:56.018466] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:21.754 [2024-04-25 03:05:56.018467] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:21.754 [2024-04-25 03:05:56.059624] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:21.754 [2024-04-25 03:05:56.059666] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:24.285 03:05:58 -- event/event.sh@38 -- # waitforlisten 3908672 /var/tmp/spdk-nbd.sock 00:05:24.285 03:05:58 -- common/autotest_common.sh@817 -- # '[' -z 3908672 ']' 00:05:24.286 03:05:58 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:24.286 03:05:58 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:24.286 03:05:58 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:24.286 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:24.286 03:05:58 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:24.286 03:05:58 -- common/autotest_common.sh@10 -- # set +x 00:05:24.544 03:05:58 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:24.544 03:05:58 -- common/autotest_common.sh@850 -- # return 0 00:05:24.544 03:05:58 -- event/event.sh@39 -- # killprocess 3908672 00:05:24.544 03:05:58 -- common/autotest_common.sh@936 -- # '[' -z 3908672 ']' 00:05:24.544 03:05:58 -- common/autotest_common.sh@940 -- # kill -0 3908672 00:05:24.544 03:05:58 -- common/autotest_common.sh@941 -- # uname 00:05:24.544 03:05:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:24.544 03:05:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3908672 00:05:24.544 03:05:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:24.544 03:05:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:24.544 03:05:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3908672' 00:05:24.544 killing process with pid 3908672 00:05:24.544 03:05:58 -- common/autotest_common.sh@955 -- # kill 3908672 00:05:24.544 03:05:58 -- common/autotest_common.sh@960 -- # wait 3908672 00:05:24.803 spdk_app_start is called in Round 0. 00:05:24.803 Shutdown signal received, stop current app iteration 00:05:24.803 Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 reinitialization... 00:05:24.803 spdk_app_start is called in Round 1. 00:05:24.803 Shutdown signal received, stop current app iteration 00:05:24.803 Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 reinitialization... 00:05:24.803 spdk_app_start is called in Round 2. 00:05:24.803 Shutdown signal received, stop current app iteration 00:05:24.803 Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 reinitialization... 00:05:24.803 spdk_app_start is called in Round 3. 00:05:24.803 Shutdown signal received, stop current app iteration 00:05:24.803 03:05:59 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:05:24.803 03:05:59 -- event/event.sh@42 -- # return 0 00:05:24.803 00:05:24.803 real 0m16.078s 00:05:24.803 user 0m34.534s 00:05:24.803 sys 0m2.399s 00:05:24.803 03:05:59 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:24.803 03:05:59 -- common/autotest_common.sh@10 -- # set +x 00:05:24.803 ************************************ 00:05:24.803 END TEST app_repeat 00:05:24.803 ************************************ 00:05:24.803 03:05:59 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:05:24.803 03:05:59 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:24.803 03:05:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:24.803 03:05:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:24.803 03:05:59 -- common/autotest_common.sh@10 -- # set +x 00:05:24.803 ************************************ 00:05:24.803 START TEST cpu_locks 00:05:24.803 ************************************ 00:05:24.803 03:05:59 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:25.062 * Looking for test storage... 00:05:25.062 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event 00:05:25.062 03:05:59 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:05:25.062 03:05:59 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:05:25.062 03:05:59 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:05:25.062 03:05:59 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:05:25.062 03:05:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:25.062 03:05:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:25.062 03:05:59 -- common/autotest_common.sh@10 -- # set +x 00:05:25.062 ************************************ 00:05:25.062 START TEST default_locks 00:05:25.062 ************************************ 00:05:25.062 03:05:59 -- common/autotest_common.sh@1111 -- # default_locks 00:05:25.062 03:05:59 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=3911640 00:05:25.062 03:05:59 -- event/cpu_locks.sh@47 -- # waitforlisten 3911640 00:05:25.062 03:05:59 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:25.062 03:05:59 -- common/autotest_common.sh@817 -- # '[' -z 3911640 ']' 00:05:25.062 03:05:59 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:25.062 03:05:59 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:25.062 03:05:59 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:25.062 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:25.062 03:05:59 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:25.062 03:05:59 -- common/autotest_common.sh@10 -- # set +x 00:05:25.062 [2024-04-25 03:05:59.540127] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:25.062 [2024-04-25 03:05:59.540165] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3911640 ] 00:05:25.320 EAL: No free 2048 kB hugepages reported on node 1 00:05:25.320 [2024-04-25 03:05:59.598950] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:25.320 [2024-04-25 03:05:59.674865] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:25.886 03:06:00 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:25.886 03:06:00 -- common/autotest_common.sh@850 -- # return 0 00:05:25.886 03:06:00 -- event/cpu_locks.sh@49 -- # locks_exist 3911640 00:05:25.886 03:06:00 -- event/cpu_locks.sh@22 -- # lslocks -p 3911640 00:05:25.886 03:06:00 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:26.144 lslocks: write error 00:05:26.144 03:06:00 -- event/cpu_locks.sh@50 -- # killprocess 3911640 00:05:26.144 03:06:00 -- common/autotest_common.sh@936 -- # '[' -z 3911640 ']' 00:05:26.144 03:06:00 -- common/autotest_common.sh@940 -- # kill -0 3911640 00:05:26.144 03:06:00 -- common/autotest_common.sh@941 -- # uname 00:05:26.144 03:06:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:26.144 03:06:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3911640 00:05:26.144 03:06:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:26.144 03:06:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:26.144 03:06:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3911640' 00:05:26.144 killing process with pid 3911640 00:05:26.144 03:06:00 -- common/autotest_common.sh@955 -- # kill 3911640 00:05:26.144 03:06:00 -- common/autotest_common.sh@960 -- # wait 3911640 00:05:26.710 03:06:00 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 3911640 00:05:26.711 03:06:00 -- common/autotest_common.sh@638 -- # local es=0 00:05:26.711 03:06:00 -- common/autotest_common.sh@640 -- # valid_exec_arg waitforlisten 3911640 00:05:26.711 03:06:00 -- common/autotest_common.sh@626 -- # local arg=waitforlisten 00:05:26.711 03:06:00 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:26.711 03:06:00 -- common/autotest_common.sh@630 -- # type -t waitforlisten 00:05:26.711 03:06:00 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:26.711 03:06:00 -- common/autotest_common.sh@641 -- # waitforlisten 3911640 00:05:26.711 03:06:00 -- common/autotest_common.sh@817 -- # '[' -z 3911640 ']' 00:05:26.711 03:06:00 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:26.711 03:06:00 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:26.711 03:06:00 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:26.711 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:26.711 03:06:00 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:26.711 03:06:00 -- common/autotest_common.sh@10 -- # set +x 00:05:26.711 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/autotest_common.sh: line 832: kill: (3911640) - No such process 00:05:26.711 ERROR: process (pid: 3911640) is no longer running 00:05:26.711 03:06:00 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:26.711 03:06:00 -- common/autotest_common.sh@850 -- # return 1 00:05:26.711 03:06:00 -- common/autotest_common.sh@641 -- # es=1 00:05:26.711 03:06:00 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:26.711 03:06:00 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:05:26.711 03:06:00 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:26.711 03:06:00 -- event/cpu_locks.sh@54 -- # no_locks 00:05:26.711 03:06:00 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:26.711 03:06:00 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:26.711 03:06:00 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:26.711 00:05:26.711 real 0m1.459s 00:05:26.711 user 0m1.518s 00:05:26.711 sys 0m0.461s 00:05:26.711 03:06:00 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:26.711 03:06:00 -- common/autotest_common.sh@10 -- # set +x 00:05:26.711 ************************************ 00:05:26.711 END TEST default_locks 00:05:26.711 ************************************ 00:05:26.711 03:06:00 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:05:26.711 03:06:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:26.711 03:06:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:26.711 03:06:00 -- common/autotest_common.sh@10 -- # set +x 00:05:26.711 ************************************ 00:05:26.711 START TEST default_locks_via_rpc 00:05:26.711 ************************************ 00:05:26.711 03:06:01 -- common/autotest_common.sh@1111 -- # default_locks_via_rpc 00:05:26.711 03:06:01 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:26.711 03:06:01 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=3911986 00:05:26.711 03:06:01 -- event/cpu_locks.sh@63 -- # waitforlisten 3911986 00:05:26.711 03:06:01 -- common/autotest_common.sh@817 -- # '[' -z 3911986 ']' 00:05:26.711 03:06:01 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:26.711 03:06:01 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:26.711 03:06:01 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:26.711 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:26.711 03:06:01 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:26.711 03:06:01 -- common/autotest_common.sh@10 -- # set +x 00:05:26.711 [2024-04-25 03:06:01.128581] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:26.711 [2024-04-25 03:06:01.128616] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3911986 ] 00:05:26.711 EAL: No free 2048 kB hugepages reported on node 1 00:05:26.711 [2024-04-25 03:06:01.186590] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:26.969 [2024-04-25 03:06:01.264124] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.535 03:06:01 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:27.535 03:06:01 -- common/autotest_common.sh@850 -- # return 0 00:05:27.535 03:06:01 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:05:27.535 03:06:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:27.535 03:06:01 -- common/autotest_common.sh@10 -- # set +x 00:05:27.535 03:06:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:27.535 03:06:01 -- event/cpu_locks.sh@67 -- # no_locks 00:05:27.535 03:06:01 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:27.535 03:06:01 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:27.535 03:06:01 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:27.535 03:06:01 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:05:27.535 03:06:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:27.535 03:06:01 -- common/autotest_common.sh@10 -- # set +x 00:05:27.535 03:06:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:27.535 03:06:01 -- event/cpu_locks.sh@71 -- # locks_exist 3911986 00:05:27.535 03:06:01 -- event/cpu_locks.sh@22 -- # lslocks -p 3911986 00:05:27.535 03:06:01 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:28.115 03:06:02 -- event/cpu_locks.sh@73 -- # killprocess 3911986 00:05:28.115 03:06:02 -- common/autotest_common.sh@936 -- # '[' -z 3911986 ']' 00:05:28.116 03:06:02 -- common/autotest_common.sh@940 -- # kill -0 3911986 00:05:28.116 03:06:02 -- common/autotest_common.sh@941 -- # uname 00:05:28.116 03:06:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:28.116 03:06:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3911986 00:05:28.116 03:06:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:28.116 03:06:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:28.116 03:06:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3911986' 00:05:28.116 killing process with pid 3911986 00:05:28.116 03:06:02 -- common/autotest_common.sh@955 -- # kill 3911986 00:05:28.116 03:06:02 -- common/autotest_common.sh@960 -- # wait 3911986 00:05:28.386 00:05:28.386 real 0m1.767s 00:05:28.386 user 0m1.852s 00:05:28.386 sys 0m0.561s 00:05:28.386 03:06:02 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:28.386 03:06:02 -- common/autotest_common.sh@10 -- # set +x 00:05:28.386 ************************************ 00:05:28.386 END TEST default_locks_via_rpc 00:05:28.386 ************************************ 00:05:28.647 03:06:02 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:05:28.647 03:06:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:28.647 03:06:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:28.647 03:06:02 -- common/autotest_common.sh@10 -- # set +x 00:05:28.647 ************************************ 00:05:28.647 START TEST non_locking_app_on_locked_coremask 00:05:28.647 ************************************ 00:05:28.647 03:06:03 -- common/autotest_common.sh@1111 -- # non_locking_app_on_locked_coremask 00:05:28.647 03:06:03 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=3912512 00:05:28.647 03:06:03 -- event/cpu_locks.sh@81 -- # waitforlisten 3912512 /var/tmp/spdk.sock 00:05:28.647 03:06:03 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:28.647 03:06:03 -- common/autotest_common.sh@817 -- # '[' -z 3912512 ']' 00:05:28.647 03:06:03 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:28.647 03:06:03 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:28.647 03:06:03 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:28.647 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:28.647 03:06:03 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:28.647 03:06:03 -- common/autotest_common.sh@10 -- # set +x 00:05:28.647 [2024-04-25 03:06:03.069326] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:28.647 [2024-04-25 03:06:03.069365] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3912512 ] 00:05:28.647 EAL: No free 2048 kB hugepages reported on node 1 00:05:28.647 [2024-04-25 03:06:03.128249] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:28.905 [2024-04-25 03:06:03.205624] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:29.471 03:06:03 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:29.471 03:06:03 -- common/autotest_common.sh@850 -- # return 0 00:05:29.471 03:06:03 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=3912546 00:05:29.471 03:06:03 -- event/cpu_locks.sh@85 -- # waitforlisten 3912546 /var/tmp/spdk2.sock 00:05:29.471 03:06:03 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:05:29.471 03:06:03 -- common/autotest_common.sh@817 -- # '[' -z 3912546 ']' 00:05:29.471 03:06:03 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:29.471 03:06:03 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:29.471 03:06:03 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:29.471 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:29.471 03:06:03 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:29.471 03:06:03 -- common/autotest_common.sh@10 -- # set +x 00:05:29.471 [2024-04-25 03:06:03.906763] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:29.471 [2024-04-25 03:06:03.906809] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3912546 ] 00:05:29.471 EAL: No free 2048 kB hugepages reported on node 1 00:05:29.729 [2024-04-25 03:06:03.984188] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:29.729 [2024-04-25 03:06:03.984214] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:29.729 [2024-04-25 03:06:04.136516] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:30.295 03:06:04 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:30.295 03:06:04 -- common/autotest_common.sh@850 -- # return 0 00:05:30.295 03:06:04 -- event/cpu_locks.sh@87 -- # locks_exist 3912512 00:05:30.295 03:06:04 -- event/cpu_locks.sh@22 -- # lslocks -p 3912512 00:05:30.295 03:06:04 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:30.861 lslocks: write error 00:05:30.861 03:06:05 -- event/cpu_locks.sh@89 -- # killprocess 3912512 00:05:30.861 03:06:05 -- common/autotest_common.sh@936 -- # '[' -z 3912512 ']' 00:05:30.861 03:06:05 -- common/autotest_common.sh@940 -- # kill -0 3912512 00:05:30.861 03:06:05 -- common/autotest_common.sh@941 -- # uname 00:05:30.861 03:06:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:30.861 03:06:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3912512 00:05:30.861 03:06:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:30.861 03:06:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:30.861 03:06:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3912512' 00:05:30.861 killing process with pid 3912512 00:05:30.861 03:06:05 -- common/autotest_common.sh@955 -- # kill 3912512 00:05:30.861 03:06:05 -- common/autotest_common.sh@960 -- # wait 3912512 00:05:31.427 03:06:05 -- event/cpu_locks.sh@90 -- # killprocess 3912546 00:05:31.427 03:06:05 -- common/autotest_common.sh@936 -- # '[' -z 3912546 ']' 00:05:31.427 03:06:05 -- common/autotest_common.sh@940 -- # kill -0 3912546 00:05:31.427 03:06:05 -- common/autotest_common.sh@941 -- # uname 00:05:31.427 03:06:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:31.427 03:06:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3912546 00:05:31.685 03:06:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:31.685 03:06:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:31.685 03:06:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3912546' 00:05:31.685 killing process with pid 3912546 00:05:31.685 03:06:05 -- common/autotest_common.sh@955 -- # kill 3912546 00:05:31.685 03:06:05 -- common/autotest_common.sh@960 -- # wait 3912546 00:05:31.944 00:05:31.944 real 0m3.265s 00:05:31.944 user 0m3.476s 00:05:31.944 sys 0m0.924s 00:05:31.944 03:06:06 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:31.944 03:06:06 -- common/autotest_common.sh@10 -- # set +x 00:05:31.944 ************************************ 00:05:31.944 END TEST non_locking_app_on_locked_coremask 00:05:31.944 ************************************ 00:05:31.944 03:06:06 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:05:31.944 03:06:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:31.944 03:06:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:31.944 03:06:06 -- common/autotest_common.sh@10 -- # set +x 00:05:32.202 ************************************ 00:05:32.202 START TEST locking_app_on_unlocked_coremask 00:05:32.202 ************************************ 00:05:32.202 03:06:06 -- common/autotest_common.sh@1111 -- # locking_app_on_unlocked_coremask 00:05:32.202 03:06:06 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=3913021 00:05:32.202 03:06:06 -- event/cpu_locks.sh@99 -- # waitforlisten 3913021 /var/tmp/spdk.sock 00:05:32.202 03:06:06 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:05:32.202 03:06:06 -- common/autotest_common.sh@817 -- # '[' -z 3913021 ']' 00:05:32.202 03:06:06 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:32.202 03:06:06 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:32.202 03:06:06 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:32.202 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:32.202 03:06:06 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:32.202 03:06:06 -- common/autotest_common.sh@10 -- # set +x 00:05:32.202 [2024-04-25 03:06:06.503247] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:32.202 [2024-04-25 03:06:06.503292] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3913021 ] 00:05:32.202 EAL: No free 2048 kB hugepages reported on node 1 00:05:32.202 [2024-04-25 03:06:06.564801] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:32.202 [2024-04-25 03:06:06.564825] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:32.202 [2024-04-25 03:06:06.639286] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.137 03:06:07 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:33.137 03:06:07 -- common/autotest_common.sh@850 -- # return 0 00:05:33.137 03:06:07 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=3913247 00:05:33.137 03:06:07 -- event/cpu_locks.sh@103 -- # waitforlisten 3913247 /var/tmp/spdk2.sock 00:05:33.137 03:06:07 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:33.137 03:06:07 -- common/autotest_common.sh@817 -- # '[' -z 3913247 ']' 00:05:33.137 03:06:07 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:33.137 03:06:07 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:33.137 03:06:07 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:33.137 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:33.137 03:06:07 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:33.137 03:06:07 -- common/autotest_common.sh@10 -- # set +x 00:05:33.137 [2024-04-25 03:06:07.332175] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:33.137 [2024-04-25 03:06:07.332224] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3913247 ] 00:05:33.137 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.137 [2024-04-25 03:06:07.414943] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:33.137 [2024-04-25 03:06:07.553222] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.706 03:06:08 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:33.706 03:06:08 -- common/autotest_common.sh@850 -- # return 0 00:05:33.706 03:06:08 -- event/cpu_locks.sh@105 -- # locks_exist 3913247 00:05:33.706 03:06:08 -- event/cpu_locks.sh@22 -- # lslocks -p 3913247 00:05:33.706 03:06:08 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:34.273 lslocks: write error 00:05:34.273 03:06:08 -- event/cpu_locks.sh@107 -- # killprocess 3913021 00:05:34.273 03:06:08 -- common/autotest_common.sh@936 -- # '[' -z 3913021 ']' 00:05:34.273 03:06:08 -- common/autotest_common.sh@940 -- # kill -0 3913021 00:05:34.273 03:06:08 -- common/autotest_common.sh@941 -- # uname 00:05:34.273 03:06:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:34.273 03:06:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3913021 00:05:34.273 03:06:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:34.273 03:06:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:34.273 03:06:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3913021' 00:05:34.273 killing process with pid 3913021 00:05:34.273 03:06:08 -- common/autotest_common.sh@955 -- # kill 3913021 00:05:34.273 03:06:08 -- common/autotest_common.sh@960 -- # wait 3913021 00:05:34.841 03:06:09 -- event/cpu_locks.sh@108 -- # killprocess 3913247 00:05:34.841 03:06:09 -- common/autotest_common.sh@936 -- # '[' -z 3913247 ']' 00:05:34.841 03:06:09 -- common/autotest_common.sh@940 -- # kill -0 3913247 00:05:34.841 03:06:09 -- common/autotest_common.sh@941 -- # uname 00:05:34.841 03:06:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:34.841 03:06:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3913247 00:05:35.100 03:06:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:35.100 03:06:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:35.100 03:06:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3913247' 00:05:35.100 killing process with pid 3913247 00:05:35.100 03:06:09 -- common/autotest_common.sh@955 -- # kill 3913247 00:05:35.100 03:06:09 -- common/autotest_common.sh@960 -- # wait 3913247 00:05:35.358 00:05:35.358 real 0m3.237s 00:05:35.358 user 0m3.435s 00:05:35.358 sys 0m0.905s 00:05:35.358 03:06:09 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:35.358 03:06:09 -- common/autotest_common.sh@10 -- # set +x 00:05:35.358 ************************************ 00:05:35.358 END TEST locking_app_on_unlocked_coremask 00:05:35.358 ************************************ 00:05:35.358 03:06:09 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:05:35.358 03:06:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:35.358 03:06:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.358 03:06:09 -- common/autotest_common.sh@10 -- # set +x 00:05:35.358 ************************************ 00:05:35.358 START TEST locking_app_on_locked_coremask 00:05:35.358 ************************************ 00:05:35.358 03:06:09 -- common/autotest_common.sh@1111 -- # locking_app_on_locked_coremask 00:05:35.358 03:06:09 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=3914116 00:05:35.358 03:06:09 -- event/cpu_locks.sh@116 -- # waitforlisten 3914116 /var/tmp/spdk.sock 00:05:35.358 03:06:09 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:35.358 03:06:09 -- common/autotest_common.sh@817 -- # '[' -z 3914116 ']' 00:05:35.358 03:06:09 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:35.358 03:06:09 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:35.358 03:06:09 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:35.358 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:35.358 03:06:09 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:35.358 03:06:09 -- common/autotest_common.sh@10 -- # set +x 00:05:35.616 [2024-04-25 03:06:09.904957] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:35.616 [2024-04-25 03:06:09.904994] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3914116 ] 00:05:35.616 EAL: No free 2048 kB hugepages reported on node 1 00:05:35.616 [2024-04-25 03:06:09.963427] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:35.616 [2024-04-25 03:06:10.047596] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:36.552 03:06:10 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:36.552 03:06:10 -- common/autotest_common.sh@850 -- # return 0 00:05:36.552 03:06:10 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:36.552 03:06:10 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=3914174 00:05:36.552 03:06:10 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 3914174 /var/tmp/spdk2.sock 00:05:36.552 03:06:10 -- common/autotest_common.sh@638 -- # local es=0 00:05:36.552 03:06:10 -- common/autotest_common.sh@640 -- # valid_exec_arg waitforlisten 3914174 /var/tmp/spdk2.sock 00:05:36.552 03:06:10 -- common/autotest_common.sh@626 -- # local arg=waitforlisten 00:05:36.552 03:06:10 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:36.552 03:06:10 -- common/autotest_common.sh@630 -- # type -t waitforlisten 00:05:36.552 03:06:10 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:36.552 03:06:10 -- common/autotest_common.sh@641 -- # waitforlisten 3914174 /var/tmp/spdk2.sock 00:05:36.552 03:06:10 -- common/autotest_common.sh@817 -- # '[' -z 3914174 ']' 00:05:36.552 03:06:10 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:36.552 03:06:10 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:36.552 03:06:10 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:36.552 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:36.552 03:06:10 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:36.552 03:06:10 -- common/autotest_common.sh@10 -- # set +x 00:05:36.552 [2024-04-25 03:06:10.723327] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:36.552 [2024-04-25 03:06:10.723369] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3914174 ] 00:05:36.552 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.552 [2024-04-25 03:06:10.803510] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 3914116 has claimed it. 00:05:36.552 [2024-04-25 03:06:10.803540] app.c: 821:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:37.118 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/autotest_common.sh: line 832: kill: (3914174) - No such process 00:05:37.118 ERROR: process (pid: 3914174) is no longer running 00:05:37.118 03:06:11 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:37.118 03:06:11 -- common/autotest_common.sh@850 -- # return 1 00:05:37.118 03:06:11 -- common/autotest_common.sh@641 -- # es=1 00:05:37.118 03:06:11 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:37.118 03:06:11 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:05:37.118 03:06:11 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:37.118 03:06:11 -- event/cpu_locks.sh@122 -- # locks_exist 3914116 00:05:37.118 03:06:11 -- event/cpu_locks.sh@22 -- # lslocks -p 3914116 00:05:37.118 03:06:11 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:37.377 lslocks: write error 00:05:37.377 03:06:11 -- event/cpu_locks.sh@124 -- # killprocess 3914116 00:05:37.377 03:06:11 -- common/autotest_common.sh@936 -- # '[' -z 3914116 ']' 00:05:37.377 03:06:11 -- common/autotest_common.sh@940 -- # kill -0 3914116 00:05:37.377 03:06:11 -- common/autotest_common.sh@941 -- # uname 00:05:37.377 03:06:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:37.377 03:06:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3914116 00:05:37.377 03:06:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:37.377 03:06:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:37.377 03:06:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3914116' 00:05:37.377 killing process with pid 3914116 00:05:37.377 03:06:11 -- common/autotest_common.sh@955 -- # kill 3914116 00:05:37.377 03:06:11 -- common/autotest_common.sh@960 -- # wait 3914116 00:05:37.635 00:05:37.635 real 0m2.262s 00:05:37.635 user 0m2.466s 00:05:37.635 sys 0m0.606s 00:05:37.635 03:06:12 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:37.635 03:06:12 -- common/autotest_common.sh@10 -- # set +x 00:05:37.635 ************************************ 00:05:37.635 END TEST locking_app_on_locked_coremask 00:05:37.635 ************************************ 00:05:37.894 03:06:12 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:05:37.894 03:06:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:37.894 03:06:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:37.894 03:06:12 -- common/autotest_common.sh@10 -- # set +x 00:05:37.894 ************************************ 00:05:37.894 START TEST locking_overlapped_coremask 00:05:37.894 ************************************ 00:05:37.894 03:06:12 -- common/autotest_common.sh@1111 -- # locking_overlapped_coremask 00:05:37.894 03:06:12 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:05:37.894 03:06:12 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=3914567 00:05:37.894 03:06:12 -- event/cpu_locks.sh@133 -- # waitforlisten 3914567 /var/tmp/spdk.sock 00:05:37.894 03:06:12 -- common/autotest_common.sh@817 -- # '[' -z 3914567 ']' 00:05:37.894 03:06:12 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:37.894 03:06:12 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:37.894 03:06:12 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:37.894 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:37.894 03:06:12 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:37.894 03:06:12 -- common/autotest_common.sh@10 -- # set +x 00:05:37.894 [2024-04-25 03:06:12.306784] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:37.894 [2024-04-25 03:06:12.306820] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3914567 ] 00:05:37.894 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.894 [2024-04-25 03:06:12.366189] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:38.153 [2024-04-25 03:06:12.444483] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:38.153 [2024-04-25 03:06:12.444579] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:38.153 [2024-04-25 03:06:12.444579] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:38.718 03:06:13 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:38.718 03:06:13 -- common/autotest_common.sh@850 -- # return 0 00:05:38.718 03:06:13 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=3914634 00:05:38.718 03:06:13 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 3914634 /var/tmp/spdk2.sock 00:05:38.718 03:06:13 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:05:38.718 03:06:13 -- common/autotest_common.sh@638 -- # local es=0 00:05:38.718 03:06:13 -- common/autotest_common.sh@640 -- # valid_exec_arg waitforlisten 3914634 /var/tmp/spdk2.sock 00:05:38.718 03:06:13 -- common/autotest_common.sh@626 -- # local arg=waitforlisten 00:05:38.718 03:06:13 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:38.718 03:06:13 -- common/autotest_common.sh@630 -- # type -t waitforlisten 00:05:38.718 03:06:13 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:38.719 03:06:13 -- common/autotest_common.sh@641 -- # waitforlisten 3914634 /var/tmp/spdk2.sock 00:05:38.719 03:06:13 -- common/autotest_common.sh@817 -- # '[' -z 3914634 ']' 00:05:38.719 03:06:13 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:38.719 03:06:13 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:38.719 03:06:13 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:38.719 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:38.719 03:06:13 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:38.719 03:06:13 -- common/autotest_common.sh@10 -- # set +x 00:05:38.719 [2024-04-25 03:06:13.162467] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:38.719 [2024-04-25 03:06:13.162514] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3914634 ] 00:05:38.719 EAL: No free 2048 kB hugepages reported on node 1 00:05:38.976 [2024-04-25 03:06:13.244259] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3914567 has claimed it. 00:05:38.976 [2024-04-25 03:06:13.244290] app.c: 821:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:39.542 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/autotest_common.sh: line 832: kill: (3914634) - No such process 00:05:39.542 ERROR: process (pid: 3914634) is no longer running 00:05:39.542 03:06:13 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:39.542 03:06:13 -- common/autotest_common.sh@850 -- # return 1 00:05:39.542 03:06:13 -- common/autotest_common.sh@641 -- # es=1 00:05:39.542 03:06:13 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:39.542 03:06:13 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:05:39.542 03:06:13 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:39.542 03:06:13 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:05:39.542 03:06:13 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:39.542 03:06:13 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:39.542 03:06:13 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:39.542 03:06:13 -- event/cpu_locks.sh@141 -- # killprocess 3914567 00:05:39.542 03:06:13 -- common/autotest_common.sh@936 -- # '[' -z 3914567 ']' 00:05:39.542 03:06:13 -- common/autotest_common.sh@940 -- # kill -0 3914567 00:05:39.542 03:06:13 -- common/autotest_common.sh@941 -- # uname 00:05:39.542 03:06:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:39.542 03:06:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3914567 00:05:39.542 03:06:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:39.542 03:06:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:39.542 03:06:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3914567' 00:05:39.542 killing process with pid 3914567 00:05:39.542 03:06:13 -- common/autotest_common.sh@955 -- # kill 3914567 00:05:39.542 03:06:13 -- common/autotest_common.sh@960 -- # wait 3914567 00:05:39.800 00:05:39.800 real 0m1.897s 00:05:39.800 user 0m5.336s 00:05:39.800 sys 0m0.395s 00:05:39.800 03:06:14 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:39.800 03:06:14 -- common/autotest_common.sh@10 -- # set +x 00:05:39.800 ************************************ 00:05:39.800 END TEST locking_overlapped_coremask 00:05:39.800 ************************************ 00:05:39.800 03:06:14 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:05:39.800 03:06:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:39.800 03:06:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.800 03:06:14 -- common/autotest_common.sh@10 -- # set +x 00:05:40.059 ************************************ 00:05:40.059 START TEST locking_overlapped_coremask_via_rpc 00:05:40.059 ************************************ 00:05:40.059 03:06:14 -- common/autotest_common.sh@1111 -- # locking_overlapped_coremask_via_rpc 00:05:40.059 03:06:14 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=3914900 00:05:40.059 03:06:14 -- event/cpu_locks.sh@149 -- # waitforlisten 3914900 /var/tmp/spdk.sock 00:05:40.059 03:06:14 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:05:40.059 03:06:14 -- common/autotest_common.sh@817 -- # '[' -z 3914900 ']' 00:05:40.059 03:06:14 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:40.059 03:06:14 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:40.059 03:06:14 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:40.059 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:40.059 03:06:14 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:40.059 03:06:14 -- common/autotest_common.sh@10 -- # set +x 00:05:40.059 [2024-04-25 03:06:14.382111] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:40.059 [2024-04-25 03:06:14.382148] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3914900 ] 00:05:40.059 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.059 [2024-04-25 03:06:14.441185] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:40.059 [2024-04-25 03:06:14.441207] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:40.059 [2024-04-25 03:06:14.518546] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:40.059 [2024-04-25 03:06:14.518647] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:40.059 [2024-04-25 03:06:14.518649] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:40.993 03:06:15 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:40.993 03:06:15 -- common/autotest_common.sh@850 -- # return 0 00:05:40.993 03:06:15 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=3915119 00:05:40.993 03:06:15 -- event/cpu_locks.sh@153 -- # waitforlisten 3915119 /var/tmp/spdk2.sock 00:05:40.993 03:06:15 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:05:40.993 03:06:15 -- common/autotest_common.sh@817 -- # '[' -z 3915119 ']' 00:05:40.993 03:06:15 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:40.993 03:06:15 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:40.993 03:06:15 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:40.993 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:40.993 03:06:15 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:40.993 03:06:15 -- common/autotest_common.sh@10 -- # set +x 00:05:40.993 [2024-04-25 03:06:15.216853] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:40.993 [2024-04-25 03:06:15.216908] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3915119 ] 00:05:40.993 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.993 [2024-04-25 03:06:15.300426] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:40.993 [2024-04-25 03:06:15.300451] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:40.993 [2024-04-25 03:06:15.444620] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:40.993 [2024-04-25 03:06:15.444731] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:40.993 [2024-04-25 03:06:15.444732] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:05:41.562 03:06:16 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:41.562 03:06:16 -- common/autotest_common.sh@850 -- # return 0 00:05:41.562 03:06:16 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:05:41.562 03:06:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:41.562 03:06:16 -- common/autotest_common.sh@10 -- # set +x 00:05:41.562 03:06:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:41.562 03:06:16 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:41.562 03:06:16 -- common/autotest_common.sh@638 -- # local es=0 00:05:41.562 03:06:16 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:41.562 03:06:16 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:05:41.562 03:06:16 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:41.562 03:06:16 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:05:41.562 03:06:16 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:41.562 03:06:16 -- common/autotest_common.sh@641 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:41.562 03:06:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:41.562 03:06:16 -- common/autotest_common.sh@10 -- # set +x 00:05:41.562 [2024-04-25 03:06:16.021926] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3914900 has claimed it. 00:05:41.562 request: 00:05:41.562 { 00:05:41.562 "method": "framework_enable_cpumask_locks", 00:05:41.562 "req_id": 1 00:05:41.562 } 00:05:41.562 Got JSON-RPC error response 00:05:41.562 response: 00:05:41.562 { 00:05:41.562 "code": -32603, 00:05:41.562 "message": "Failed to claim CPU core: 2" 00:05:41.562 } 00:05:41.562 03:06:16 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:05:41.562 03:06:16 -- common/autotest_common.sh@641 -- # es=1 00:05:41.562 03:06:16 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:41.562 03:06:16 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:05:41.562 03:06:16 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:41.562 03:06:16 -- event/cpu_locks.sh@158 -- # waitforlisten 3914900 /var/tmp/spdk.sock 00:05:41.562 03:06:16 -- common/autotest_common.sh@817 -- # '[' -z 3914900 ']' 00:05:41.562 03:06:16 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:41.562 03:06:16 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:41.562 03:06:16 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:41.562 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:41.562 03:06:16 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:41.562 03:06:16 -- common/autotest_common.sh@10 -- # set +x 00:05:41.822 03:06:16 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:41.822 03:06:16 -- common/autotest_common.sh@850 -- # return 0 00:05:41.822 03:06:16 -- event/cpu_locks.sh@159 -- # waitforlisten 3915119 /var/tmp/spdk2.sock 00:05:41.822 03:06:16 -- common/autotest_common.sh@817 -- # '[' -z 3915119 ']' 00:05:41.822 03:06:16 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:41.822 03:06:16 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:41.822 03:06:16 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:41.822 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:41.822 03:06:16 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:41.822 03:06:16 -- common/autotest_common.sh@10 -- # set +x 00:05:42.081 03:06:16 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:42.081 03:06:16 -- common/autotest_common.sh@850 -- # return 0 00:05:42.081 03:06:16 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:05:42.081 03:06:16 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:42.081 03:06:16 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:42.081 03:06:16 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:42.081 00:05:42.081 real 0m2.071s 00:05:42.081 user 0m0.824s 00:05:42.081 sys 0m0.177s 00:05:42.081 03:06:16 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:42.081 03:06:16 -- common/autotest_common.sh@10 -- # set +x 00:05:42.081 ************************************ 00:05:42.081 END TEST locking_overlapped_coremask_via_rpc 00:05:42.081 ************************************ 00:05:42.081 03:06:16 -- event/cpu_locks.sh@174 -- # cleanup 00:05:42.081 03:06:16 -- event/cpu_locks.sh@15 -- # [[ -z 3914900 ]] 00:05:42.081 03:06:16 -- event/cpu_locks.sh@15 -- # killprocess 3914900 00:05:42.081 03:06:16 -- common/autotest_common.sh@936 -- # '[' -z 3914900 ']' 00:05:42.081 03:06:16 -- common/autotest_common.sh@940 -- # kill -0 3914900 00:05:42.081 03:06:16 -- common/autotest_common.sh@941 -- # uname 00:05:42.081 03:06:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:42.081 03:06:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3914900 00:05:42.081 03:06:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:42.081 03:06:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:42.081 03:06:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3914900' 00:05:42.081 killing process with pid 3914900 00:05:42.081 03:06:16 -- common/autotest_common.sh@955 -- # kill 3914900 00:05:42.081 03:06:16 -- common/autotest_common.sh@960 -- # wait 3914900 00:05:42.339 03:06:16 -- event/cpu_locks.sh@16 -- # [[ -z 3915119 ]] 00:05:42.340 03:06:16 -- event/cpu_locks.sh@16 -- # killprocess 3915119 00:05:42.340 03:06:16 -- common/autotest_common.sh@936 -- # '[' -z 3915119 ']' 00:05:42.340 03:06:16 -- common/autotest_common.sh@940 -- # kill -0 3915119 00:05:42.340 03:06:16 -- common/autotest_common.sh@941 -- # uname 00:05:42.340 03:06:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:42.340 03:06:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3915119 00:05:42.599 03:06:16 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:05:42.599 03:06:16 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:05:42.599 03:06:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3915119' 00:05:42.599 killing process with pid 3915119 00:05:42.599 03:06:16 -- common/autotest_common.sh@955 -- # kill 3915119 00:05:42.599 03:06:16 -- common/autotest_common.sh@960 -- # wait 3915119 00:05:42.859 03:06:17 -- event/cpu_locks.sh@18 -- # rm -f 00:05:42.859 03:06:17 -- event/cpu_locks.sh@1 -- # cleanup 00:05:42.859 03:06:17 -- event/cpu_locks.sh@15 -- # [[ -z 3914900 ]] 00:05:42.859 03:06:17 -- event/cpu_locks.sh@15 -- # killprocess 3914900 00:05:42.859 03:06:17 -- common/autotest_common.sh@936 -- # '[' -z 3914900 ']' 00:05:42.859 03:06:17 -- common/autotest_common.sh@940 -- # kill -0 3914900 00:05:42.859 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3914900) - No such process 00:05:42.859 03:06:17 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3914900 is not found' 00:05:42.859 Process with pid 3914900 is not found 00:05:42.859 03:06:17 -- event/cpu_locks.sh@16 -- # [[ -z 3915119 ]] 00:05:42.859 03:06:17 -- event/cpu_locks.sh@16 -- # killprocess 3915119 00:05:42.859 03:06:17 -- common/autotest_common.sh@936 -- # '[' -z 3915119 ']' 00:05:42.859 03:06:17 -- common/autotest_common.sh@940 -- # kill -0 3915119 00:05:42.859 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3915119) - No such process 00:05:42.859 03:06:17 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3915119 is not found' 00:05:42.859 Process with pid 3915119 is not found 00:05:42.859 03:06:17 -- event/cpu_locks.sh@18 -- # rm -f 00:05:42.859 00:05:42.859 real 0m17.916s 00:05:42.859 user 0m29.634s 00:05:42.859 sys 0m5.195s 00:05:42.859 03:06:17 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:42.859 03:06:17 -- common/autotest_common.sh@10 -- # set +x 00:05:42.859 ************************************ 00:05:42.859 END TEST cpu_locks 00:05:42.859 ************************************ 00:05:42.859 00:05:42.859 real 0m44.145s 00:05:42.859 user 1m19.910s 00:05:42.859 sys 0m8.812s 00:05:42.859 03:06:17 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:42.859 03:06:17 -- common/autotest_common.sh@10 -- # set +x 00:05:42.859 ************************************ 00:05:42.859 END TEST event 00:05:42.859 ************************************ 00:05:42.859 03:06:17 -- spdk/autotest.sh@178 -- # run_test thread /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/thread/thread.sh 00:05:42.859 03:06:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:42.859 03:06:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:42.859 03:06:17 -- common/autotest_common.sh@10 -- # set +x 00:05:43.118 ************************************ 00:05:43.118 START TEST thread 00:05:43.118 ************************************ 00:05:43.118 03:06:17 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/thread/thread.sh 00:05:43.118 * Looking for test storage... 00:05:43.118 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/thread 00:05:43.118 03:06:17 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:43.118 03:06:17 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:43.118 03:06:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:43.118 03:06:17 -- common/autotest_common.sh@10 -- # set +x 00:05:43.376 ************************************ 00:05:43.376 START TEST thread_poller_perf 00:05:43.376 ************************************ 00:05:43.376 03:06:17 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:43.376 [2024-04-25 03:06:17.656419] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:43.376 [2024-04-25 03:06:17.656489] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3915556 ] 00:05:43.376 EAL: No free 2048 kB hugepages reported on node 1 00:05:43.376 [2024-04-25 03:06:17.722358] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:43.376 [2024-04-25 03:06:17.792587] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:43.376 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:05:44.751 ====================================== 00:05:44.751 busy:2105704118 (cyc) 00:05:44.751 total_run_count: 422000 00:05:44.751 tsc_hz: 2100000000 (cyc) 00:05:44.751 ====================================== 00:05:44.751 poller_cost: 4989 (cyc), 2375 (nsec) 00:05:44.751 00:05:44.751 real 0m1.247s 00:05:44.751 user 0m1.161s 00:05:44.751 sys 0m0.082s 00:05:44.751 03:06:18 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:44.751 03:06:18 -- common/autotest_common.sh@10 -- # set +x 00:05:44.751 ************************************ 00:05:44.751 END TEST thread_poller_perf 00:05:44.751 ************************************ 00:05:44.751 03:06:18 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:44.751 03:06:18 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:44.751 03:06:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:44.751 03:06:18 -- common/autotest_common.sh@10 -- # set +x 00:05:44.751 ************************************ 00:05:44.751 START TEST thread_poller_perf 00:05:44.751 ************************************ 00:05:44.751 03:06:19 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:44.752 [2024-04-25 03:06:19.053458] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:44.752 [2024-04-25 03:06:19.053536] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3915827 ] 00:05:44.752 EAL: No free 2048 kB hugepages reported on node 1 00:05:44.752 [2024-04-25 03:06:19.118973] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:44.752 [2024-04-25 03:06:19.189724] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:44.752 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:05:46.203 ====================================== 00:05:46.203 busy:2101706638 (cyc) 00:05:46.203 total_run_count: 5538000 00:05:46.203 tsc_hz: 2100000000 (cyc) 00:05:46.203 ====================================== 00:05:46.203 poller_cost: 379 (cyc), 180 (nsec) 00:05:46.203 00:05:46.203 real 0m1.253s 00:05:46.203 user 0m1.180s 00:05:46.203 sys 0m0.068s 00:05:46.203 03:06:20 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:46.203 03:06:20 -- common/autotest_common.sh@10 -- # set +x 00:05:46.203 ************************************ 00:05:46.203 END TEST thread_poller_perf 00:05:46.203 ************************************ 00:05:46.203 03:06:20 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:05:46.203 00:05:46.203 real 0m2.907s 00:05:46.203 user 0m2.504s 00:05:46.203 sys 0m0.380s 00:05:46.203 03:06:20 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:46.203 03:06:20 -- common/autotest_common.sh@10 -- # set +x 00:05:46.203 ************************************ 00:05:46.203 END TEST thread 00:05:46.203 ************************************ 00:05:46.203 03:06:20 -- spdk/autotest.sh@179 -- # run_test accel /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/accel.sh 00:05:46.203 03:06:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:46.203 03:06:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:46.203 03:06:20 -- common/autotest_common.sh@10 -- # set +x 00:05:46.203 ************************************ 00:05:46.203 START TEST accel 00:05:46.203 ************************************ 00:05:46.203 03:06:20 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/accel.sh 00:05:46.203 * Looking for test storage... 00:05:46.203 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel 00:05:46.203 03:06:20 -- accel/accel.sh@81 -- # declare -A expected_opcs 00:05:46.203 03:06:20 -- accel/accel.sh@82 -- # get_expected_opcs 00:05:46.203 03:06:20 -- accel/accel.sh@60 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:46.203 03:06:20 -- accel/accel.sh@62 -- # spdk_tgt_pid=3916230 00:05:46.203 03:06:20 -- accel/accel.sh@63 -- # waitforlisten 3916230 00:05:46.203 03:06:20 -- common/autotest_common.sh@817 -- # '[' -z 3916230 ']' 00:05:46.203 03:06:20 -- accel/accel.sh@61 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:05:46.203 03:06:20 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:46.203 03:06:20 -- accel/accel.sh@61 -- # build_accel_config 00:05:46.203 03:06:20 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:46.203 03:06:20 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:46.203 03:06:20 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:46.203 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:46.203 03:06:20 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:46.203 03:06:20 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:46.203 03:06:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:46.203 03:06:20 -- common/autotest_common.sh@10 -- # set +x 00:05:46.203 03:06:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:46.203 03:06:20 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:46.203 03:06:20 -- accel/accel.sh@40 -- # local IFS=, 00:05:46.203 03:06:20 -- accel/accel.sh@41 -- # jq -r . 00:05:46.203 [2024-04-25 03:06:20.602304] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:46.203 [2024-04-25 03:06:20.602353] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3916230 ] 00:05:46.203 EAL: No free 2048 kB hugepages reported on node 1 00:05:46.203 [2024-04-25 03:06:20.661709] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:46.462 [2024-04-25 03:06:20.739040] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.029 03:06:21 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:47.029 03:06:21 -- common/autotest_common.sh@850 -- # return 0 00:05:47.029 03:06:21 -- accel/accel.sh@65 -- # [[ 0 -gt 0 ]] 00:05:47.029 03:06:21 -- accel/accel.sh@66 -- # [[ 0 -gt 0 ]] 00:05:47.029 03:06:21 -- accel/accel.sh@67 -- # [[ 0 -gt 0 ]] 00:05:47.029 03:06:21 -- accel/accel.sh@68 -- # [[ -n '' ]] 00:05:47.029 03:06:21 -- accel/accel.sh@70 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:05:47.029 03:06:21 -- accel/accel.sh@70 -- # rpc_cmd accel_get_opc_assignments 00:05:47.029 03:06:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:47.029 03:06:21 -- common/autotest_common.sh@10 -- # set +x 00:05:47.029 03:06:21 -- accel/accel.sh@70 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:05:47.029 03:06:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:47.029 03:06:21 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:47.029 03:06:21 -- accel/accel.sh@72 -- # IFS== 00:05:47.029 03:06:21 -- accel/accel.sh@72 -- # read -r opc module 00:05:47.029 03:06:21 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:47.029 03:06:21 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:47.029 03:06:21 -- accel/accel.sh@72 -- # IFS== 00:05:47.029 03:06:21 -- accel/accel.sh@72 -- # read -r opc module 00:05:47.029 03:06:21 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:47.029 03:06:21 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:47.029 03:06:21 -- accel/accel.sh@72 -- # IFS== 00:05:47.029 03:06:21 -- accel/accel.sh@72 -- # read -r opc module 00:05:47.029 03:06:21 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:47.029 03:06:21 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:47.029 03:06:21 -- accel/accel.sh@72 -- # IFS== 00:05:47.029 03:06:21 -- accel/accel.sh@72 -- # read -r opc module 00:05:47.029 03:06:21 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:47.029 03:06:21 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:47.029 03:06:21 -- accel/accel.sh@72 -- # IFS== 00:05:47.029 03:06:21 -- accel/accel.sh@72 -- # read -r opc module 00:05:47.029 03:06:21 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:47.029 03:06:21 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:47.029 03:06:21 -- accel/accel.sh@72 -- # IFS== 00:05:47.029 03:06:21 -- accel/accel.sh@72 -- # read -r opc module 00:05:47.029 03:06:21 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:47.029 03:06:21 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:47.029 03:06:21 -- accel/accel.sh@72 -- # IFS== 00:05:47.029 03:06:21 -- accel/accel.sh@72 -- # read -r opc module 00:05:47.029 03:06:21 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:47.029 03:06:21 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:47.029 03:06:21 -- accel/accel.sh@72 -- # IFS== 00:05:47.029 03:06:21 -- accel/accel.sh@72 -- # read -r opc module 00:05:47.029 03:06:21 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:47.029 03:06:21 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:47.029 03:06:21 -- accel/accel.sh@72 -- # IFS== 00:05:47.029 03:06:21 -- accel/accel.sh@72 -- # read -r opc module 00:05:47.029 03:06:21 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:47.029 03:06:21 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:47.029 03:06:21 -- accel/accel.sh@72 -- # IFS== 00:05:47.029 03:06:21 -- accel/accel.sh@72 -- # read -r opc module 00:05:47.029 03:06:21 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:47.029 03:06:21 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:47.029 03:06:21 -- accel/accel.sh@72 -- # IFS== 00:05:47.029 03:06:21 -- accel/accel.sh@72 -- # read -r opc module 00:05:47.029 03:06:21 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:47.029 03:06:21 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:47.029 03:06:21 -- accel/accel.sh@72 -- # IFS== 00:05:47.029 03:06:21 -- accel/accel.sh@72 -- # read -r opc module 00:05:47.029 03:06:21 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:47.029 03:06:21 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:47.029 03:06:21 -- accel/accel.sh@72 -- # IFS== 00:05:47.029 03:06:21 -- accel/accel.sh@72 -- # read -r opc module 00:05:47.029 03:06:21 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:47.029 03:06:21 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:47.029 03:06:21 -- accel/accel.sh@72 -- # IFS== 00:05:47.029 03:06:21 -- accel/accel.sh@72 -- # read -r opc module 00:05:47.029 03:06:21 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:47.029 03:06:21 -- accel/accel.sh@75 -- # killprocess 3916230 00:05:47.029 03:06:21 -- common/autotest_common.sh@936 -- # '[' -z 3916230 ']' 00:05:47.029 03:06:21 -- common/autotest_common.sh@940 -- # kill -0 3916230 00:05:47.029 03:06:21 -- common/autotest_common.sh@941 -- # uname 00:05:47.029 03:06:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:47.029 03:06:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3916230 00:05:47.029 03:06:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:47.029 03:06:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:47.029 03:06:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3916230' 00:05:47.029 killing process with pid 3916230 00:05:47.029 03:06:21 -- common/autotest_common.sh@955 -- # kill 3916230 00:05:47.029 03:06:21 -- common/autotest_common.sh@960 -- # wait 3916230 00:05:47.597 03:06:21 -- accel/accel.sh@76 -- # trap - ERR 00:05:47.597 03:06:21 -- accel/accel.sh@89 -- # run_test accel_help accel_perf -h 00:05:47.597 03:06:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:05:47.597 03:06:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:47.597 03:06:21 -- common/autotest_common.sh@10 -- # set +x 00:05:47.597 03:06:21 -- common/autotest_common.sh@1111 -- # accel_perf -h 00:05:47.597 03:06:21 -- accel/accel.sh@12 -- # build_accel_config 00:05:47.597 03:06:21 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:47.597 03:06:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:05:47.597 03:06:21 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:47.597 03:06:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:47.597 03:06:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:47.597 03:06:21 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:47.597 03:06:21 -- accel/accel.sh@40 -- # local IFS=, 00:05:47.597 03:06:21 -- accel/accel.sh@41 -- # jq -r . 00:05:47.597 03:06:21 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:47.597 03:06:21 -- common/autotest_common.sh@10 -- # set +x 00:05:47.597 03:06:22 -- accel/accel.sh@91 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:05:47.597 03:06:22 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:47.598 03:06:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:47.598 03:06:22 -- common/autotest_common.sh@10 -- # set +x 00:05:47.857 ************************************ 00:05:47.857 START TEST accel_missing_filename 00:05:47.857 ************************************ 00:05:47.857 03:06:22 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w compress 00:05:47.857 03:06:22 -- common/autotest_common.sh@638 -- # local es=0 00:05:47.857 03:06:22 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w compress 00:05:47.857 03:06:22 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:05:47.857 03:06:22 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:47.857 03:06:22 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:05:47.857 03:06:22 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:47.857 03:06:22 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w compress 00:05:47.857 03:06:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:05:47.857 03:06:22 -- accel/accel.sh@12 -- # build_accel_config 00:05:47.857 03:06:22 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:47.857 03:06:22 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:47.857 03:06:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:47.857 03:06:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:47.857 03:06:22 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:47.857 03:06:22 -- accel/accel.sh@40 -- # local IFS=, 00:05:47.857 03:06:22 -- accel/accel.sh@41 -- # jq -r . 00:05:47.857 [2024-04-25 03:06:22.179804] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:47.857 [2024-04-25 03:06:22.179884] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3916515 ] 00:05:47.857 EAL: No free 2048 kB hugepages reported on node 1 00:05:47.857 [2024-04-25 03:06:22.244474] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:47.857 [2024-04-25 03:06:22.319925] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.115 [2024-04-25 03:06:22.360610] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:48.115 [2024-04-25 03:06:22.420902] accel_perf.c:1394:main: *ERROR*: ERROR starting application 00:05:48.115 A filename is required. 00:05:48.115 03:06:22 -- common/autotest_common.sh@641 -- # es=234 00:05:48.115 03:06:22 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:48.115 03:06:22 -- common/autotest_common.sh@650 -- # es=106 00:05:48.115 03:06:22 -- common/autotest_common.sh@651 -- # case "$es" in 00:05:48.115 03:06:22 -- common/autotest_common.sh@658 -- # es=1 00:05:48.115 03:06:22 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:48.115 00:05:48.115 real 0m0.363s 00:05:48.115 user 0m0.274s 00:05:48.115 sys 0m0.129s 00:05:48.115 03:06:22 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:48.115 03:06:22 -- common/autotest_common.sh@10 -- # set +x 00:05:48.115 ************************************ 00:05:48.115 END TEST accel_missing_filename 00:05:48.115 ************************************ 00:05:48.115 03:06:22 -- accel/accel.sh@93 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y 00:05:48.115 03:06:22 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:48.115 03:06:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:48.115 03:06:22 -- common/autotest_common.sh@10 -- # set +x 00:05:48.375 ************************************ 00:05:48.375 START TEST accel_compress_verify 00:05:48.375 ************************************ 00:05:48.375 03:06:22 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y 00:05:48.375 03:06:22 -- common/autotest_common.sh@638 -- # local es=0 00:05:48.375 03:06:22 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y 00:05:48.375 03:06:22 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:05:48.375 03:06:22 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:48.375 03:06:22 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:05:48.375 03:06:22 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:48.375 03:06:22 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y 00:05:48.375 03:06:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y 00:05:48.375 03:06:22 -- accel/accel.sh@12 -- # build_accel_config 00:05:48.375 03:06:22 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:48.375 03:06:22 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:48.375 03:06:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:48.375 03:06:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:48.375 03:06:22 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:48.375 03:06:22 -- accel/accel.sh@40 -- # local IFS=, 00:05:48.375 03:06:22 -- accel/accel.sh@41 -- # jq -r . 00:05:48.375 [2024-04-25 03:06:22.674035] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:48.375 [2024-04-25 03:06:22.674098] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3916551 ] 00:05:48.375 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.375 [2024-04-25 03:06:22.734343] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:48.375 [2024-04-25 03:06:22.803623] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.375 [2024-04-25 03:06:22.843801] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:48.634 [2024-04-25 03:06:22.904047] accel_perf.c:1394:main: *ERROR*: ERROR starting application 00:05:48.634 00:05:48.634 Compression does not support the verify option, aborting. 00:05:48.634 03:06:22 -- common/autotest_common.sh@641 -- # es=161 00:05:48.634 03:06:22 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:48.634 03:06:22 -- common/autotest_common.sh@650 -- # es=33 00:05:48.634 03:06:22 -- common/autotest_common.sh@651 -- # case "$es" in 00:05:48.634 03:06:22 -- common/autotest_common.sh@658 -- # es=1 00:05:48.634 03:06:22 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:48.634 00:05:48.634 real 0m0.351s 00:05:48.634 user 0m0.276s 00:05:48.634 sys 0m0.113s 00:05:48.634 03:06:22 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:48.634 03:06:22 -- common/autotest_common.sh@10 -- # set +x 00:05:48.634 ************************************ 00:05:48.634 END TEST accel_compress_verify 00:05:48.634 ************************************ 00:05:48.634 03:06:23 -- accel/accel.sh@95 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:05:48.634 03:06:23 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:48.634 03:06:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:48.634 03:06:23 -- common/autotest_common.sh@10 -- # set +x 00:05:48.898 ************************************ 00:05:48.898 START TEST accel_wrong_workload 00:05:48.898 ************************************ 00:05:48.898 03:06:23 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w foobar 00:05:48.898 03:06:23 -- common/autotest_common.sh@638 -- # local es=0 00:05:48.898 03:06:23 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:05:48.898 03:06:23 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:05:48.898 03:06:23 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:48.898 03:06:23 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:05:48.898 03:06:23 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:48.898 03:06:23 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w foobar 00:05:48.898 03:06:23 -- accel/accel.sh@12 -- # build_accel_config 00:05:48.898 03:06:23 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:48.898 03:06:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:05:48.898 03:06:23 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:48.898 03:06:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:48.898 03:06:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:48.898 03:06:23 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:48.898 03:06:23 -- accel/accel.sh@40 -- # local IFS=, 00:05:48.898 03:06:23 -- accel/accel.sh@41 -- # jq -r . 00:05:48.898 Unsupported workload type: foobar 00:05:48.898 [2024-04-25 03:06:23.165126] app.c:1364:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:05:48.898 accel_perf options: 00:05:48.898 [-h help message] 00:05:48.898 [-q queue depth per core] 00:05:48.898 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:48.898 [-T number of threads per core 00:05:48.898 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:48.898 [-t time in seconds] 00:05:48.898 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:48.898 [ dif_verify, , dif_generate, dif_generate_copy 00:05:48.898 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:48.898 [-l for compress/decompress workloads, name of uncompressed input file 00:05:48.898 [-S for crc32c workload, use this seed value (default 0) 00:05:48.898 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:48.898 [-f for fill workload, use this BYTE value (default 255) 00:05:48.898 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:48.898 [-y verify result if this switch is on] 00:05:48.898 [-a tasks to allocate per core (default: same value as -q)] 00:05:48.898 Can be used to spread operations across a wider range of memory. 00:05:48.898 03:06:23 -- common/autotest_common.sh@641 -- # es=1 00:05:48.898 03:06:23 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:48.898 03:06:23 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:05:48.898 03:06:23 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:48.898 00:05:48.898 real 0m0.034s 00:05:48.898 user 0m0.038s 00:05:48.898 sys 0m0.018s 00:05:48.898 03:06:23 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:48.898 03:06:23 -- common/autotest_common.sh@10 -- # set +x 00:05:48.898 ************************************ 00:05:48.898 END TEST accel_wrong_workload 00:05:48.898 ************************************ 00:05:48.898 03:06:23 -- accel/accel.sh@97 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:05:48.898 03:06:23 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:48.898 03:06:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:48.898 03:06:23 -- common/autotest_common.sh@10 -- # set +x 00:05:48.898 ************************************ 00:05:48.898 START TEST accel_negative_buffers 00:05:48.898 ************************************ 00:05:48.898 03:06:23 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:05:48.898 03:06:23 -- common/autotest_common.sh@638 -- # local es=0 00:05:48.898 03:06:23 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:05:48.899 03:06:23 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:05:48.899 03:06:23 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:48.899 03:06:23 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:05:48.899 03:06:23 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:48.899 03:06:23 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w xor -y -x -1 00:05:48.899 03:06:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:05:48.899 03:06:23 -- accel/accel.sh@12 -- # build_accel_config 00:05:48.899 03:06:23 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:48.899 03:06:23 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:48.899 03:06:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:48.899 03:06:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:48.899 03:06:23 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:48.899 03:06:23 -- accel/accel.sh@40 -- # local IFS=, 00:05:48.899 03:06:23 -- accel/accel.sh@41 -- # jq -r . 00:05:48.899 -x option must be non-negative. 00:05:48.899 [2024-04-25 03:06:23.338418] app.c:1364:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:05:48.899 accel_perf options: 00:05:48.899 [-h help message] 00:05:48.899 [-q queue depth per core] 00:05:48.899 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:48.899 [-T number of threads per core 00:05:48.899 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:48.899 [-t time in seconds] 00:05:48.899 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:48.899 [ dif_verify, , dif_generate, dif_generate_copy 00:05:48.899 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:48.899 [-l for compress/decompress workloads, name of uncompressed input file 00:05:48.899 [-S for crc32c workload, use this seed value (default 0) 00:05:48.899 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:48.899 [-f for fill workload, use this BYTE value (default 255) 00:05:48.899 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:48.899 [-y verify result if this switch is on] 00:05:48.899 [-a tasks to allocate per core (default: same value as -q)] 00:05:48.899 Can be used to spread operations across a wider range of memory. 00:05:48.899 03:06:23 -- common/autotest_common.sh@641 -- # es=1 00:05:48.899 03:06:23 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:48.899 03:06:23 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:05:48.899 03:06:23 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:48.899 00:05:48.899 real 0m0.033s 00:05:48.899 user 0m0.018s 00:05:48.899 sys 0m0.014s 00:05:48.899 03:06:23 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:48.899 03:06:23 -- common/autotest_common.sh@10 -- # set +x 00:05:48.899 ************************************ 00:05:48.899 END TEST accel_negative_buffers 00:05:48.899 ************************************ 00:05:48.899 Error: writing output failed: Broken pipe 00:05:48.899 03:06:23 -- accel/accel.sh@101 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:05:48.899 03:06:23 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:48.899 03:06:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:48.899 03:06:23 -- common/autotest_common.sh@10 -- # set +x 00:05:49.165 ************************************ 00:05:49.165 START TEST accel_crc32c 00:05:49.165 ************************************ 00:05:49.165 03:06:23 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w crc32c -S 32 -y 00:05:49.165 03:06:23 -- accel/accel.sh@16 -- # local accel_opc 00:05:49.165 03:06:23 -- accel/accel.sh@17 -- # local accel_module 00:05:49.165 03:06:23 -- accel/accel.sh@19 -- # IFS=: 00:05:49.165 03:06:23 -- accel/accel.sh@19 -- # read -r var val 00:05:49.165 03:06:23 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:49.165 03:06:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:49.165 03:06:23 -- accel/accel.sh@12 -- # build_accel_config 00:05:49.165 03:06:23 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:49.165 03:06:23 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:49.165 03:06:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:49.165 03:06:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:49.165 03:06:23 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:49.165 03:06:23 -- accel/accel.sh@40 -- # local IFS=, 00:05:49.165 03:06:23 -- accel/accel.sh@41 -- # jq -r . 00:05:49.165 [2024-04-25 03:06:23.546288] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:49.165 [2024-04-25 03:06:23.546361] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3916852 ] 00:05:49.165 EAL: No free 2048 kB hugepages reported on node 1 00:05:49.165 [2024-04-25 03:06:23.610274] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:49.424 [2024-04-25 03:06:23.687732] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:49.424 03:06:23 -- accel/accel.sh@20 -- # val= 00:05:49.424 03:06:23 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.424 03:06:23 -- accel/accel.sh@19 -- # IFS=: 00:05:49.424 03:06:23 -- accel/accel.sh@19 -- # read -r var val 00:05:49.424 03:06:23 -- accel/accel.sh@20 -- # val= 00:05:49.425 03:06:23 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # IFS=: 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # read -r var val 00:05:49.425 03:06:23 -- accel/accel.sh@20 -- # val=0x1 00:05:49.425 03:06:23 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # IFS=: 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # read -r var val 00:05:49.425 03:06:23 -- accel/accel.sh@20 -- # val= 00:05:49.425 03:06:23 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # IFS=: 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # read -r var val 00:05:49.425 03:06:23 -- accel/accel.sh@20 -- # val= 00:05:49.425 03:06:23 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # IFS=: 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # read -r var val 00:05:49.425 03:06:23 -- accel/accel.sh@20 -- # val=crc32c 00:05:49.425 03:06:23 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.425 03:06:23 -- accel/accel.sh@23 -- # accel_opc=crc32c 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # IFS=: 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # read -r var val 00:05:49.425 03:06:23 -- accel/accel.sh@20 -- # val=32 00:05:49.425 03:06:23 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # IFS=: 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # read -r var val 00:05:49.425 03:06:23 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:49.425 03:06:23 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # IFS=: 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # read -r var val 00:05:49.425 03:06:23 -- accel/accel.sh@20 -- # val= 00:05:49.425 03:06:23 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # IFS=: 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # read -r var val 00:05:49.425 03:06:23 -- accel/accel.sh@20 -- # val=software 00:05:49.425 03:06:23 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.425 03:06:23 -- accel/accel.sh@22 -- # accel_module=software 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # IFS=: 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # read -r var val 00:05:49.425 03:06:23 -- accel/accel.sh@20 -- # val=32 00:05:49.425 03:06:23 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # IFS=: 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # read -r var val 00:05:49.425 03:06:23 -- accel/accel.sh@20 -- # val=32 00:05:49.425 03:06:23 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # IFS=: 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # read -r var val 00:05:49.425 03:06:23 -- accel/accel.sh@20 -- # val=1 00:05:49.425 03:06:23 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # IFS=: 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # read -r var val 00:05:49.425 03:06:23 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:49.425 03:06:23 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # IFS=: 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # read -r var val 00:05:49.425 03:06:23 -- accel/accel.sh@20 -- # val=Yes 00:05:49.425 03:06:23 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # IFS=: 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # read -r var val 00:05:49.425 03:06:23 -- accel/accel.sh@20 -- # val= 00:05:49.425 03:06:23 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # IFS=: 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # read -r var val 00:05:49.425 03:06:23 -- accel/accel.sh@20 -- # val= 00:05:49.425 03:06:23 -- accel/accel.sh@21 -- # case "$var" in 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # IFS=: 00:05:49.425 03:06:23 -- accel/accel.sh@19 -- # read -r var val 00:05:50.802 03:06:24 -- accel/accel.sh@20 -- # val= 00:05:50.802 03:06:24 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.802 03:06:24 -- accel/accel.sh@19 -- # IFS=: 00:05:50.802 03:06:24 -- accel/accel.sh@19 -- # read -r var val 00:05:50.802 03:06:24 -- accel/accel.sh@20 -- # val= 00:05:50.802 03:06:24 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.802 03:06:24 -- accel/accel.sh@19 -- # IFS=: 00:05:50.802 03:06:24 -- accel/accel.sh@19 -- # read -r var val 00:05:50.802 03:06:24 -- accel/accel.sh@20 -- # val= 00:05:50.802 03:06:24 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.802 03:06:24 -- accel/accel.sh@19 -- # IFS=: 00:05:50.802 03:06:24 -- accel/accel.sh@19 -- # read -r var val 00:05:50.802 03:06:24 -- accel/accel.sh@20 -- # val= 00:05:50.802 03:06:24 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.802 03:06:24 -- accel/accel.sh@19 -- # IFS=: 00:05:50.802 03:06:24 -- accel/accel.sh@19 -- # read -r var val 00:05:50.802 03:06:24 -- accel/accel.sh@20 -- # val= 00:05:50.802 03:06:24 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.802 03:06:24 -- accel/accel.sh@19 -- # IFS=: 00:05:50.802 03:06:24 -- accel/accel.sh@19 -- # read -r var val 00:05:50.802 03:06:24 -- accel/accel.sh@20 -- # val= 00:05:50.802 03:06:24 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.802 03:06:24 -- accel/accel.sh@19 -- # IFS=: 00:05:50.802 03:06:24 -- accel/accel.sh@19 -- # read -r var val 00:05:50.802 03:06:24 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:50.802 03:06:24 -- accel/accel.sh@27 -- # [[ -n crc32c ]] 00:05:50.802 03:06:24 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:50.802 00:05:50.802 real 0m1.370s 00:05:50.802 user 0m1.257s 00:05:50.802 sys 0m0.126s 00:05:50.802 03:06:24 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:50.802 03:06:24 -- common/autotest_common.sh@10 -- # set +x 00:05:50.802 ************************************ 00:05:50.802 END TEST accel_crc32c 00:05:50.802 ************************************ 00:05:50.802 03:06:24 -- accel/accel.sh@102 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:05:50.802 03:06:24 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:50.802 03:06:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:50.802 03:06:24 -- common/autotest_common.sh@10 -- # set +x 00:05:50.802 ************************************ 00:05:50.802 START TEST accel_crc32c_C2 00:05:50.802 ************************************ 00:05:50.802 03:06:25 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w crc32c -y -C 2 00:05:50.802 03:06:25 -- accel/accel.sh@16 -- # local accel_opc 00:05:50.802 03:06:25 -- accel/accel.sh@17 -- # local accel_module 00:05:50.802 03:06:25 -- accel/accel.sh@19 -- # IFS=: 00:05:50.802 03:06:25 -- accel/accel.sh@19 -- # read -r var val 00:05:50.802 03:06:25 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:50.802 03:06:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:50.802 03:06:25 -- accel/accel.sh@12 -- # build_accel_config 00:05:50.802 03:06:25 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:50.802 03:06:25 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:50.802 03:06:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:50.802 03:06:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:50.802 03:06:25 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:50.802 03:06:25 -- accel/accel.sh@40 -- # local IFS=, 00:05:50.802 03:06:25 -- accel/accel.sh@41 -- # jq -r . 00:05:50.802 [2024-04-25 03:06:25.083313] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:50.802 [2024-04-25 03:06:25.083384] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3917103 ] 00:05:50.802 EAL: No free 2048 kB hugepages reported on node 1 00:05:50.802 [2024-04-25 03:06:25.147151] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:50.802 [2024-04-25 03:06:25.223538] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:50.802 03:06:25 -- accel/accel.sh@20 -- # val= 00:05:50.802 03:06:25 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.802 03:06:25 -- accel/accel.sh@19 -- # IFS=: 00:05:50.802 03:06:25 -- accel/accel.sh@19 -- # read -r var val 00:05:50.802 03:06:25 -- accel/accel.sh@20 -- # val= 00:05:50.802 03:06:25 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.802 03:06:25 -- accel/accel.sh@19 -- # IFS=: 00:05:50.802 03:06:25 -- accel/accel.sh@19 -- # read -r var val 00:05:50.802 03:06:25 -- accel/accel.sh@20 -- # val=0x1 00:05:50.803 03:06:25 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # IFS=: 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # read -r var val 00:05:50.803 03:06:25 -- accel/accel.sh@20 -- # val= 00:05:50.803 03:06:25 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # IFS=: 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # read -r var val 00:05:50.803 03:06:25 -- accel/accel.sh@20 -- # val= 00:05:50.803 03:06:25 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # IFS=: 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # read -r var val 00:05:50.803 03:06:25 -- accel/accel.sh@20 -- # val=crc32c 00:05:50.803 03:06:25 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.803 03:06:25 -- accel/accel.sh@23 -- # accel_opc=crc32c 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # IFS=: 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # read -r var val 00:05:50.803 03:06:25 -- accel/accel.sh@20 -- # val=0 00:05:50.803 03:06:25 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # IFS=: 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # read -r var val 00:05:50.803 03:06:25 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:50.803 03:06:25 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # IFS=: 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # read -r var val 00:05:50.803 03:06:25 -- accel/accel.sh@20 -- # val= 00:05:50.803 03:06:25 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # IFS=: 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # read -r var val 00:05:50.803 03:06:25 -- accel/accel.sh@20 -- # val=software 00:05:50.803 03:06:25 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.803 03:06:25 -- accel/accel.sh@22 -- # accel_module=software 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # IFS=: 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # read -r var val 00:05:50.803 03:06:25 -- accel/accel.sh@20 -- # val=32 00:05:50.803 03:06:25 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # IFS=: 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # read -r var val 00:05:50.803 03:06:25 -- accel/accel.sh@20 -- # val=32 00:05:50.803 03:06:25 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # IFS=: 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # read -r var val 00:05:50.803 03:06:25 -- accel/accel.sh@20 -- # val=1 00:05:50.803 03:06:25 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # IFS=: 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # read -r var val 00:05:50.803 03:06:25 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:50.803 03:06:25 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # IFS=: 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # read -r var val 00:05:50.803 03:06:25 -- accel/accel.sh@20 -- # val=Yes 00:05:50.803 03:06:25 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # IFS=: 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # read -r var val 00:05:50.803 03:06:25 -- accel/accel.sh@20 -- # val= 00:05:50.803 03:06:25 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # IFS=: 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # read -r var val 00:05:50.803 03:06:25 -- accel/accel.sh@20 -- # val= 00:05:50.803 03:06:25 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # IFS=: 00:05:50.803 03:06:25 -- accel/accel.sh@19 -- # read -r var val 00:05:52.180 03:06:26 -- accel/accel.sh@20 -- # val= 00:05:52.180 03:06:26 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.180 03:06:26 -- accel/accel.sh@19 -- # IFS=: 00:05:52.180 03:06:26 -- accel/accel.sh@19 -- # read -r var val 00:05:52.180 03:06:26 -- accel/accel.sh@20 -- # val= 00:05:52.180 03:06:26 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.180 03:06:26 -- accel/accel.sh@19 -- # IFS=: 00:05:52.180 03:06:26 -- accel/accel.sh@19 -- # read -r var val 00:05:52.180 03:06:26 -- accel/accel.sh@20 -- # val= 00:05:52.180 03:06:26 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.180 03:06:26 -- accel/accel.sh@19 -- # IFS=: 00:05:52.180 03:06:26 -- accel/accel.sh@19 -- # read -r var val 00:05:52.180 03:06:26 -- accel/accel.sh@20 -- # val= 00:05:52.180 03:06:26 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.180 03:06:26 -- accel/accel.sh@19 -- # IFS=: 00:05:52.180 03:06:26 -- accel/accel.sh@19 -- # read -r var val 00:05:52.180 03:06:26 -- accel/accel.sh@20 -- # val= 00:05:52.180 03:06:26 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.180 03:06:26 -- accel/accel.sh@19 -- # IFS=: 00:05:52.180 03:06:26 -- accel/accel.sh@19 -- # read -r var val 00:05:52.180 03:06:26 -- accel/accel.sh@20 -- # val= 00:05:52.180 03:06:26 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.181 03:06:26 -- accel/accel.sh@19 -- # IFS=: 00:05:52.181 03:06:26 -- accel/accel.sh@19 -- # read -r var val 00:05:52.181 03:06:26 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:52.181 03:06:26 -- accel/accel.sh@27 -- # [[ -n crc32c ]] 00:05:52.181 03:06:26 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:52.181 00:05:52.181 real 0m1.370s 00:05:52.181 user 0m1.260s 00:05:52.181 sys 0m0.122s 00:05:52.181 03:06:26 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:52.181 03:06:26 -- common/autotest_common.sh@10 -- # set +x 00:05:52.181 ************************************ 00:05:52.181 END TEST accel_crc32c_C2 00:05:52.181 ************************************ 00:05:52.181 03:06:26 -- accel/accel.sh@103 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:05:52.181 03:06:26 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:52.181 03:06:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:52.181 03:06:26 -- common/autotest_common.sh@10 -- # set +x 00:05:52.181 ************************************ 00:05:52.181 START TEST accel_copy 00:05:52.181 ************************************ 00:05:52.181 03:06:26 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w copy -y 00:05:52.181 03:06:26 -- accel/accel.sh@16 -- # local accel_opc 00:05:52.181 03:06:26 -- accel/accel.sh@17 -- # local accel_module 00:05:52.181 03:06:26 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:05:52.181 03:06:26 -- accel/accel.sh@19 -- # IFS=: 00:05:52.181 03:06:26 -- accel/accel.sh@19 -- # read -r var val 00:05:52.181 03:06:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:52.181 03:06:26 -- accel/accel.sh@12 -- # build_accel_config 00:05:52.181 03:06:26 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:52.181 03:06:26 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:52.181 03:06:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:52.181 03:06:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:52.181 03:06:26 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:52.181 03:06:26 -- accel/accel.sh@40 -- # local IFS=, 00:05:52.181 03:06:26 -- accel/accel.sh@41 -- # jq -r . 00:05:52.181 [2024-04-25 03:06:26.589826] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:52.181 [2024-04-25 03:06:26.589869] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3917359 ] 00:05:52.181 EAL: No free 2048 kB hugepages reported on node 1 00:05:52.181 [2024-04-25 03:06:26.647975] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:52.440 [2024-04-25 03:06:26.717561] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:52.440 03:06:26 -- accel/accel.sh@20 -- # val= 00:05:52.440 03:06:26 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # IFS=: 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # read -r var val 00:05:52.440 03:06:26 -- accel/accel.sh@20 -- # val= 00:05:52.440 03:06:26 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # IFS=: 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # read -r var val 00:05:52.440 03:06:26 -- accel/accel.sh@20 -- # val=0x1 00:05:52.440 03:06:26 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # IFS=: 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # read -r var val 00:05:52.440 03:06:26 -- accel/accel.sh@20 -- # val= 00:05:52.440 03:06:26 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # IFS=: 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # read -r var val 00:05:52.440 03:06:26 -- accel/accel.sh@20 -- # val= 00:05:52.440 03:06:26 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # IFS=: 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # read -r var val 00:05:52.440 03:06:26 -- accel/accel.sh@20 -- # val=copy 00:05:52.440 03:06:26 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.440 03:06:26 -- accel/accel.sh@23 -- # accel_opc=copy 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # IFS=: 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # read -r var val 00:05:52.440 03:06:26 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:52.440 03:06:26 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # IFS=: 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # read -r var val 00:05:52.440 03:06:26 -- accel/accel.sh@20 -- # val= 00:05:52.440 03:06:26 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # IFS=: 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # read -r var val 00:05:52.440 03:06:26 -- accel/accel.sh@20 -- # val=software 00:05:52.440 03:06:26 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.440 03:06:26 -- accel/accel.sh@22 -- # accel_module=software 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # IFS=: 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # read -r var val 00:05:52.440 03:06:26 -- accel/accel.sh@20 -- # val=32 00:05:52.440 03:06:26 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # IFS=: 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # read -r var val 00:05:52.440 03:06:26 -- accel/accel.sh@20 -- # val=32 00:05:52.440 03:06:26 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # IFS=: 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # read -r var val 00:05:52.440 03:06:26 -- accel/accel.sh@20 -- # val=1 00:05:52.440 03:06:26 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # IFS=: 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # read -r var val 00:05:52.440 03:06:26 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:52.440 03:06:26 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # IFS=: 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # read -r var val 00:05:52.440 03:06:26 -- accel/accel.sh@20 -- # val=Yes 00:05:52.440 03:06:26 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # IFS=: 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # read -r var val 00:05:52.440 03:06:26 -- accel/accel.sh@20 -- # val= 00:05:52.440 03:06:26 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # IFS=: 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # read -r var val 00:05:52.440 03:06:26 -- accel/accel.sh@20 -- # val= 00:05:52.440 03:06:26 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # IFS=: 00:05:52.440 03:06:26 -- accel/accel.sh@19 -- # read -r var val 00:05:53.817 03:06:27 -- accel/accel.sh@20 -- # val= 00:05:53.817 03:06:27 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.817 03:06:27 -- accel/accel.sh@19 -- # IFS=: 00:05:53.817 03:06:27 -- accel/accel.sh@19 -- # read -r var val 00:05:53.817 03:06:27 -- accel/accel.sh@20 -- # val= 00:05:53.817 03:06:27 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.817 03:06:27 -- accel/accel.sh@19 -- # IFS=: 00:05:53.817 03:06:27 -- accel/accel.sh@19 -- # read -r var val 00:05:53.817 03:06:27 -- accel/accel.sh@20 -- # val= 00:05:53.817 03:06:27 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.817 03:06:27 -- accel/accel.sh@19 -- # IFS=: 00:05:53.817 03:06:27 -- accel/accel.sh@19 -- # read -r var val 00:05:53.817 03:06:27 -- accel/accel.sh@20 -- # val= 00:05:53.817 03:06:27 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.817 03:06:27 -- accel/accel.sh@19 -- # IFS=: 00:05:53.817 03:06:27 -- accel/accel.sh@19 -- # read -r var val 00:05:53.817 03:06:27 -- accel/accel.sh@20 -- # val= 00:05:53.817 03:06:27 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.817 03:06:27 -- accel/accel.sh@19 -- # IFS=: 00:05:53.817 03:06:27 -- accel/accel.sh@19 -- # read -r var val 00:05:53.817 03:06:27 -- accel/accel.sh@20 -- # val= 00:05:53.817 03:06:27 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.817 03:06:27 -- accel/accel.sh@19 -- # IFS=: 00:05:53.817 03:06:27 -- accel/accel.sh@19 -- # read -r var val 00:05:53.817 03:06:27 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:53.817 03:06:27 -- accel/accel.sh@27 -- # [[ -n copy ]] 00:05:53.817 03:06:27 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:53.817 00:05:53.817 real 0m1.339s 00:05:53.817 user 0m1.246s 00:05:53.817 sys 0m0.105s 00:05:53.817 03:06:27 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:53.817 03:06:27 -- common/autotest_common.sh@10 -- # set +x 00:05:53.817 ************************************ 00:05:53.817 END TEST accel_copy 00:05:53.817 ************************************ 00:05:53.817 03:06:27 -- accel/accel.sh@104 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:53.817 03:06:27 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:53.817 03:06:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:53.817 03:06:27 -- common/autotest_common.sh@10 -- # set +x 00:05:53.817 ************************************ 00:05:53.817 START TEST accel_fill 00:05:53.817 ************************************ 00:05:53.817 03:06:28 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:53.817 03:06:28 -- accel/accel.sh@16 -- # local accel_opc 00:05:53.817 03:06:28 -- accel/accel.sh@17 -- # local accel_module 00:05:53.817 03:06:28 -- accel/accel.sh@19 -- # IFS=: 00:05:53.817 03:06:28 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:53.817 03:06:28 -- accel/accel.sh@19 -- # read -r var val 00:05:53.817 03:06:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:53.818 03:06:28 -- accel/accel.sh@12 -- # build_accel_config 00:05:53.818 03:06:28 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:53.818 03:06:28 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:53.818 03:06:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:53.818 03:06:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:53.818 03:06:28 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:53.818 03:06:28 -- accel/accel.sh@40 -- # local IFS=, 00:05:53.818 03:06:28 -- accel/accel.sh@41 -- # jq -r . 00:05:53.818 [2024-04-25 03:06:28.093651] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:53.818 [2024-04-25 03:06:28.093707] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3917614 ] 00:05:53.818 EAL: No free 2048 kB hugepages reported on node 1 00:05:53.818 [2024-04-25 03:06:28.152927] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:53.818 [2024-04-25 03:06:28.222554] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:53.818 03:06:28 -- accel/accel.sh@20 -- # val= 00:05:53.818 03:06:28 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # IFS=: 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # read -r var val 00:05:53.818 03:06:28 -- accel/accel.sh@20 -- # val= 00:05:53.818 03:06:28 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # IFS=: 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # read -r var val 00:05:53.818 03:06:28 -- accel/accel.sh@20 -- # val=0x1 00:05:53.818 03:06:28 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # IFS=: 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # read -r var val 00:05:53.818 03:06:28 -- accel/accel.sh@20 -- # val= 00:05:53.818 03:06:28 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # IFS=: 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # read -r var val 00:05:53.818 03:06:28 -- accel/accel.sh@20 -- # val= 00:05:53.818 03:06:28 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # IFS=: 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # read -r var val 00:05:53.818 03:06:28 -- accel/accel.sh@20 -- # val=fill 00:05:53.818 03:06:28 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.818 03:06:28 -- accel/accel.sh@23 -- # accel_opc=fill 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # IFS=: 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # read -r var val 00:05:53.818 03:06:28 -- accel/accel.sh@20 -- # val=0x80 00:05:53.818 03:06:28 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # IFS=: 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # read -r var val 00:05:53.818 03:06:28 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:53.818 03:06:28 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # IFS=: 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # read -r var val 00:05:53.818 03:06:28 -- accel/accel.sh@20 -- # val= 00:05:53.818 03:06:28 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # IFS=: 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # read -r var val 00:05:53.818 03:06:28 -- accel/accel.sh@20 -- # val=software 00:05:53.818 03:06:28 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.818 03:06:28 -- accel/accel.sh@22 -- # accel_module=software 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # IFS=: 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # read -r var val 00:05:53.818 03:06:28 -- accel/accel.sh@20 -- # val=64 00:05:53.818 03:06:28 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # IFS=: 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # read -r var val 00:05:53.818 03:06:28 -- accel/accel.sh@20 -- # val=64 00:05:53.818 03:06:28 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # IFS=: 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # read -r var val 00:05:53.818 03:06:28 -- accel/accel.sh@20 -- # val=1 00:05:53.818 03:06:28 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # IFS=: 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # read -r var val 00:05:53.818 03:06:28 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:53.818 03:06:28 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # IFS=: 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # read -r var val 00:05:53.818 03:06:28 -- accel/accel.sh@20 -- # val=Yes 00:05:53.818 03:06:28 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # IFS=: 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # read -r var val 00:05:53.818 03:06:28 -- accel/accel.sh@20 -- # val= 00:05:53.818 03:06:28 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # IFS=: 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # read -r var val 00:05:53.818 03:06:28 -- accel/accel.sh@20 -- # val= 00:05:53.818 03:06:28 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # IFS=: 00:05:53.818 03:06:28 -- accel/accel.sh@19 -- # read -r var val 00:05:55.194 03:06:29 -- accel/accel.sh@20 -- # val= 00:05:55.194 03:06:29 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.194 03:06:29 -- accel/accel.sh@19 -- # IFS=: 00:05:55.194 03:06:29 -- accel/accel.sh@19 -- # read -r var val 00:05:55.194 03:06:29 -- accel/accel.sh@20 -- # val= 00:05:55.194 03:06:29 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.194 03:06:29 -- accel/accel.sh@19 -- # IFS=: 00:05:55.194 03:06:29 -- accel/accel.sh@19 -- # read -r var val 00:05:55.194 03:06:29 -- accel/accel.sh@20 -- # val= 00:05:55.194 03:06:29 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.194 03:06:29 -- accel/accel.sh@19 -- # IFS=: 00:05:55.194 03:06:29 -- accel/accel.sh@19 -- # read -r var val 00:05:55.194 03:06:29 -- accel/accel.sh@20 -- # val= 00:05:55.194 03:06:29 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.194 03:06:29 -- accel/accel.sh@19 -- # IFS=: 00:05:55.194 03:06:29 -- accel/accel.sh@19 -- # read -r var val 00:05:55.194 03:06:29 -- accel/accel.sh@20 -- # val= 00:05:55.194 03:06:29 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.194 03:06:29 -- accel/accel.sh@19 -- # IFS=: 00:05:55.194 03:06:29 -- accel/accel.sh@19 -- # read -r var val 00:05:55.194 03:06:29 -- accel/accel.sh@20 -- # val= 00:05:55.194 03:06:29 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.194 03:06:29 -- accel/accel.sh@19 -- # IFS=: 00:05:55.194 03:06:29 -- accel/accel.sh@19 -- # read -r var val 00:05:55.194 03:06:29 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:55.194 03:06:29 -- accel/accel.sh@27 -- # [[ -n fill ]] 00:05:55.194 03:06:29 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:55.194 00:05:55.194 real 0m1.349s 00:05:55.194 user 0m1.247s 00:05:55.194 sys 0m0.115s 00:05:55.194 03:06:29 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:55.194 03:06:29 -- common/autotest_common.sh@10 -- # set +x 00:05:55.194 ************************************ 00:05:55.194 END TEST accel_fill 00:05:55.194 ************************************ 00:05:55.194 03:06:29 -- accel/accel.sh@105 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:55.194 03:06:29 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:55.194 03:06:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:55.194 03:06:29 -- common/autotest_common.sh@10 -- # set +x 00:05:55.194 ************************************ 00:05:55.194 START TEST accel_copy_crc32c 00:05:55.195 ************************************ 00:05:55.195 03:06:29 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w copy_crc32c -y 00:05:55.195 03:06:29 -- accel/accel.sh@16 -- # local accel_opc 00:05:55.195 03:06:29 -- accel/accel.sh@17 -- # local accel_module 00:05:55.195 03:06:29 -- accel/accel.sh@19 -- # IFS=: 00:05:55.195 03:06:29 -- accel/accel.sh@19 -- # read -r var val 00:05:55.195 03:06:29 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:55.195 03:06:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:55.195 03:06:29 -- accel/accel.sh@12 -- # build_accel_config 00:05:55.195 03:06:29 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:55.195 03:06:29 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:55.195 03:06:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:55.195 03:06:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:55.195 03:06:29 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:55.195 03:06:29 -- accel/accel.sh@40 -- # local IFS=, 00:05:55.195 03:06:29 -- accel/accel.sh@41 -- # jq -r . 00:05:55.195 [2024-04-25 03:06:29.582626] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:55.195 [2024-04-25 03:06:29.582672] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3917872 ] 00:05:55.195 EAL: No free 2048 kB hugepages reported on node 1 00:05:55.195 [2024-04-25 03:06:29.641534] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:55.453 [2024-04-25 03:06:29.710795] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:55.453 03:06:29 -- accel/accel.sh@20 -- # val= 00:05:55.453 03:06:29 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.453 03:06:29 -- accel/accel.sh@19 -- # IFS=: 00:05:55.453 03:06:29 -- accel/accel.sh@19 -- # read -r var val 00:05:55.454 03:06:29 -- accel/accel.sh@20 -- # val= 00:05:55.454 03:06:29 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # IFS=: 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # read -r var val 00:05:55.454 03:06:29 -- accel/accel.sh@20 -- # val=0x1 00:05:55.454 03:06:29 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # IFS=: 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # read -r var val 00:05:55.454 03:06:29 -- accel/accel.sh@20 -- # val= 00:05:55.454 03:06:29 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # IFS=: 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # read -r var val 00:05:55.454 03:06:29 -- accel/accel.sh@20 -- # val= 00:05:55.454 03:06:29 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # IFS=: 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # read -r var val 00:05:55.454 03:06:29 -- accel/accel.sh@20 -- # val=copy_crc32c 00:05:55.454 03:06:29 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.454 03:06:29 -- accel/accel.sh@23 -- # accel_opc=copy_crc32c 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # IFS=: 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # read -r var val 00:05:55.454 03:06:29 -- accel/accel.sh@20 -- # val=0 00:05:55.454 03:06:29 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # IFS=: 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # read -r var val 00:05:55.454 03:06:29 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:55.454 03:06:29 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # IFS=: 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # read -r var val 00:05:55.454 03:06:29 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:55.454 03:06:29 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # IFS=: 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # read -r var val 00:05:55.454 03:06:29 -- accel/accel.sh@20 -- # val= 00:05:55.454 03:06:29 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # IFS=: 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # read -r var val 00:05:55.454 03:06:29 -- accel/accel.sh@20 -- # val=software 00:05:55.454 03:06:29 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.454 03:06:29 -- accel/accel.sh@22 -- # accel_module=software 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # IFS=: 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # read -r var val 00:05:55.454 03:06:29 -- accel/accel.sh@20 -- # val=32 00:05:55.454 03:06:29 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # IFS=: 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # read -r var val 00:05:55.454 03:06:29 -- accel/accel.sh@20 -- # val=32 00:05:55.454 03:06:29 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # IFS=: 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # read -r var val 00:05:55.454 03:06:29 -- accel/accel.sh@20 -- # val=1 00:05:55.454 03:06:29 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # IFS=: 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # read -r var val 00:05:55.454 03:06:29 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:55.454 03:06:29 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # IFS=: 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # read -r var val 00:05:55.454 03:06:29 -- accel/accel.sh@20 -- # val=Yes 00:05:55.454 03:06:29 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # IFS=: 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # read -r var val 00:05:55.454 03:06:29 -- accel/accel.sh@20 -- # val= 00:05:55.454 03:06:29 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # IFS=: 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # read -r var val 00:05:55.454 03:06:29 -- accel/accel.sh@20 -- # val= 00:05:55.454 03:06:29 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # IFS=: 00:05:55.454 03:06:29 -- accel/accel.sh@19 -- # read -r var val 00:05:56.831 03:06:30 -- accel/accel.sh@20 -- # val= 00:05:56.831 03:06:30 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.831 03:06:30 -- accel/accel.sh@19 -- # IFS=: 00:05:56.831 03:06:30 -- accel/accel.sh@19 -- # read -r var val 00:05:56.831 03:06:30 -- accel/accel.sh@20 -- # val= 00:05:56.831 03:06:30 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.831 03:06:30 -- accel/accel.sh@19 -- # IFS=: 00:05:56.831 03:06:30 -- accel/accel.sh@19 -- # read -r var val 00:05:56.831 03:06:30 -- accel/accel.sh@20 -- # val= 00:05:56.831 03:06:30 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.831 03:06:30 -- accel/accel.sh@19 -- # IFS=: 00:05:56.831 03:06:30 -- accel/accel.sh@19 -- # read -r var val 00:05:56.831 03:06:30 -- accel/accel.sh@20 -- # val= 00:05:56.831 03:06:30 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.831 03:06:30 -- accel/accel.sh@19 -- # IFS=: 00:05:56.831 03:06:30 -- accel/accel.sh@19 -- # read -r var val 00:05:56.831 03:06:30 -- accel/accel.sh@20 -- # val= 00:05:56.831 03:06:30 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.831 03:06:30 -- accel/accel.sh@19 -- # IFS=: 00:05:56.831 03:06:30 -- accel/accel.sh@19 -- # read -r var val 00:05:56.831 03:06:30 -- accel/accel.sh@20 -- # val= 00:05:56.831 03:06:30 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.831 03:06:30 -- accel/accel.sh@19 -- # IFS=: 00:05:56.831 03:06:30 -- accel/accel.sh@19 -- # read -r var val 00:05:56.831 03:06:30 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:56.831 03:06:30 -- accel/accel.sh@27 -- # [[ -n copy_crc32c ]] 00:05:56.831 03:06:30 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:56.831 00:05:56.831 real 0m1.355s 00:05:56.831 user 0m1.252s 00:05:56.831 sys 0m0.116s 00:05:56.831 03:06:30 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:56.831 03:06:30 -- common/autotest_common.sh@10 -- # set +x 00:05:56.831 ************************************ 00:05:56.831 END TEST accel_copy_crc32c 00:05:56.831 ************************************ 00:05:56.831 03:06:30 -- accel/accel.sh@106 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:56.831 03:06:30 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:56.831 03:06:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:56.831 03:06:30 -- common/autotest_common.sh@10 -- # set +x 00:05:56.831 ************************************ 00:05:56.831 START TEST accel_copy_crc32c_C2 00:05:56.831 ************************************ 00:05:56.831 03:06:31 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:56.831 03:06:31 -- accel/accel.sh@16 -- # local accel_opc 00:05:56.831 03:06:31 -- accel/accel.sh@17 -- # local accel_module 00:05:56.831 03:06:31 -- accel/accel.sh@19 -- # IFS=: 00:05:56.831 03:06:31 -- accel/accel.sh@19 -- # read -r var val 00:05:56.831 03:06:31 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:56.831 03:06:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:56.831 03:06:31 -- accel/accel.sh@12 -- # build_accel_config 00:05:56.831 03:06:31 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:56.831 03:06:31 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:56.831 03:06:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:56.831 03:06:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:56.831 03:06:31 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:56.831 03:06:31 -- accel/accel.sh@40 -- # local IFS=, 00:05:56.831 03:06:31 -- accel/accel.sh@41 -- # jq -r . 00:05:56.831 [2024-04-25 03:06:31.092438] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:56.831 [2024-04-25 03:06:31.092504] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3918122 ] 00:05:56.831 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.831 [2024-04-25 03:06:31.157691] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:56.831 [2024-04-25 03:06:31.230624] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.831 03:06:31 -- accel/accel.sh@20 -- # val= 00:05:56.831 03:06:31 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.831 03:06:31 -- accel/accel.sh@19 -- # IFS=: 00:05:56.831 03:06:31 -- accel/accel.sh@19 -- # read -r var val 00:05:56.831 03:06:31 -- accel/accel.sh@20 -- # val= 00:05:56.831 03:06:31 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.831 03:06:31 -- accel/accel.sh@19 -- # IFS=: 00:05:56.831 03:06:31 -- accel/accel.sh@19 -- # read -r var val 00:05:56.831 03:06:31 -- accel/accel.sh@20 -- # val=0x1 00:05:56.831 03:06:31 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.831 03:06:31 -- accel/accel.sh@19 -- # IFS=: 00:05:56.831 03:06:31 -- accel/accel.sh@19 -- # read -r var val 00:05:56.831 03:06:31 -- accel/accel.sh@20 -- # val= 00:05:56.831 03:06:31 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.831 03:06:31 -- accel/accel.sh@19 -- # IFS=: 00:05:56.831 03:06:31 -- accel/accel.sh@19 -- # read -r var val 00:05:56.831 03:06:31 -- accel/accel.sh@20 -- # val= 00:05:56.831 03:06:31 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.831 03:06:31 -- accel/accel.sh@19 -- # IFS=: 00:05:56.831 03:06:31 -- accel/accel.sh@19 -- # read -r var val 00:05:56.831 03:06:31 -- accel/accel.sh@20 -- # val=copy_crc32c 00:05:56.831 03:06:31 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.831 03:06:31 -- accel/accel.sh@23 -- # accel_opc=copy_crc32c 00:05:56.831 03:06:31 -- accel/accel.sh@19 -- # IFS=: 00:05:56.831 03:06:31 -- accel/accel.sh@19 -- # read -r var val 00:05:56.831 03:06:31 -- accel/accel.sh@20 -- # val=0 00:05:56.831 03:06:31 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.831 03:06:31 -- accel/accel.sh@19 -- # IFS=: 00:05:56.831 03:06:31 -- accel/accel.sh@19 -- # read -r var val 00:05:56.831 03:06:31 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:56.831 03:06:31 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.831 03:06:31 -- accel/accel.sh@19 -- # IFS=: 00:05:56.831 03:06:31 -- accel/accel.sh@19 -- # read -r var val 00:05:56.831 03:06:31 -- accel/accel.sh@20 -- # val='8192 bytes' 00:05:56.831 03:06:31 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.831 03:06:31 -- accel/accel.sh@19 -- # IFS=: 00:05:56.831 03:06:31 -- accel/accel.sh@19 -- # read -r var val 00:05:56.831 03:06:31 -- accel/accel.sh@20 -- # val= 00:05:56.831 03:06:31 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.831 03:06:31 -- accel/accel.sh@19 -- # IFS=: 00:05:56.831 03:06:31 -- accel/accel.sh@19 -- # read -r var val 00:05:56.831 03:06:31 -- accel/accel.sh@20 -- # val=software 00:05:56.831 03:06:31 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.831 03:06:31 -- accel/accel.sh@22 -- # accel_module=software 00:05:56.831 03:06:31 -- accel/accel.sh@19 -- # IFS=: 00:05:56.831 03:06:31 -- accel/accel.sh@19 -- # read -r var val 00:05:56.831 03:06:31 -- accel/accel.sh@20 -- # val=32 00:05:56.832 03:06:31 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.832 03:06:31 -- accel/accel.sh@19 -- # IFS=: 00:05:56.832 03:06:31 -- accel/accel.sh@19 -- # read -r var val 00:05:56.832 03:06:31 -- accel/accel.sh@20 -- # val=32 00:05:56.832 03:06:31 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.832 03:06:31 -- accel/accel.sh@19 -- # IFS=: 00:05:56.832 03:06:31 -- accel/accel.sh@19 -- # read -r var val 00:05:56.832 03:06:31 -- accel/accel.sh@20 -- # val=1 00:05:56.832 03:06:31 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.832 03:06:31 -- accel/accel.sh@19 -- # IFS=: 00:05:56.832 03:06:31 -- accel/accel.sh@19 -- # read -r var val 00:05:56.832 03:06:31 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:56.832 03:06:31 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.832 03:06:31 -- accel/accel.sh@19 -- # IFS=: 00:05:56.832 03:06:31 -- accel/accel.sh@19 -- # read -r var val 00:05:56.832 03:06:31 -- accel/accel.sh@20 -- # val=Yes 00:05:56.832 03:06:31 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.832 03:06:31 -- accel/accel.sh@19 -- # IFS=: 00:05:56.832 03:06:31 -- accel/accel.sh@19 -- # read -r var val 00:05:56.832 03:06:31 -- accel/accel.sh@20 -- # val= 00:05:56.832 03:06:31 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.832 03:06:31 -- accel/accel.sh@19 -- # IFS=: 00:05:56.832 03:06:31 -- accel/accel.sh@19 -- # read -r var val 00:05:56.832 03:06:31 -- accel/accel.sh@20 -- # val= 00:05:56.832 03:06:31 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.832 03:06:31 -- accel/accel.sh@19 -- # IFS=: 00:05:56.832 03:06:31 -- accel/accel.sh@19 -- # read -r var val 00:05:58.208 03:06:32 -- accel/accel.sh@20 -- # val= 00:05:58.208 03:06:32 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.208 03:06:32 -- accel/accel.sh@19 -- # IFS=: 00:05:58.208 03:06:32 -- accel/accel.sh@19 -- # read -r var val 00:05:58.208 03:06:32 -- accel/accel.sh@20 -- # val= 00:05:58.208 03:06:32 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.208 03:06:32 -- accel/accel.sh@19 -- # IFS=: 00:05:58.208 03:06:32 -- accel/accel.sh@19 -- # read -r var val 00:05:58.208 03:06:32 -- accel/accel.sh@20 -- # val= 00:05:58.208 03:06:32 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.208 03:06:32 -- accel/accel.sh@19 -- # IFS=: 00:05:58.208 03:06:32 -- accel/accel.sh@19 -- # read -r var val 00:05:58.208 03:06:32 -- accel/accel.sh@20 -- # val= 00:05:58.208 03:06:32 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.208 03:06:32 -- accel/accel.sh@19 -- # IFS=: 00:05:58.208 03:06:32 -- accel/accel.sh@19 -- # read -r var val 00:05:58.208 03:06:32 -- accel/accel.sh@20 -- # val= 00:05:58.208 03:06:32 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.208 03:06:32 -- accel/accel.sh@19 -- # IFS=: 00:05:58.208 03:06:32 -- accel/accel.sh@19 -- # read -r var val 00:05:58.208 03:06:32 -- accel/accel.sh@20 -- # val= 00:05:58.208 03:06:32 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.208 03:06:32 -- accel/accel.sh@19 -- # IFS=: 00:05:58.208 03:06:32 -- accel/accel.sh@19 -- # read -r var val 00:05:58.208 03:06:32 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:58.208 03:06:32 -- accel/accel.sh@27 -- # [[ -n copy_crc32c ]] 00:05:58.208 03:06:32 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:58.208 00:05:58.208 real 0m1.366s 00:05:58.208 user 0m1.247s 00:05:58.208 sys 0m0.132s 00:05:58.208 03:06:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:58.208 03:06:32 -- common/autotest_common.sh@10 -- # set +x 00:05:58.208 ************************************ 00:05:58.208 END TEST accel_copy_crc32c_C2 00:05:58.208 ************************************ 00:05:58.208 03:06:32 -- accel/accel.sh@107 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:05:58.208 03:06:32 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:58.208 03:06:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:58.208 03:06:32 -- common/autotest_common.sh@10 -- # set +x 00:05:58.208 ************************************ 00:05:58.208 START TEST accel_dualcast 00:05:58.208 ************************************ 00:05:58.208 03:06:32 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dualcast -y 00:05:58.208 03:06:32 -- accel/accel.sh@16 -- # local accel_opc 00:05:58.208 03:06:32 -- accel/accel.sh@17 -- # local accel_module 00:05:58.208 03:06:32 -- accel/accel.sh@19 -- # IFS=: 00:05:58.208 03:06:32 -- accel/accel.sh@19 -- # read -r var val 00:05:58.209 03:06:32 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:05:58.209 03:06:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:58.209 03:06:32 -- accel/accel.sh@12 -- # build_accel_config 00:05:58.209 03:06:32 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:58.209 03:06:32 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:58.209 03:06:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:58.209 03:06:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:58.209 03:06:32 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:58.209 03:06:32 -- accel/accel.sh@40 -- # local IFS=, 00:05:58.209 03:06:32 -- accel/accel.sh@41 -- # jq -r . 00:05:58.209 [2024-04-25 03:06:32.590668] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:58.209 [2024-04-25 03:06:32.590713] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3918408 ] 00:05:58.209 EAL: No free 2048 kB hugepages reported on node 1 00:05:58.209 [2024-04-25 03:06:32.648831] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:58.468 [2024-04-25 03:06:32.720762] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:58.468 03:06:32 -- accel/accel.sh@20 -- # val= 00:05:58.468 03:06:32 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # IFS=: 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # read -r var val 00:05:58.468 03:06:32 -- accel/accel.sh@20 -- # val= 00:05:58.468 03:06:32 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # IFS=: 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # read -r var val 00:05:58.468 03:06:32 -- accel/accel.sh@20 -- # val=0x1 00:05:58.468 03:06:32 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # IFS=: 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # read -r var val 00:05:58.468 03:06:32 -- accel/accel.sh@20 -- # val= 00:05:58.468 03:06:32 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # IFS=: 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # read -r var val 00:05:58.468 03:06:32 -- accel/accel.sh@20 -- # val= 00:05:58.468 03:06:32 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # IFS=: 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # read -r var val 00:05:58.468 03:06:32 -- accel/accel.sh@20 -- # val=dualcast 00:05:58.468 03:06:32 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.468 03:06:32 -- accel/accel.sh@23 -- # accel_opc=dualcast 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # IFS=: 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # read -r var val 00:05:58.468 03:06:32 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:58.468 03:06:32 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # IFS=: 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # read -r var val 00:05:58.468 03:06:32 -- accel/accel.sh@20 -- # val= 00:05:58.468 03:06:32 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # IFS=: 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # read -r var val 00:05:58.468 03:06:32 -- accel/accel.sh@20 -- # val=software 00:05:58.468 03:06:32 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.468 03:06:32 -- accel/accel.sh@22 -- # accel_module=software 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # IFS=: 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # read -r var val 00:05:58.468 03:06:32 -- accel/accel.sh@20 -- # val=32 00:05:58.468 03:06:32 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # IFS=: 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # read -r var val 00:05:58.468 03:06:32 -- accel/accel.sh@20 -- # val=32 00:05:58.468 03:06:32 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # IFS=: 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # read -r var val 00:05:58.468 03:06:32 -- accel/accel.sh@20 -- # val=1 00:05:58.468 03:06:32 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # IFS=: 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # read -r var val 00:05:58.468 03:06:32 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:58.468 03:06:32 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # IFS=: 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # read -r var val 00:05:58.468 03:06:32 -- accel/accel.sh@20 -- # val=Yes 00:05:58.468 03:06:32 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # IFS=: 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # read -r var val 00:05:58.468 03:06:32 -- accel/accel.sh@20 -- # val= 00:05:58.468 03:06:32 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # IFS=: 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # read -r var val 00:05:58.468 03:06:32 -- accel/accel.sh@20 -- # val= 00:05:58.468 03:06:32 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # IFS=: 00:05:58.468 03:06:32 -- accel/accel.sh@19 -- # read -r var val 00:05:59.844 03:06:33 -- accel/accel.sh@20 -- # val= 00:05:59.844 03:06:33 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.844 03:06:33 -- accel/accel.sh@19 -- # IFS=: 00:05:59.844 03:06:33 -- accel/accel.sh@19 -- # read -r var val 00:05:59.844 03:06:33 -- accel/accel.sh@20 -- # val= 00:05:59.844 03:06:33 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.844 03:06:33 -- accel/accel.sh@19 -- # IFS=: 00:05:59.844 03:06:33 -- accel/accel.sh@19 -- # read -r var val 00:05:59.844 03:06:33 -- accel/accel.sh@20 -- # val= 00:05:59.844 03:06:33 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.844 03:06:33 -- accel/accel.sh@19 -- # IFS=: 00:05:59.844 03:06:33 -- accel/accel.sh@19 -- # read -r var val 00:05:59.844 03:06:33 -- accel/accel.sh@20 -- # val= 00:05:59.844 03:06:33 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.844 03:06:33 -- accel/accel.sh@19 -- # IFS=: 00:05:59.844 03:06:33 -- accel/accel.sh@19 -- # read -r var val 00:05:59.844 03:06:33 -- accel/accel.sh@20 -- # val= 00:05:59.844 03:06:33 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.844 03:06:33 -- accel/accel.sh@19 -- # IFS=: 00:05:59.844 03:06:33 -- accel/accel.sh@19 -- # read -r var val 00:05:59.844 03:06:33 -- accel/accel.sh@20 -- # val= 00:05:59.844 03:06:33 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.844 03:06:33 -- accel/accel.sh@19 -- # IFS=: 00:05:59.844 03:06:33 -- accel/accel.sh@19 -- # read -r var val 00:05:59.844 03:06:33 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:59.844 03:06:33 -- accel/accel.sh@27 -- # [[ -n dualcast ]] 00:05:59.844 03:06:33 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:59.844 00:05:59.844 real 0m1.357s 00:05:59.844 user 0m1.250s 00:05:59.844 sys 0m0.117s 00:05:59.844 03:06:33 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:59.844 03:06:33 -- common/autotest_common.sh@10 -- # set +x 00:05:59.844 ************************************ 00:05:59.844 END TEST accel_dualcast 00:05:59.844 ************************************ 00:05:59.844 03:06:33 -- accel/accel.sh@108 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:05:59.844 03:06:33 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:59.844 03:06:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:59.844 03:06:33 -- common/autotest_common.sh@10 -- # set +x 00:05:59.844 ************************************ 00:05:59.844 START TEST accel_compare 00:05:59.844 ************************************ 00:05:59.844 03:06:34 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w compare -y 00:05:59.844 03:06:34 -- accel/accel.sh@16 -- # local accel_opc 00:05:59.844 03:06:34 -- accel/accel.sh@17 -- # local accel_module 00:05:59.844 03:06:34 -- accel/accel.sh@19 -- # IFS=: 00:05:59.844 03:06:34 -- accel/accel.sh@19 -- # read -r var val 00:05:59.844 03:06:34 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:05:59.844 03:06:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:59.844 03:06:34 -- accel/accel.sh@12 -- # build_accel_config 00:05:59.844 03:06:34 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:59.844 03:06:34 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:59.844 03:06:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:59.844 03:06:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:59.844 03:06:34 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:59.844 03:06:34 -- accel/accel.sh@40 -- # local IFS=, 00:05:59.844 03:06:34 -- accel/accel.sh@41 -- # jq -r . 00:05:59.844 [2024-04-25 03:06:34.090167] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:05:59.844 [2024-04-25 03:06:34.090216] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3918739 ] 00:05:59.844 EAL: No free 2048 kB hugepages reported on node 1 00:05:59.844 [2024-04-25 03:06:34.151151] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:59.844 [2024-04-25 03:06:34.225296] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.844 03:06:34 -- accel/accel.sh@20 -- # val= 00:05:59.844 03:06:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.844 03:06:34 -- accel/accel.sh@19 -- # IFS=: 00:05:59.844 03:06:34 -- accel/accel.sh@19 -- # read -r var val 00:05:59.844 03:06:34 -- accel/accel.sh@20 -- # val= 00:05:59.844 03:06:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.844 03:06:34 -- accel/accel.sh@19 -- # IFS=: 00:05:59.844 03:06:34 -- accel/accel.sh@19 -- # read -r var val 00:05:59.844 03:06:34 -- accel/accel.sh@20 -- # val=0x1 00:05:59.844 03:06:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.844 03:06:34 -- accel/accel.sh@19 -- # IFS=: 00:05:59.844 03:06:34 -- accel/accel.sh@19 -- # read -r var val 00:05:59.844 03:06:34 -- accel/accel.sh@20 -- # val= 00:05:59.844 03:06:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.844 03:06:34 -- accel/accel.sh@19 -- # IFS=: 00:05:59.844 03:06:34 -- accel/accel.sh@19 -- # read -r var val 00:05:59.844 03:06:34 -- accel/accel.sh@20 -- # val= 00:05:59.844 03:06:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.844 03:06:34 -- accel/accel.sh@19 -- # IFS=: 00:05:59.844 03:06:34 -- accel/accel.sh@19 -- # read -r var val 00:05:59.844 03:06:34 -- accel/accel.sh@20 -- # val=compare 00:05:59.844 03:06:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.844 03:06:34 -- accel/accel.sh@23 -- # accel_opc=compare 00:05:59.844 03:06:34 -- accel/accel.sh@19 -- # IFS=: 00:05:59.844 03:06:34 -- accel/accel.sh@19 -- # read -r var val 00:05:59.844 03:06:34 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:59.844 03:06:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.844 03:06:34 -- accel/accel.sh@19 -- # IFS=: 00:05:59.844 03:06:34 -- accel/accel.sh@19 -- # read -r var val 00:05:59.844 03:06:34 -- accel/accel.sh@20 -- # val= 00:05:59.844 03:06:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.844 03:06:34 -- accel/accel.sh@19 -- # IFS=: 00:05:59.844 03:06:34 -- accel/accel.sh@19 -- # read -r var val 00:05:59.844 03:06:34 -- accel/accel.sh@20 -- # val=software 00:05:59.844 03:06:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.844 03:06:34 -- accel/accel.sh@22 -- # accel_module=software 00:05:59.844 03:06:34 -- accel/accel.sh@19 -- # IFS=: 00:05:59.844 03:06:34 -- accel/accel.sh@19 -- # read -r var val 00:05:59.844 03:06:34 -- accel/accel.sh@20 -- # val=32 00:05:59.844 03:06:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.844 03:06:34 -- accel/accel.sh@19 -- # IFS=: 00:05:59.844 03:06:34 -- accel/accel.sh@19 -- # read -r var val 00:05:59.844 03:06:34 -- accel/accel.sh@20 -- # val=32 00:05:59.844 03:06:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.844 03:06:34 -- accel/accel.sh@19 -- # IFS=: 00:05:59.845 03:06:34 -- accel/accel.sh@19 -- # read -r var val 00:05:59.845 03:06:34 -- accel/accel.sh@20 -- # val=1 00:05:59.845 03:06:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.845 03:06:34 -- accel/accel.sh@19 -- # IFS=: 00:05:59.845 03:06:34 -- accel/accel.sh@19 -- # read -r var val 00:05:59.845 03:06:34 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:59.845 03:06:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.845 03:06:34 -- accel/accel.sh@19 -- # IFS=: 00:05:59.845 03:06:34 -- accel/accel.sh@19 -- # read -r var val 00:05:59.845 03:06:34 -- accel/accel.sh@20 -- # val=Yes 00:05:59.845 03:06:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.845 03:06:34 -- accel/accel.sh@19 -- # IFS=: 00:05:59.845 03:06:34 -- accel/accel.sh@19 -- # read -r var val 00:05:59.845 03:06:34 -- accel/accel.sh@20 -- # val= 00:05:59.845 03:06:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.845 03:06:34 -- accel/accel.sh@19 -- # IFS=: 00:05:59.845 03:06:34 -- accel/accel.sh@19 -- # read -r var val 00:05:59.845 03:06:34 -- accel/accel.sh@20 -- # val= 00:05:59.845 03:06:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.845 03:06:34 -- accel/accel.sh@19 -- # IFS=: 00:05:59.845 03:06:34 -- accel/accel.sh@19 -- # read -r var val 00:06:01.222 03:06:35 -- accel/accel.sh@20 -- # val= 00:06:01.222 03:06:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.222 03:06:35 -- accel/accel.sh@19 -- # IFS=: 00:06:01.222 03:06:35 -- accel/accel.sh@19 -- # read -r var val 00:06:01.222 03:06:35 -- accel/accel.sh@20 -- # val= 00:06:01.222 03:06:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.222 03:06:35 -- accel/accel.sh@19 -- # IFS=: 00:06:01.222 03:06:35 -- accel/accel.sh@19 -- # read -r var val 00:06:01.222 03:06:35 -- accel/accel.sh@20 -- # val= 00:06:01.222 03:06:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.222 03:06:35 -- accel/accel.sh@19 -- # IFS=: 00:06:01.222 03:06:35 -- accel/accel.sh@19 -- # read -r var val 00:06:01.222 03:06:35 -- accel/accel.sh@20 -- # val= 00:06:01.222 03:06:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.222 03:06:35 -- accel/accel.sh@19 -- # IFS=: 00:06:01.222 03:06:35 -- accel/accel.sh@19 -- # read -r var val 00:06:01.222 03:06:35 -- accel/accel.sh@20 -- # val= 00:06:01.222 03:06:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.222 03:06:35 -- accel/accel.sh@19 -- # IFS=: 00:06:01.222 03:06:35 -- accel/accel.sh@19 -- # read -r var val 00:06:01.222 03:06:35 -- accel/accel.sh@20 -- # val= 00:06:01.222 03:06:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.222 03:06:35 -- accel/accel.sh@19 -- # IFS=: 00:06:01.222 03:06:35 -- accel/accel.sh@19 -- # read -r var val 00:06:01.222 03:06:35 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:01.222 03:06:35 -- accel/accel.sh@27 -- # [[ -n compare ]] 00:06:01.222 03:06:35 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:01.222 00:06:01.222 real 0m1.361s 00:06:01.222 user 0m1.254s 00:06:01.222 sys 0m0.120s 00:06:01.222 03:06:35 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:01.222 03:06:35 -- common/autotest_common.sh@10 -- # set +x 00:06:01.222 ************************************ 00:06:01.222 END TEST accel_compare 00:06:01.222 ************************************ 00:06:01.222 03:06:35 -- accel/accel.sh@109 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:06:01.222 03:06:35 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:01.222 03:06:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:01.222 03:06:35 -- common/autotest_common.sh@10 -- # set +x 00:06:01.222 ************************************ 00:06:01.222 START TEST accel_xor 00:06:01.222 ************************************ 00:06:01.222 03:06:35 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w xor -y 00:06:01.222 03:06:35 -- accel/accel.sh@16 -- # local accel_opc 00:06:01.222 03:06:35 -- accel/accel.sh@17 -- # local accel_module 00:06:01.222 03:06:35 -- accel/accel.sh@19 -- # IFS=: 00:06:01.222 03:06:35 -- accel/accel.sh@19 -- # read -r var val 00:06:01.222 03:06:35 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:06:01.222 03:06:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:01.222 03:06:35 -- accel/accel.sh@12 -- # build_accel_config 00:06:01.222 03:06:35 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:01.222 03:06:35 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:01.222 03:06:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:01.222 03:06:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:01.222 03:06:35 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:01.222 03:06:35 -- accel/accel.sh@40 -- # local IFS=, 00:06:01.222 03:06:35 -- accel/accel.sh@41 -- # jq -r . 00:06:01.222 [2024-04-25 03:06:35.606637] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:06:01.222 [2024-04-25 03:06:35.606682] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3919094 ] 00:06:01.222 EAL: No free 2048 kB hugepages reported on node 1 00:06:01.222 [2024-04-25 03:06:35.665217] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:01.481 [2024-04-25 03:06:35.734794] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:01.481 03:06:35 -- accel/accel.sh@20 -- # val= 00:06:01.481 03:06:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # IFS=: 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # read -r var val 00:06:01.481 03:06:35 -- accel/accel.sh@20 -- # val= 00:06:01.481 03:06:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # IFS=: 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # read -r var val 00:06:01.481 03:06:35 -- accel/accel.sh@20 -- # val=0x1 00:06:01.481 03:06:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # IFS=: 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # read -r var val 00:06:01.481 03:06:35 -- accel/accel.sh@20 -- # val= 00:06:01.481 03:06:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # IFS=: 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # read -r var val 00:06:01.481 03:06:35 -- accel/accel.sh@20 -- # val= 00:06:01.481 03:06:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # IFS=: 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # read -r var val 00:06:01.481 03:06:35 -- accel/accel.sh@20 -- # val=xor 00:06:01.481 03:06:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.481 03:06:35 -- accel/accel.sh@23 -- # accel_opc=xor 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # IFS=: 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # read -r var val 00:06:01.481 03:06:35 -- accel/accel.sh@20 -- # val=2 00:06:01.481 03:06:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # IFS=: 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # read -r var val 00:06:01.481 03:06:35 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:01.481 03:06:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # IFS=: 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # read -r var val 00:06:01.481 03:06:35 -- accel/accel.sh@20 -- # val= 00:06:01.481 03:06:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # IFS=: 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # read -r var val 00:06:01.481 03:06:35 -- accel/accel.sh@20 -- # val=software 00:06:01.481 03:06:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.481 03:06:35 -- accel/accel.sh@22 -- # accel_module=software 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # IFS=: 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # read -r var val 00:06:01.481 03:06:35 -- accel/accel.sh@20 -- # val=32 00:06:01.481 03:06:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # IFS=: 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # read -r var val 00:06:01.481 03:06:35 -- accel/accel.sh@20 -- # val=32 00:06:01.481 03:06:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # IFS=: 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # read -r var val 00:06:01.481 03:06:35 -- accel/accel.sh@20 -- # val=1 00:06:01.481 03:06:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # IFS=: 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # read -r var val 00:06:01.481 03:06:35 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:01.481 03:06:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # IFS=: 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # read -r var val 00:06:01.481 03:06:35 -- accel/accel.sh@20 -- # val=Yes 00:06:01.481 03:06:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # IFS=: 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # read -r var val 00:06:01.481 03:06:35 -- accel/accel.sh@20 -- # val= 00:06:01.481 03:06:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # IFS=: 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # read -r var val 00:06:01.481 03:06:35 -- accel/accel.sh@20 -- # val= 00:06:01.481 03:06:35 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # IFS=: 00:06:01.481 03:06:35 -- accel/accel.sh@19 -- # read -r var val 00:06:02.858 03:06:36 -- accel/accel.sh@20 -- # val= 00:06:02.858 03:06:36 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.858 03:06:36 -- accel/accel.sh@19 -- # IFS=: 00:06:02.858 03:06:36 -- accel/accel.sh@19 -- # read -r var val 00:06:02.858 03:06:36 -- accel/accel.sh@20 -- # val= 00:06:02.858 03:06:36 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.858 03:06:36 -- accel/accel.sh@19 -- # IFS=: 00:06:02.858 03:06:36 -- accel/accel.sh@19 -- # read -r var val 00:06:02.858 03:06:36 -- accel/accel.sh@20 -- # val= 00:06:02.858 03:06:36 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.858 03:06:36 -- accel/accel.sh@19 -- # IFS=: 00:06:02.858 03:06:36 -- accel/accel.sh@19 -- # read -r var val 00:06:02.858 03:06:36 -- accel/accel.sh@20 -- # val= 00:06:02.858 03:06:36 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.858 03:06:36 -- accel/accel.sh@19 -- # IFS=: 00:06:02.858 03:06:36 -- accel/accel.sh@19 -- # read -r var val 00:06:02.858 03:06:36 -- accel/accel.sh@20 -- # val= 00:06:02.858 03:06:36 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.858 03:06:36 -- accel/accel.sh@19 -- # IFS=: 00:06:02.858 03:06:36 -- accel/accel.sh@19 -- # read -r var val 00:06:02.858 03:06:36 -- accel/accel.sh@20 -- # val= 00:06:02.858 03:06:36 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.858 03:06:36 -- accel/accel.sh@19 -- # IFS=: 00:06:02.858 03:06:36 -- accel/accel.sh@19 -- # read -r var val 00:06:02.858 03:06:36 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:02.858 03:06:36 -- accel/accel.sh@27 -- # [[ -n xor ]] 00:06:02.858 03:06:36 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:02.858 00:06:02.858 real 0m1.360s 00:06:02.858 user 0m1.253s 00:06:02.858 sys 0m0.119s 00:06:02.858 03:06:36 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:02.858 03:06:36 -- common/autotest_common.sh@10 -- # set +x 00:06:02.858 ************************************ 00:06:02.858 END TEST accel_xor 00:06:02.858 ************************************ 00:06:02.858 03:06:36 -- accel/accel.sh@110 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:06:02.858 03:06:36 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:02.858 03:06:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:02.858 03:06:36 -- common/autotest_common.sh@10 -- # set +x 00:06:02.858 ************************************ 00:06:02.858 START TEST accel_xor 00:06:02.858 ************************************ 00:06:02.858 03:06:37 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w xor -y -x 3 00:06:02.858 03:06:37 -- accel/accel.sh@16 -- # local accel_opc 00:06:02.858 03:06:37 -- accel/accel.sh@17 -- # local accel_module 00:06:02.858 03:06:37 -- accel/accel.sh@19 -- # IFS=: 00:06:02.858 03:06:37 -- accel/accel.sh@19 -- # read -r var val 00:06:02.858 03:06:37 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:06:02.858 03:06:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:02.858 03:06:37 -- accel/accel.sh@12 -- # build_accel_config 00:06:02.858 03:06:37 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:02.858 03:06:37 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:02.858 03:06:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:02.858 03:06:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:02.858 03:06:37 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:02.858 03:06:37 -- accel/accel.sh@40 -- # local IFS=, 00:06:02.858 03:06:37 -- accel/accel.sh@41 -- # jq -r . 00:06:02.858 [2024-04-25 03:06:37.122908] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:06:02.859 [2024-04-25 03:06:37.122952] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3919350 ] 00:06:02.859 EAL: No free 2048 kB hugepages reported on node 1 00:06:02.859 [2024-04-25 03:06:37.182121] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:02.859 [2024-04-25 03:06:37.250124] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.859 03:06:37 -- accel/accel.sh@20 -- # val= 00:06:02.859 03:06:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # IFS=: 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # read -r var val 00:06:02.859 03:06:37 -- accel/accel.sh@20 -- # val= 00:06:02.859 03:06:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # IFS=: 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # read -r var val 00:06:02.859 03:06:37 -- accel/accel.sh@20 -- # val=0x1 00:06:02.859 03:06:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # IFS=: 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # read -r var val 00:06:02.859 03:06:37 -- accel/accel.sh@20 -- # val= 00:06:02.859 03:06:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # IFS=: 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # read -r var val 00:06:02.859 03:06:37 -- accel/accel.sh@20 -- # val= 00:06:02.859 03:06:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # IFS=: 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # read -r var val 00:06:02.859 03:06:37 -- accel/accel.sh@20 -- # val=xor 00:06:02.859 03:06:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.859 03:06:37 -- accel/accel.sh@23 -- # accel_opc=xor 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # IFS=: 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # read -r var val 00:06:02.859 03:06:37 -- accel/accel.sh@20 -- # val=3 00:06:02.859 03:06:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # IFS=: 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # read -r var val 00:06:02.859 03:06:37 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:02.859 03:06:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # IFS=: 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # read -r var val 00:06:02.859 03:06:37 -- accel/accel.sh@20 -- # val= 00:06:02.859 03:06:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # IFS=: 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # read -r var val 00:06:02.859 03:06:37 -- accel/accel.sh@20 -- # val=software 00:06:02.859 03:06:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.859 03:06:37 -- accel/accel.sh@22 -- # accel_module=software 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # IFS=: 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # read -r var val 00:06:02.859 03:06:37 -- accel/accel.sh@20 -- # val=32 00:06:02.859 03:06:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # IFS=: 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # read -r var val 00:06:02.859 03:06:37 -- accel/accel.sh@20 -- # val=32 00:06:02.859 03:06:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # IFS=: 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # read -r var val 00:06:02.859 03:06:37 -- accel/accel.sh@20 -- # val=1 00:06:02.859 03:06:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # IFS=: 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # read -r var val 00:06:02.859 03:06:37 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:02.859 03:06:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # IFS=: 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # read -r var val 00:06:02.859 03:06:37 -- accel/accel.sh@20 -- # val=Yes 00:06:02.859 03:06:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # IFS=: 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # read -r var val 00:06:02.859 03:06:37 -- accel/accel.sh@20 -- # val= 00:06:02.859 03:06:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # IFS=: 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # read -r var val 00:06:02.859 03:06:37 -- accel/accel.sh@20 -- # val= 00:06:02.859 03:06:37 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # IFS=: 00:06:02.859 03:06:37 -- accel/accel.sh@19 -- # read -r var val 00:06:04.235 03:06:38 -- accel/accel.sh@20 -- # val= 00:06:04.235 03:06:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.235 03:06:38 -- accel/accel.sh@19 -- # IFS=: 00:06:04.235 03:06:38 -- accel/accel.sh@19 -- # read -r var val 00:06:04.235 03:06:38 -- accel/accel.sh@20 -- # val= 00:06:04.235 03:06:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.235 03:06:38 -- accel/accel.sh@19 -- # IFS=: 00:06:04.235 03:06:38 -- accel/accel.sh@19 -- # read -r var val 00:06:04.235 03:06:38 -- accel/accel.sh@20 -- # val= 00:06:04.235 03:06:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.235 03:06:38 -- accel/accel.sh@19 -- # IFS=: 00:06:04.235 03:06:38 -- accel/accel.sh@19 -- # read -r var val 00:06:04.235 03:06:38 -- accel/accel.sh@20 -- # val= 00:06:04.235 03:06:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.235 03:06:38 -- accel/accel.sh@19 -- # IFS=: 00:06:04.235 03:06:38 -- accel/accel.sh@19 -- # read -r var val 00:06:04.235 03:06:38 -- accel/accel.sh@20 -- # val= 00:06:04.235 03:06:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.235 03:06:38 -- accel/accel.sh@19 -- # IFS=: 00:06:04.235 03:06:38 -- accel/accel.sh@19 -- # read -r var val 00:06:04.235 03:06:38 -- accel/accel.sh@20 -- # val= 00:06:04.235 03:06:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.235 03:06:38 -- accel/accel.sh@19 -- # IFS=: 00:06:04.235 03:06:38 -- accel/accel.sh@19 -- # read -r var val 00:06:04.235 03:06:38 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:04.235 03:06:38 -- accel/accel.sh@27 -- # [[ -n xor ]] 00:06:04.235 03:06:38 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:04.235 00:06:04.235 real 0m1.353s 00:06:04.235 user 0m1.254s 00:06:04.235 sys 0m0.112s 00:06:04.235 03:06:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:04.235 03:06:38 -- common/autotest_common.sh@10 -- # set +x 00:06:04.235 ************************************ 00:06:04.235 END TEST accel_xor 00:06:04.235 ************************************ 00:06:04.235 03:06:38 -- accel/accel.sh@111 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:06:04.235 03:06:38 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:04.235 03:06:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:04.235 03:06:38 -- common/autotest_common.sh@10 -- # set +x 00:06:04.235 ************************************ 00:06:04.235 START TEST accel_dif_verify 00:06:04.235 ************************************ 00:06:04.235 03:06:38 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dif_verify 00:06:04.235 03:06:38 -- accel/accel.sh@16 -- # local accel_opc 00:06:04.235 03:06:38 -- accel/accel.sh@17 -- # local accel_module 00:06:04.235 03:06:38 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:06:04.235 03:06:38 -- accel/accel.sh@19 -- # IFS=: 00:06:04.235 03:06:38 -- accel/accel.sh@19 -- # read -r var val 00:06:04.235 03:06:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:04.235 03:06:38 -- accel/accel.sh@12 -- # build_accel_config 00:06:04.235 03:06:38 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:04.235 03:06:38 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:04.235 03:06:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:04.235 03:06:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:04.235 03:06:38 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:04.235 03:06:38 -- accel/accel.sh@40 -- # local IFS=, 00:06:04.235 03:06:38 -- accel/accel.sh@41 -- # jq -r . 00:06:04.235 [2024-04-25 03:06:38.609090] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:06:04.235 [2024-04-25 03:06:38.609127] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3919600 ] 00:06:04.235 EAL: No free 2048 kB hugepages reported on node 1 00:06:04.235 [2024-04-25 03:06:38.668092] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:04.494 [2024-04-25 03:06:38.737841] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:04.494 03:06:38 -- accel/accel.sh@20 -- # val= 00:06:04.494 03:06:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # IFS=: 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # read -r var val 00:06:04.494 03:06:38 -- accel/accel.sh@20 -- # val= 00:06:04.494 03:06:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # IFS=: 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # read -r var val 00:06:04.494 03:06:38 -- accel/accel.sh@20 -- # val=0x1 00:06:04.494 03:06:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # IFS=: 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # read -r var val 00:06:04.494 03:06:38 -- accel/accel.sh@20 -- # val= 00:06:04.494 03:06:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # IFS=: 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # read -r var val 00:06:04.494 03:06:38 -- accel/accel.sh@20 -- # val= 00:06:04.494 03:06:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # IFS=: 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # read -r var val 00:06:04.494 03:06:38 -- accel/accel.sh@20 -- # val=dif_verify 00:06:04.494 03:06:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.494 03:06:38 -- accel/accel.sh@23 -- # accel_opc=dif_verify 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # IFS=: 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # read -r var val 00:06:04.494 03:06:38 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:04.494 03:06:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # IFS=: 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # read -r var val 00:06:04.494 03:06:38 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:04.494 03:06:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # IFS=: 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # read -r var val 00:06:04.494 03:06:38 -- accel/accel.sh@20 -- # val='512 bytes' 00:06:04.494 03:06:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # IFS=: 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # read -r var val 00:06:04.494 03:06:38 -- accel/accel.sh@20 -- # val='8 bytes' 00:06:04.494 03:06:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # IFS=: 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # read -r var val 00:06:04.494 03:06:38 -- accel/accel.sh@20 -- # val= 00:06:04.494 03:06:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # IFS=: 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # read -r var val 00:06:04.494 03:06:38 -- accel/accel.sh@20 -- # val=software 00:06:04.494 03:06:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.494 03:06:38 -- accel/accel.sh@22 -- # accel_module=software 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # IFS=: 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # read -r var val 00:06:04.494 03:06:38 -- accel/accel.sh@20 -- # val=32 00:06:04.494 03:06:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # IFS=: 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # read -r var val 00:06:04.494 03:06:38 -- accel/accel.sh@20 -- # val=32 00:06:04.494 03:06:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # IFS=: 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # read -r var val 00:06:04.494 03:06:38 -- accel/accel.sh@20 -- # val=1 00:06:04.494 03:06:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # IFS=: 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # read -r var val 00:06:04.494 03:06:38 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:04.494 03:06:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # IFS=: 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # read -r var val 00:06:04.494 03:06:38 -- accel/accel.sh@20 -- # val=No 00:06:04.494 03:06:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # IFS=: 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # read -r var val 00:06:04.494 03:06:38 -- accel/accel.sh@20 -- # val= 00:06:04.494 03:06:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # IFS=: 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # read -r var val 00:06:04.494 03:06:38 -- accel/accel.sh@20 -- # val= 00:06:04.494 03:06:38 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # IFS=: 00:06:04.494 03:06:38 -- accel/accel.sh@19 -- # read -r var val 00:06:05.879 03:06:39 -- accel/accel.sh@20 -- # val= 00:06:05.879 03:06:39 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.879 03:06:39 -- accel/accel.sh@19 -- # IFS=: 00:06:05.879 03:06:39 -- accel/accel.sh@19 -- # read -r var val 00:06:05.879 03:06:39 -- accel/accel.sh@20 -- # val= 00:06:05.879 03:06:39 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.879 03:06:39 -- accel/accel.sh@19 -- # IFS=: 00:06:05.879 03:06:39 -- accel/accel.sh@19 -- # read -r var val 00:06:05.879 03:06:39 -- accel/accel.sh@20 -- # val= 00:06:05.879 03:06:39 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.879 03:06:39 -- accel/accel.sh@19 -- # IFS=: 00:06:05.879 03:06:39 -- accel/accel.sh@19 -- # read -r var val 00:06:05.879 03:06:39 -- accel/accel.sh@20 -- # val= 00:06:05.879 03:06:39 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.879 03:06:39 -- accel/accel.sh@19 -- # IFS=: 00:06:05.879 03:06:39 -- accel/accel.sh@19 -- # read -r var val 00:06:05.879 03:06:39 -- accel/accel.sh@20 -- # val= 00:06:05.879 03:06:39 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.879 03:06:39 -- accel/accel.sh@19 -- # IFS=: 00:06:05.879 03:06:39 -- accel/accel.sh@19 -- # read -r var val 00:06:05.879 03:06:39 -- accel/accel.sh@20 -- # val= 00:06:05.879 03:06:39 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.879 03:06:39 -- accel/accel.sh@19 -- # IFS=: 00:06:05.879 03:06:39 -- accel/accel.sh@19 -- # read -r var val 00:06:05.879 03:06:39 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:05.879 03:06:39 -- accel/accel.sh@27 -- # [[ -n dif_verify ]] 00:06:05.879 03:06:39 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:05.879 00:06:05.879 real 0m1.347s 00:06:05.879 user 0m1.246s 00:06:05.879 sys 0m0.113s 00:06:05.879 03:06:39 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:05.879 03:06:39 -- common/autotest_common.sh@10 -- # set +x 00:06:05.879 ************************************ 00:06:05.879 END TEST accel_dif_verify 00:06:05.879 ************************************ 00:06:05.879 03:06:39 -- accel/accel.sh@112 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:06:05.880 03:06:39 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:05.880 03:06:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:05.880 03:06:39 -- common/autotest_common.sh@10 -- # set +x 00:06:05.880 ************************************ 00:06:05.880 START TEST accel_dif_generate 00:06:05.880 ************************************ 00:06:05.880 03:06:40 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dif_generate 00:06:05.880 03:06:40 -- accel/accel.sh@16 -- # local accel_opc 00:06:05.880 03:06:40 -- accel/accel.sh@17 -- # local accel_module 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # IFS=: 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # read -r var val 00:06:05.880 03:06:40 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:06:05.880 03:06:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:05.880 03:06:40 -- accel/accel.sh@12 -- # build_accel_config 00:06:05.880 03:06:40 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:05.880 03:06:40 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:05.880 03:06:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:05.880 03:06:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:05.880 03:06:40 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:05.880 03:06:40 -- accel/accel.sh@40 -- # local IFS=, 00:06:05.880 03:06:40 -- accel/accel.sh@41 -- # jq -r . 00:06:05.880 [2024-04-25 03:06:40.127319] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:06:05.880 [2024-04-25 03:06:40.127371] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3919859 ] 00:06:05.880 EAL: No free 2048 kB hugepages reported on node 1 00:06:05.880 [2024-04-25 03:06:40.190197] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:05.880 [2024-04-25 03:06:40.262818] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:05.880 03:06:40 -- accel/accel.sh@20 -- # val= 00:06:05.880 03:06:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # IFS=: 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # read -r var val 00:06:05.880 03:06:40 -- accel/accel.sh@20 -- # val= 00:06:05.880 03:06:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # IFS=: 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # read -r var val 00:06:05.880 03:06:40 -- accel/accel.sh@20 -- # val=0x1 00:06:05.880 03:06:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # IFS=: 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # read -r var val 00:06:05.880 03:06:40 -- accel/accel.sh@20 -- # val= 00:06:05.880 03:06:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # IFS=: 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # read -r var val 00:06:05.880 03:06:40 -- accel/accel.sh@20 -- # val= 00:06:05.880 03:06:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # IFS=: 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # read -r var val 00:06:05.880 03:06:40 -- accel/accel.sh@20 -- # val=dif_generate 00:06:05.880 03:06:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.880 03:06:40 -- accel/accel.sh@23 -- # accel_opc=dif_generate 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # IFS=: 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # read -r var val 00:06:05.880 03:06:40 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:05.880 03:06:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # IFS=: 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # read -r var val 00:06:05.880 03:06:40 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:05.880 03:06:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # IFS=: 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # read -r var val 00:06:05.880 03:06:40 -- accel/accel.sh@20 -- # val='512 bytes' 00:06:05.880 03:06:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # IFS=: 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # read -r var val 00:06:05.880 03:06:40 -- accel/accel.sh@20 -- # val='8 bytes' 00:06:05.880 03:06:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # IFS=: 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # read -r var val 00:06:05.880 03:06:40 -- accel/accel.sh@20 -- # val= 00:06:05.880 03:06:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # IFS=: 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # read -r var val 00:06:05.880 03:06:40 -- accel/accel.sh@20 -- # val=software 00:06:05.880 03:06:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.880 03:06:40 -- accel/accel.sh@22 -- # accel_module=software 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # IFS=: 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # read -r var val 00:06:05.880 03:06:40 -- accel/accel.sh@20 -- # val=32 00:06:05.880 03:06:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # IFS=: 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # read -r var val 00:06:05.880 03:06:40 -- accel/accel.sh@20 -- # val=32 00:06:05.880 03:06:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # IFS=: 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # read -r var val 00:06:05.880 03:06:40 -- accel/accel.sh@20 -- # val=1 00:06:05.880 03:06:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # IFS=: 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # read -r var val 00:06:05.880 03:06:40 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:05.880 03:06:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # IFS=: 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # read -r var val 00:06:05.880 03:06:40 -- accel/accel.sh@20 -- # val=No 00:06:05.880 03:06:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # IFS=: 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # read -r var val 00:06:05.880 03:06:40 -- accel/accel.sh@20 -- # val= 00:06:05.880 03:06:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # IFS=: 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # read -r var val 00:06:05.880 03:06:40 -- accel/accel.sh@20 -- # val= 00:06:05.880 03:06:40 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # IFS=: 00:06:05.880 03:06:40 -- accel/accel.sh@19 -- # read -r var val 00:06:07.269 03:06:41 -- accel/accel.sh@20 -- # val= 00:06:07.269 03:06:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.269 03:06:41 -- accel/accel.sh@19 -- # IFS=: 00:06:07.269 03:06:41 -- accel/accel.sh@19 -- # read -r var val 00:06:07.269 03:06:41 -- accel/accel.sh@20 -- # val= 00:06:07.269 03:06:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.269 03:06:41 -- accel/accel.sh@19 -- # IFS=: 00:06:07.269 03:06:41 -- accel/accel.sh@19 -- # read -r var val 00:06:07.269 03:06:41 -- accel/accel.sh@20 -- # val= 00:06:07.269 03:06:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.269 03:06:41 -- accel/accel.sh@19 -- # IFS=: 00:06:07.269 03:06:41 -- accel/accel.sh@19 -- # read -r var val 00:06:07.269 03:06:41 -- accel/accel.sh@20 -- # val= 00:06:07.269 03:06:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.269 03:06:41 -- accel/accel.sh@19 -- # IFS=: 00:06:07.269 03:06:41 -- accel/accel.sh@19 -- # read -r var val 00:06:07.269 03:06:41 -- accel/accel.sh@20 -- # val= 00:06:07.269 03:06:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.269 03:06:41 -- accel/accel.sh@19 -- # IFS=: 00:06:07.269 03:06:41 -- accel/accel.sh@19 -- # read -r var val 00:06:07.269 03:06:41 -- accel/accel.sh@20 -- # val= 00:06:07.269 03:06:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.269 03:06:41 -- accel/accel.sh@19 -- # IFS=: 00:06:07.269 03:06:41 -- accel/accel.sh@19 -- # read -r var val 00:06:07.269 03:06:41 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:07.269 03:06:41 -- accel/accel.sh@27 -- # [[ -n dif_generate ]] 00:06:07.269 03:06:41 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:07.269 00:06:07.269 real 0m1.362s 00:06:07.269 user 0m1.259s 00:06:07.269 sys 0m0.117s 00:06:07.269 03:06:41 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:07.269 03:06:41 -- common/autotest_common.sh@10 -- # set +x 00:06:07.269 ************************************ 00:06:07.269 END TEST accel_dif_generate 00:06:07.269 ************************************ 00:06:07.269 03:06:41 -- accel/accel.sh@113 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:06:07.269 03:06:41 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:07.269 03:06:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:07.269 03:06:41 -- common/autotest_common.sh@10 -- # set +x 00:06:07.269 ************************************ 00:06:07.269 START TEST accel_dif_generate_copy 00:06:07.269 ************************************ 00:06:07.269 03:06:41 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dif_generate_copy 00:06:07.269 03:06:41 -- accel/accel.sh@16 -- # local accel_opc 00:06:07.269 03:06:41 -- accel/accel.sh@17 -- # local accel_module 00:06:07.269 03:06:41 -- accel/accel.sh@19 -- # IFS=: 00:06:07.269 03:06:41 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:06:07.269 03:06:41 -- accel/accel.sh@19 -- # read -r var val 00:06:07.269 03:06:41 -- accel/accel.sh@12 -- # build_accel_config 00:06:07.269 03:06:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:07.269 03:06:41 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:07.269 03:06:41 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:07.269 03:06:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:07.269 03:06:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:07.269 03:06:41 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:07.269 03:06:41 -- accel/accel.sh@40 -- # local IFS=, 00:06:07.269 03:06:41 -- accel/accel.sh@41 -- # jq -r . 00:06:07.269 [2024-04-25 03:06:41.628677] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:06:07.269 [2024-04-25 03:06:41.628731] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3920111 ] 00:06:07.269 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.269 [2024-04-25 03:06:41.689345] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:07.269 [2024-04-25 03:06:41.759315] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:07.527 03:06:41 -- accel/accel.sh@20 -- # val= 00:06:07.527 03:06:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # IFS=: 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # read -r var val 00:06:07.527 03:06:41 -- accel/accel.sh@20 -- # val= 00:06:07.527 03:06:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # IFS=: 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # read -r var val 00:06:07.527 03:06:41 -- accel/accel.sh@20 -- # val=0x1 00:06:07.527 03:06:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # IFS=: 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # read -r var val 00:06:07.527 03:06:41 -- accel/accel.sh@20 -- # val= 00:06:07.527 03:06:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # IFS=: 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # read -r var val 00:06:07.527 03:06:41 -- accel/accel.sh@20 -- # val= 00:06:07.527 03:06:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # IFS=: 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # read -r var val 00:06:07.527 03:06:41 -- accel/accel.sh@20 -- # val=dif_generate_copy 00:06:07.527 03:06:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.527 03:06:41 -- accel/accel.sh@23 -- # accel_opc=dif_generate_copy 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # IFS=: 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # read -r var val 00:06:07.527 03:06:41 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:07.527 03:06:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # IFS=: 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # read -r var val 00:06:07.527 03:06:41 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:07.527 03:06:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # IFS=: 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # read -r var val 00:06:07.527 03:06:41 -- accel/accel.sh@20 -- # val= 00:06:07.527 03:06:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # IFS=: 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # read -r var val 00:06:07.527 03:06:41 -- accel/accel.sh@20 -- # val=software 00:06:07.527 03:06:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.527 03:06:41 -- accel/accel.sh@22 -- # accel_module=software 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # IFS=: 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # read -r var val 00:06:07.527 03:06:41 -- accel/accel.sh@20 -- # val=32 00:06:07.527 03:06:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # IFS=: 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # read -r var val 00:06:07.527 03:06:41 -- accel/accel.sh@20 -- # val=32 00:06:07.527 03:06:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # IFS=: 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # read -r var val 00:06:07.527 03:06:41 -- accel/accel.sh@20 -- # val=1 00:06:07.527 03:06:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # IFS=: 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # read -r var val 00:06:07.527 03:06:41 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:07.527 03:06:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # IFS=: 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # read -r var val 00:06:07.527 03:06:41 -- accel/accel.sh@20 -- # val=No 00:06:07.527 03:06:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # IFS=: 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # read -r var val 00:06:07.527 03:06:41 -- accel/accel.sh@20 -- # val= 00:06:07.527 03:06:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # IFS=: 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # read -r var val 00:06:07.527 03:06:41 -- accel/accel.sh@20 -- # val= 00:06:07.527 03:06:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # IFS=: 00:06:07.527 03:06:41 -- accel/accel.sh@19 -- # read -r var val 00:06:08.458 03:06:42 -- accel/accel.sh@20 -- # val= 00:06:08.458 03:06:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.458 03:06:42 -- accel/accel.sh@19 -- # IFS=: 00:06:08.458 03:06:42 -- accel/accel.sh@19 -- # read -r var val 00:06:08.458 03:06:42 -- accel/accel.sh@20 -- # val= 00:06:08.459 03:06:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.459 03:06:42 -- accel/accel.sh@19 -- # IFS=: 00:06:08.459 03:06:42 -- accel/accel.sh@19 -- # read -r var val 00:06:08.459 03:06:42 -- accel/accel.sh@20 -- # val= 00:06:08.459 03:06:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.459 03:06:42 -- accel/accel.sh@19 -- # IFS=: 00:06:08.459 03:06:42 -- accel/accel.sh@19 -- # read -r var val 00:06:08.459 03:06:42 -- accel/accel.sh@20 -- # val= 00:06:08.459 03:06:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.459 03:06:42 -- accel/accel.sh@19 -- # IFS=: 00:06:08.459 03:06:42 -- accel/accel.sh@19 -- # read -r var val 00:06:08.459 03:06:42 -- accel/accel.sh@20 -- # val= 00:06:08.459 03:06:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.459 03:06:42 -- accel/accel.sh@19 -- # IFS=: 00:06:08.459 03:06:42 -- accel/accel.sh@19 -- # read -r var val 00:06:08.459 03:06:42 -- accel/accel.sh@20 -- # val= 00:06:08.459 03:06:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.459 03:06:42 -- accel/accel.sh@19 -- # IFS=: 00:06:08.459 03:06:42 -- accel/accel.sh@19 -- # read -r var val 00:06:08.459 03:06:42 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:08.716 03:06:42 -- accel/accel.sh@27 -- # [[ -n dif_generate_copy ]] 00:06:08.716 03:06:42 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:08.716 00:06:08.716 real 0m1.351s 00:06:08.716 user 0m1.249s 00:06:08.716 sys 0m0.115s 00:06:08.716 03:06:42 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:08.716 03:06:42 -- common/autotest_common.sh@10 -- # set +x 00:06:08.716 ************************************ 00:06:08.716 END TEST accel_dif_generate_copy 00:06:08.716 ************************************ 00:06:08.716 03:06:42 -- accel/accel.sh@115 -- # [[ y == y ]] 00:06:08.716 03:06:42 -- accel/accel.sh@116 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib 00:06:08.716 03:06:42 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:08.716 03:06:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:08.716 03:06:42 -- common/autotest_common.sh@10 -- # set +x 00:06:08.716 ************************************ 00:06:08.716 START TEST accel_comp 00:06:08.716 ************************************ 00:06:08.716 03:06:43 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib 00:06:08.716 03:06:43 -- accel/accel.sh@16 -- # local accel_opc 00:06:08.716 03:06:43 -- accel/accel.sh@17 -- # local accel_module 00:06:08.716 03:06:43 -- accel/accel.sh@19 -- # IFS=: 00:06:08.716 03:06:43 -- accel/accel.sh@19 -- # read -r var val 00:06:08.716 03:06:43 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib 00:06:08.716 03:06:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib 00:06:08.716 03:06:43 -- accel/accel.sh@12 -- # build_accel_config 00:06:08.716 03:06:43 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:08.716 03:06:43 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:08.716 03:06:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:08.716 03:06:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:08.716 03:06:43 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:08.716 03:06:43 -- accel/accel.sh@40 -- # local IFS=, 00:06:08.716 03:06:43 -- accel/accel.sh@41 -- # jq -r . 00:06:08.716 [2024-04-25 03:06:43.138468] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:06:08.716 [2024-04-25 03:06:43.138542] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3920371 ] 00:06:08.716 EAL: No free 2048 kB hugepages reported on node 1 00:06:08.716 [2024-04-25 03:06:43.197023] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:08.974 [2024-04-25 03:06:43.266623] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.974 03:06:43 -- accel/accel.sh@20 -- # val= 00:06:08.974 03:06:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.974 03:06:43 -- accel/accel.sh@19 -- # IFS=: 00:06:08.974 03:06:43 -- accel/accel.sh@19 -- # read -r var val 00:06:08.974 03:06:43 -- accel/accel.sh@20 -- # val= 00:06:08.974 03:06:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.974 03:06:43 -- accel/accel.sh@19 -- # IFS=: 00:06:08.974 03:06:43 -- accel/accel.sh@19 -- # read -r var val 00:06:08.974 03:06:43 -- accel/accel.sh@20 -- # val= 00:06:08.974 03:06:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.974 03:06:43 -- accel/accel.sh@19 -- # IFS=: 00:06:08.974 03:06:43 -- accel/accel.sh@19 -- # read -r var val 00:06:08.974 03:06:43 -- accel/accel.sh@20 -- # val=0x1 00:06:08.974 03:06:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.974 03:06:43 -- accel/accel.sh@19 -- # IFS=: 00:06:08.974 03:06:43 -- accel/accel.sh@19 -- # read -r var val 00:06:08.974 03:06:43 -- accel/accel.sh@20 -- # val= 00:06:08.974 03:06:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.974 03:06:43 -- accel/accel.sh@19 -- # IFS=: 00:06:08.974 03:06:43 -- accel/accel.sh@19 -- # read -r var val 00:06:08.974 03:06:43 -- accel/accel.sh@20 -- # val= 00:06:08.974 03:06:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.974 03:06:43 -- accel/accel.sh@19 -- # IFS=: 00:06:08.974 03:06:43 -- accel/accel.sh@19 -- # read -r var val 00:06:08.974 03:06:43 -- accel/accel.sh@20 -- # val=compress 00:06:08.974 03:06:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.974 03:06:43 -- accel/accel.sh@23 -- # accel_opc=compress 00:06:08.974 03:06:43 -- accel/accel.sh@19 -- # IFS=: 00:06:08.974 03:06:43 -- accel/accel.sh@19 -- # read -r var val 00:06:08.974 03:06:43 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:08.974 03:06:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.974 03:06:43 -- accel/accel.sh@19 -- # IFS=: 00:06:08.974 03:06:43 -- accel/accel.sh@19 -- # read -r var val 00:06:08.974 03:06:43 -- accel/accel.sh@20 -- # val= 00:06:08.974 03:06:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.974 03:06:43 -- accel/accel.sh@19 -- # IFS=: 00:06:08.974 03:06:43 -- accel/accel.sh@19 -- # read -r var val 00:06:08.974 03:06:43 -- accel/accel.sh@20 -- # val=software 00:06:08.974 03:06:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.974 03:06:43 -- accel/accel.sh@22 -- # accel_module=software 00:06:08.974 03:06:43 -- accel/accel.sh@19 -- # IFS=: 00:06:08.974 03:06:43 -- accel/accel.sh@19 -- # read -r var val 00:06:08.974 03:06:43 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib 00:06:08.975 03:06:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.975 03:06:43 -- accel/accel.sh@19 -- # IFS=: 00:06:08.975 03:06:43 -- accel/accel.sh@19 -- # read -r var val 00:06:08.975 03:06:43 -- accel/accel.sh@20 -- # val=32 00:06:08.975 03:06:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.975 03:06:43 -- accel/accel.sh@19 -- # IFS=: 00:06:08.975 03:06:43 -- accel/accel.sh@19 -- # read -r var val 00:06:08.975 03:06:43 -- accel/accel.sh@20 -- # val=32 00:06:08.975 03:06:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.975 03:06:43 -- accel/accel.sh@19 -- # IFS=: 00:06:08.975 03:06:43 -- accel/accel.sh@19 -- # read -r var val 00:06:08.975 03:06:43 -- accel/accel.sh@20 -- # val=1 00:06:08.975 03:06:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.975 03:06:43 -- accel/accel.sh@19 -- # IFS=: 00:06:08.975 03:06:43 -- accel/accel.sh@19 -- # read -r var val 00:06:08.975 03:06:43 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:08.975 03:06:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.975 03:06:43 -- accel/accel.sh@19 -- # IFS=: 00:06:08.975 03:06:43 -- accel/accel.sh@19 -- # read -r var val 00:06:08.975 03:06:43 -- accel/accel.sh@20 -- # val=No 00:06:08.975 03:06:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.975 03:06:43 -- accel/accel.sh@19 -- # IFS=: 00:06:08.975 03:06:43 -- accel/accel.sh@19 -- # read -r var val 00:06:08.975 03:06:43 -- accel/accel.sh@20 -- # val= 00:06:08.975 03:06:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.975 03:06:43 -- accel/accel.sh@19 -- # IFS=: 00:06:08.975 03:06:43 -- accel/accel.sh@19 -- # read -r var val 00:06:08.975 03:06:43 -- accel/accel.sh@20 -- # val= 00:06:08.975 03:06:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.975 03:06:43 -- accel/accel.sh@19 -- # IFS=: 00:06:08.975 03:06:43 -- accel/accel.sh@19 -- # read -r var val 00:06:10.348 03:06:44 -- accel/accel.sh@20 -- # val= 00:06:10.348 03:06:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.348 03:06:44 -- accel/accel.sh@19 -- # IFS=: 00:06:10.348 03:06:44 -- accel/accel.sh@19 -- # read -r var val 00:06:10.348 03:06:44 -- accel/accel.sh@20 -- # val= 00:06:10.348 03:06:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.348 03:06:44 -- accel/accel.sh@19 -- # IFS=: 00:06:10.348 03:06:44 -- accel/accel.sh@19 -- # read -r var val 00:06:10.348 03:06:44 -- accel/accel.sh@20 -- # val= 00:06:10.348 03:06:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.348 03:06:44 -- accel/accel.sh@19 -- # IFS=: 00:06:10.348 03:06:44 -- accel/accel.sh@19 -- # read -r var val 00:06:10.348 03:06:44 -- accel/accel.sh@20 -- # val= 00:06:10.348 03:06:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.348 03:06:44 -- accel/accel.sh@19 -- # IFS=: 00:06:10.348 03:06:44 -- accel/accel.sh@19 -- # read -r var val 00:06:10.348 03:06:44 -- accel/accel.sh@20 -- # val= 00:06:10.348 03:06:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.348 03:06:44 -- accel/accel.sh@19 -- # IFS=: 00:06:10.348 03:06:44 -- accel/accel.sh@19 -- # read -r var val 00:06:10.348 03:06:44 -- accel/accel.sh@20 -- # val= 00:06:10.348 03:06:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.348 03:06:44 -- accel/accel.sh@19 -- # IFS=: 00:06:10.348 03:06:44 -- accel/accel.sh@19 -- # read -r var val 00:06:10.348 03:06:44 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:10.348 03:06:44 -- accel/accel.sh@27 -- # [[ -n compress ]] 00:06:10.348 03:06:44 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:10.348 00:06:10.348 real 0m1.355s 00:06:10.348 user 0m1.253s 00:06:10.348 sys 0m0.114s 00:06:10.348 03:06:44 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:10.348 03:06:44 -- common/autotest_common.sh@10 -- # set +x 00:06:10.348 ************************************ 00:06:10.348 END TEST accel_comp 00:06:10.348 ************************************ 00:06:10.348 03:06:44 -- accel/accel.sh@117 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y 00:06:10.348 03:06:44 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:10.348 03:06:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:10.348 03:06:44 -- common/autotest_common.sh@10 -- # set +x 00:06:10.348 ************************************ 00:06:10.348 START TEST accel_decomp 00:06:10.348 ************************************ 00:06:10.348 03:06:44 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y 00:06:10.348 03:06:44 -- accel/accel.sh@16 -- # local accel_opc 00:06:10.348 03:06:44 -- accel/accel.sh@17 -- # local accel_module 00:06:10.348 03:06:44 -- accel/accel.sh@19 -- # IFS=: 00:06:10.348 03:06:44 -- accel/accel.sh@19 -- # read -r var val 00:06:10.348 03:06:44 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y 00:06:10.348 03:06:44 -- accel/accel.sh@12 -- # build_accel_config 00:06:10.348 03:06:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y 00:06:10.348 03:06:44 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:10.348 03:06:44 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:10.348 03:06:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:10.348 03:06:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:10.348 03:06:44 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:10.348 03:06:44 -- accel/accel.sh@40 -- # local IFS=, 00:06:10.349 03:06:44 -- accel/accel.sh@41 -- # jq -r . 00:06:10.349 [2024-04-25 03:06:44.647316] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:06:10.349 [2024-04-25 03:06:44.647372] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3920624 ] 00:06:10.349 EAL: No free 2048 kB hugepages reported on node 1 00:06:10.349 [2024-04-25 03:06:44.709806] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:10.349 [2024-04-25 03:06:44.779011] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:10.349 03:06:44 -- accel/accel.sh@20 -- # val= 00:06:10.349 03:06:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # IFS=: 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # read -r var val 00:06:10.349 03:06:44 -- accel/accel.sh@20 -- # val= 00:06:10.349 03:06:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # IFS=: 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # read -r var val 00:06:10.349 03:06:44 -- accel/accel.sh@20 -- # val= 00:06:10.349 03:06:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # IFS=: 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # read -r var val 00:06:10.349 03:06:44 -- accel/accel.sh@20 -- # val=0x1 00:06:10.349 03:06:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # IFS=: 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # read -r var val 00:06:10.349 03:06:44 -- accel/accel.sh@20 -- # val= 00:06:10.349 03:06:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # IFS=: 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # read -r var val 00:06:10.349 03:06:44 -- accel/accel.sh@20 -- # val= 00:06:10.349 03:06:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # IFS=: 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # read -r var val 00:06:10.349 03:06:44 -- accel/accel.sh@20 -- # val=decompress 00:06:10.349 03:06:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.349 03:06:44 -- accel/accel.sh@23 -- # accel_opc=decompress 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # IFS=: 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # read -r var val 00:06:10.349 03:06:44 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:10.349 03:06:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # IFS=: 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # read -r var val 00:06:10.349 03:06:44 -- accel/accel.sh@20 -- # val= 00:06:10.349 03:06:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # IFS=: 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # read -r var val 00:06:10.349 03:06:44 -- accel/accel.sh@20 -- # val=software 00:06:10.349 03:06:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.349 03:06:44 -- accel/accel.sh@22 -- # accel_module=software 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # IFS=: 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # read -r var val 00:06:10.349 03:06:44 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib 00:06:10.349 03:06:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # IFS=: 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # read -r var val 00:06:10.349 03:06:44 -- accel/accel.sh@20 -- # val=32 00:06:10.349 03:06:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # IFS=: 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # read -r var val 00:06:10.349 03:06:44 -- accel/accel.sh@20 -- # val=32 00:06:10.349 03:06:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # IFS=: 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # read -r var val 00:06:10.349 03:06:44 -- accel/accel.sh@20 -- # val=1 00:06:10.349 03:06:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # IFS=: 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # read -r var val 00:06:10.349 03:06:44 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:10.349 03:06:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # IFS=: 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # read -r var val 00:06:10.349 03:06:44 -- accel/accel.sh@20 -- # val=Yes 00:06:10.349 03:06:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # IFS=: 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # read -r var val 00:06:10.349 03:06:44 -- accel/accel.sh@20 -- # val= 00:06:10.349 03:06:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # IFS=: 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # read -r var val 00:06:10.349 03:06:44 -- accel/accel.sh@20 -- # val= 00:06:10.349 03:06:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # IFS=: 00:06:10.349 03:06:44 -- accel/accel.sh@19 -- # read -r var val 00:06:11.726 03:06:45 -- accel/accel.sh@20 -- # val= 00:06:11.726 03:06:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.726 03:06:45 -- accel/accel.sh@19 -- # IFS=: 00:06:11.726 03:06:45 -- accel/accel.sh@19 -- # read -r var val 00:06:11.726 03:06:45 -- accel/accel.sh@20 -- # val= 00:06:11.726 03:06:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.726 03:06:45 -- accel/accel.sh@19 -- # IFS=: 00:06:11.726 03:06:45 -- accel/accel.sh@19 -- # read -r var val 00:06:11.726 03:06:45 -- accel/accel.sh@20 -- # val= 00:06:11.726 03:06:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.726 03:06:45 -- accel/accel.sh@19 -- # IFS=: 00:06:11.726 03:06:45 -- accel/accel.sh@19 -- # read -r var val 00:06:11.726 03:06:45 -- accel/accel.sh@20 -- # val= 00:06:11.726 03:06:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.726 03:06:45 -- accel/accel.sh@19 -- # IFS=: 00:06:11.726 03:06:45 -- accel/accel.sh@19 -- # read -r var val 00:06:11.726 03:06:45 -- accel/accel.sh@20 -- # val= 00:06:11.726 03:06:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.726 03:06:45 -- accel/accel.sh@19 -- # IFS=: 00:06:11.726 03:06:45 -- accel/accel.sh@19 -- # read -r var val 00:06:11.726 03:06:45 -- accel/accel.sh@20 -- # val= 00:06:11.726 03:06:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.726 03:06:45 -- accel/accel.sh@19 -- # IFS=: 00:06:11.726 03:06:45 -- accel/accel.sh@19 -- # read -r var val 00:06:11.726 03:06:45 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:11.726 03:06:45 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:06:11.726 03:06:45 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:11.726 00:06:11.726 real 0m1.361s 00:06:11.726 user 0m1.259s 00:06:11.726 sys 0m0.115s 00:06:11.726 03:06:45 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:11.726 03:06:45 -- common/autotest_common.sh@10 -- # set +x 00:06:11.726 ************************************ 00:06:11.726 END TEST accel_decomp 00:06:11.726 ************************************ 00:06:11.726 03:06:46 -- accel/accel.sh@118 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:11.726 03:06:46 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:11.726 03:06:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:11.726 03:06:46 -- common/autotest_common.sh@10 -- # set +x 00:06:11.726 ************************************ 00:06:11.726 START TEST accel_decmop_full 00:06:11.726 ************************************ 00:06:11.726 03:06:46 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:11.726 03:06:46 -- accel/accel.sh@16 -- # local accel_opc 00:06:11.726 03:06:46 -- accel/accel.sh@17 -- # local accel_module 00:06:11.726 03:06:46 -- accel/accel.sh@19 -- # IFS=: 00:06:11.726 03:06:46 -- accel/accel.sh@19 -- # read -r var val 00:06:11.726 03:06:46 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:11.726 03:06:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:11.726 03:06:46 -- accel/accel.sh@12 -- # build_accel_config 00:06:11.726 03:06:46 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:11.726 03:06:46 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:11.726 03:06:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:11.726 03:06:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:11.726 03:06:46 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:11.726 03:06:46 -- accel/accel.sh@40 -- # local IFS=, 00:06:11.726 03:06:46 -- accel/accel.sh@41 -- # jq -r . 00:06:11.726 [2024-04-25 03:06:46.161965] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:06:11.726 [2024-04-25 03:06:46.162009] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3920888 ] 00:06:11.726 EAL: No free 2048 kB hugepages reported on node 1 00:06:11.726 [2024-04-25 03:06:46.215305] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:11.984 [2024-04-25 03:06:46.287430] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.984 03:06:46 -- accel/accel.sh@20 -- # val= 00:06:11.984 03:06:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.984 03:06:46 -- accel/accel.sh@19 -- # IFS=: 00:06:11.984 03:06:46 -- accel/accel.sh@19 -- # read -r var val 00:06:11.984 03:06:46 -- accel/accel.sh@20 -- # val= 00:06:11.984 03:06:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.984 03:06:46 -- accel/accel.sh@19 -- # IFS=: 00:06:11.984 03:06:46 -- accel/accel.sh@19 -- # read -r var val 00:06:11.984 03:06:46 -- accel/accel.sh@20 -- # val= 00:06:11.984 03:06:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.984 03:06:46 -- accel/accel.sh@19 -- # IFS=: 00:06:11.984 03:06:46 -- accel/accel.sh@19 -- # read -r var val 00:06:11.984 03:06:46 -- accel/accel.sh@20 -- # val=0x1 00:06:11.984 03:06:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.984 03:06:46 -- accel/accel.sh@19 -- # IFS=: 00:06:11.984 03:06:46 -- accel/accel.sh@19 -- # read -r var val 00:06:11.984 03:06:46 -- accel/accel.sh@20 -- # val= 00:06:11.984 03:06:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.984 03:06:46 -- accel/accel.sh@19 -- # IFS=: 00:06:11.984 03:06:46 -- accel/accel.sh@19 -- # read -r var val 00:06:11.984 03:06:46 -- accel/accel.sh@20 -- # val= 00:06:11.984 03:06:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.984 03:06:46 -- accel/accel.sh@19 -- # IFS=: 00:06:11.984 03:06:46 -- accel/accel.sh@19 -- # read -r var val 00:06:11.984 03:06:46 -- accel/accel.sh@20 -- # val=decompress 00:06:11.984 03:06:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.984 03:06:46 -- accel/accel.sh@23 -- # accel_opc=decompress 00:06:11.984 03:06:46 -- accel/accel.sh@19 -- # IFS=: 00:06:11.984 03:06:46 -- accel/accel.sh@19 -- # read -r var val 00:06:11.984 03:06:46 -- accel/accel.sh@20 -- # val='111250 bytes' 00:06:11.984 03:06:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.984 03:06:46 -- accel/accel.sh@19 -- # IFS=: 00:06:11.984 03:06:46 -- accel/accel.sh@19 -- # read -r var val 00:06:11.984 03:06:46 -- accel/accel.sh@20 -- # val= 00:06:11.984 03:06:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.984 03:06:46 -- accel/accel.sh@19 -- # IFS=: 00:06:11.984 03:06:46 -- accel/accel.sh@19 -- # read -r var val 00:06:11.985 03:06:46 -- accel/accel.sh@20 -- # val=software 00:06:11.985 03:06:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.985 03:06:46 -- accel/accel.sh@22 -- # accel_module=software 00:06:11.985 03:06:46 -- accel/accel.sh@19 -- # IFS=: 00:06:11.985 03:06:46 -- accel/accel.sh@19 -- # read -r var val 00:06:11.985 03:06:46 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib 00:06:11.985 03:06:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.985 03:06:46 -- accel/accel.sh@19 -- # IFS=: 00:06:11.985 03:06:46 -- accel/accel.sh@19 -- # read -r var val 00:06:11.985 03:06:46 -- accel/accel.sh@20 -- # val=32 00:06:11.985 03:06:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.985 03:06:46 -- accel/accel.sh@19 -- # IFS=: 00:06:11.985 03:06:46 -- accel/accel.sh@19 -- # read -r var val 00:06:11.985 03:06:46 -- accel/accel.sh@20 -- # val=32 00:06:11.985 03:06:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.985 03:06:46 -- accel/accel.sh@19 -- # IFS=: 00:06:11.985 03:06:46 -- accel/accel.sh@19 -- # read -r var val 00:06:11.985 03:06:46 -- accel/accel.sh@20 -- # val=1 00:06:11.985 03:06:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.985 03:06:46 -- accel/accel.sh@19 -- # IFS=: 00:06:11.985 03:06:46 -- accel/accel.sh@19 -- # read -r var val 00:06:11.985 03:06:46 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:11.985 03:06:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.985 03:06:46 -- accel/accel.sh@19 -- # IFS=: 00:06:11.985 03:06:46 -- accel/accel.sh@19 -- # read -r var val 00:06:11.985 03:06:46 -- accel/accel.sh@20 -- # val=Yes 00:06:11.985 03:06:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.985 03:06:46 -- accel/accel.sh@19 -- # IFS=: 00:06:11.985 03:06:46 -- accel/accel.sh@19 -- # read -r var val 00:06:11.985 03:06:46 -- accel/accel.sh@20 -- # val= 00:06:11.985 03:06:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.985 03:06:46 -- accel/accel.sh@19 -- # IFS=: 00:06:11.985 03:06:46 -- accel/accel.sh@19 -- # read -r var val 00:06:11.985 03:06:46 -- accel/accel.sh@20 -- # val= 00:06:11.985 03:06:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.985 03:06:46 -- accel/accel.sh@19 -- # IFS=: 00:06:11.985 03:06:46 -- accel/accel.sh@19 -- # read -r var val 00:06:13.360 03:06:47 -- accel/accel.sh@20 -- # val= 00:06:13.360 03:06:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # IFS=: 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # read -r var val 00:06:13.360 03:06:47 -- accel/accel.sh@20 -- # val= 00:06:13.360 03:06:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # IFS=: 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # read -r var val 00:06:13.360 03:06:47 -- accel/accel.sh@20 -- # val= 00:06:13.360 03:06:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # IFS=: 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # read -r var val 00:06:13.360 03:06:47 -- accel/accel.sh@20 -- # val= 00:06:13.360 03:06:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # IFS=: 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # read -r var val 00:06:13.360 03:06:47 -- accel/accel.sh@20 -- # val= 00:06:13.360 03:06:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # IFS=: 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # read -r var val 00:06:13.360 03:06:47 -- accel/accel.sh@20 -- # val= 00:06:13.360 03:06:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # IFS=: 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # read -r var val 00:06:13.360 03:06:47 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:13.360 03:06:47 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:06:13.360 03:06:47 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:13.360 00:06:13.360 real 0m1.358s 00:06:13.360 user 0m1.260s 00:06:13.360 sys 0m0.110s 00:06:13.360 03:06:47 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:13.360 03:06:47 -- common/autotest_common.sh@10 -- # set +x 00:06:13.360 ************************************ 00:06:13.360 END TEST accel_decmop_full 00:06:13.360 ************************************ 00:06:13.360 03:06:47 -- accel/accel.sh@119 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:13.360 03:06:47 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:13.360 03:06:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:13.360 03:06:47 -- common/autotest_common.sh@10 -- # set +x 00:06:13.360 ************************************ 00:06:13.360 START TEST accel_decomp_mcore 00:06:13.360 ************************************ 00:06:13.360 03:06:47 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:13.360 03:06:47 -- accel/accel.sh@16 -- # local accel_opc 00:06:13.360 03:06:47 -- accel/accel.sh@17 -- # local accel_module 00:06:13.360 03:06:47 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # IFS=: 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # read -r var val 00:06:13.360 03:06:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:13.360 03:06:47 -- accel/accel.sh@12 -- # build_accel_config 00:06:13.360 03:06:47 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:13.360 03:06:47 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:13.360 03:06:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:13.360 03:06:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:13.360 03:06:47 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:13.360 03:06:47 -- accel/accel.sh@40 -- # local IFS=, 00:06:13.360 03:06:47 -- accel/accel.sh@41 -- # jq -r . 00:06:13.360 [2024-04-25 03:06:47.668173] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:06:13.360 [2024-04-25 03:06:47.668214] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3921217 ] 00:06:13.360 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.360 [2024-04-25 03:06:47.728134] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:13.360 [2024-04-25 03:06:47.803050] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:13.360 [2024-04-25 03:06:47.803068] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:13.360 [2024-04-25 03:06:47.803157] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:13.360 [2024-04-25 03:06:47.803159] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:13.360 03:06:47 -- accel/accel.sh@20 -- # val= 00:06:13.360 03:06:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # IFS=: 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # read -r var val 00:06:13.360 03:06:47 -- accel/accel.sh@20 -- # val= 00:06:13.360 03:06:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # IFS=: 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # read -r var val 00:06:13.360 03:06:47 -- accel/accel.sh@20 -- # val= 00:06:13.360 03:06:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # IFS=: 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # read -r var val 00:06:13.360 03:06:47 -- accel/accel.sh@20 -- # val=0xf 00:06:13.360 03:06:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # IFS=: 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # read -r var val 00:06:13.360 03:06:47 -- accel/accel.sh@20 -- # val= 00:06:13.360 03:06:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # IFS=: 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # read -r var val 00:06:13.360 03:06:47 -- accel/accel.sh@20 -- # val= 00:06:13.360 03:06:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # IFS=: 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # read -r var val 00:06:13.360 03:06:47 -- accel/accel.sh@20 -- # val=decompress 00:06:13.360 03:06:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.360 03:06:47 -- accel/accel.sh@23 -- # accel_opc=decompress 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # IFS=: 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # read -r var val 00:06:13.360 03:06:47 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:13.360 03:06:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # IFS=: 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # read -r var val 00:06:13.360 03:06:47 -- accel/accel.sh@20 -- # val= 00:06:13.360 03:06:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # IFS=: 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # read -r var val 00:06:13.360 03:06:47 -- accel/accel.sh@20 -- # val=software 00:06:13.360 03:06:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.360 03:06:47 -- accel/accel.sh@22 -- # accel_module=software 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # IFS=: 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # read -r var val 00:06:13.360 03:06:47 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib 00:06:13.360 03:06:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # IFS=: 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # read -r var val 00:06:13.360 03:06:47 -- accel/accel.sh@20 -- # val=32 00:06:13.360 03:06:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # IFS=: 00:06:13.360 03:06:47 -- accel/accel.sh@19 -- # read -r var val 00:06:13.360 03:06:47 -- accel/accel.sh@20 -- # val=32 00:06:13.619 03:06:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.619 03:06:47 -- accel/accel.sh@19 -- # IFS=: 00:06:13.619 03:06:47 -- accel/accel.sh@19 -- # read -r var val 00:06:13.619 03:06:47 -- accel/accel.sh@20 -- # val=1 00:06:13.619 03:06:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.619 03:06:47 -- accel/accel.sh@19 -- # IFS=: 00:06:13.619 03:06:47 -- accel/accel.sh@19 -- # read -r var val 00:06:13.619 03:06:47 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:13.619 03:06:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.619 03:06:47 -- accel/accel.sh@19 -- # IFS=: 00:06:13.619 03:06:47 -- accel/accel.sh@19 -- # read -r var val 00:06:13.619 03:06:47 -- accel/accel.sh@20 -- # val=Yes 00:06:13.619 03:06:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.619 03:06:47 -- accel/accel.sh@19 -- # IFS=: 00:06:13.619 03:06:47 -- accel/accel.sh@19 -- # read -r var val 00:06:13.619 03:06:47 -- accel/accel.sh@20 -- # val= 00:06:13.619 03:06:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.619 03:06:47 -- accel/accel.sh@19 -- # IFS=: 00:06:13.619 03:06:47 -- accel/accel.sh@19 -- # read -r var val 00:06:13.619 03:06:47 -- accel/accel.sh@20 -- # val= 00:06:13.619 03:06:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.619 03:06:47 -- accel/accel.sh@19 -- # IFS=: 00:06:13.619 03:06:47 -- accel/accel.sh@19 -- # read -r var val 00:06:14.554 03:06:49 -- accel/accel.sh@20 -- # val= 00:06:14.554 03:06:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.554 03:06:49 -- accel/accel.sh@19 -- # IFS=: 00:06:14.554 03:06:49 -- accel/accel.sh@19 -- # read -r var val 00:06:14.554 03:06:49 -- accel/accel.sh@20 -- # val= 00:06:14.554 03:06:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.554 03:06:49 -- accel/accel.sh@19 -- # IFS=: 00:06:14.554 03:06:49 -- accel/accel.sh@19 -- # read -r var val 00:06:14.554 03:06:49 -- accel/accel.sh@20 -- # val= 00:06:14.554 03:06:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.554 03:06:49 -- accel/accel.sh@19 -- # IFS=: 00:06:14.554 03:06:49 -- accel/accel.sh@19 -- # read -r var val 00:06:14.554 03:06:49 -- accel/accel.sh@20 -- # val= 00:06:14.554 03:06:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.554 03:06:49 -- accel/accel.sh@19 -- # IFS=: 00:06:14.554 03:06:49 -- accel/accel.sh@19 -- # read -r var val 00:06:14.554 03:06:49 -- accel/accel.sh@20 -- # val= 00:06:14.554 03:06:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.554 03:06:49 -- accel/accel.sh@19 -- # IFS=: 00:06:14.554 03:06:49 -- accel/accel.sh@19 -- # read -r var val 00:06:14.554 03:06:49 -- accel/accel.sh@20 -- # val= 00:06:14.554 03:06:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.554 03:06:49 -- accel/accel.sh@19 -- # IFS=: 00:06:14.554 03:06:49 -- accel/accel.sh@19 -- # read -r var val 00:06:14.554 03:06:49 -- accel/accel.sh@20 -- # val= 00:06:14.554 03:06:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.554 03:06:49 -- accel/accel.sh@19 -- # IFS=: 00:06:14.554 03:06:49 -- accel/accel.sh@19 -- # read -r var val 00:06:14.554 03:06:49 -- accel/accel.sh@20 -- # val= 00:06:14.554 03:06:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.554 03:06:49 -- accel/accel.sh@19 -- # IFS=: 00:06:14.554 03:06:49 -- accel/accel.sh@19 -- # read -r var val 00:06:14.554 03:06:49 -- accel/accel.sh@20 -- # val= 00:06:14.554 03:06:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.554 03:06:49 -- accel/accel.sh@19 -- # IFS=: 00:06:14.554 03:06:49 -- accel/accel.sh@19 -- # read -r var val 00:06:14.554 03:06:49 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:14.554 03:06:49 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:06:14.554 03:06:49 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:14.554 00:06:14.554 real 0m1.362s 00:06:14.554 user 0m4.585s 00:06:14.554 sys 0m0.121s 00:06:14.554 03:06:49 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:14.554 03:06:49 -- common/autotest_common.sh@10 -- # set +x 00:06:14.554 ************************************ 00:06:14.554 END TEST accel_decomp_mcore 00:06:14.554 ************************************ 00:06:14.554 03:06:49 -- accel/accel.sh@120 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:14.554 03:06:49 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:14.554 03:06:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:14.554 03:06:49 -- common/autotest_common.sh@10 -- # set +x 00:06:14.813 ************************************ 00:06:14.813 START TEST accel_decomp_full_mcore 00:06:14.813 ************************************ 00:06:14.813 03:06:49 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:14.813 03:06:49 -- accel/accel.sh@16 -- # local accel_opc 00:06:14.813 03:06:49 -- accel/accel.sh@17 -- # local accel_module 00:06:14.813 03:06:49 -- accel/accel.sh@19 -- # IFS=: 00:06:14.813 03:06:49 -- accel/accel.sh@19 -- # read -r var val 00:06:14.813 03:06:49 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:14.813 03:06:49 -- accel/accel.sh@12 -- # build_accel_config 00:06:14.813 03:06:49 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:14.813 03:06:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:14.813 03:06:49 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:14.813 03:06:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:14.813 03:06:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:14.813 03:06:49 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:14.813 03:06:49 -- accel/accel.sh@40 -- # local IFS=, 00:06:14.813 03:06:49 -- accel/accel.sh@41 -- # jq -r . 00:06:14.813 [2024-04-25 03:06:49.185102] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:06:14.813 [2024-04-25 03:06:49.185165] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3921547 ] 00:06:14.813 EAL: No free 2048 kB hugepages reported on node 1 00:06:14.813 [2024-04-25 03:06:49.244255] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:15.072 [2024-04-25 03:06:49.317300] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:15.072 [2024-04-25 03:06:49.317401] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:15.072 [2024-04-25 03:06:49.317494] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:15.072 [2024-04-25 03:06:49.317496] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:15.072 03:06:49 -- accel/accel.sh@20 -- # val= 00:06:15.072 03:06:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # IFS=: 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # read -r var val 00:06:15.072 03:06:49 -- accel/accel.sh@20 -- # val= 00:06:15.072 03:06:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # IFS=: 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # read -r var val 00:06:15.072 03:06:49 -- accel/accel.sh@20 -- # val= 00:06:15.072 03:06:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # IFS=: 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # read -r var val 00:06:15.072 03:06:49 -- accel/accel.sh@20 -- # val=0xf 00:06:15.072 03:06:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # IFS=: 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # read -r var val 00:06:15.072 03:06:49 -- accel/accel.sh@20 -- # val= 00:06:15.072 03:06:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # IFS=: 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # read -r var val 00:06:15.072 03:06:49 -- accel/accel.sh@20 -- # val= 00:06:15.072 03:06:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # IFS=: 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # read -r var val 00:06:15.072 03:06:49 -- accel/accel.sh@20 -- # val=decompress 00:06:15.072 03:06:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.072 03:06:49 -- accel/accel.sh@23 -- # accel_opc=decompress 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # IFS=: 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # read -r var val 00:06:15.072 03:06:49 -- accel/accel.sh@20 -- # val='111250 bytes' 00:06:15.072 03:06:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # IFS=: 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # read -r var val 00:06:15.072 03:06:49 -- accel/accel.sh@20 -- # val= 00:06:15.072 03:06:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # IFS=: 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # read -r var val 00:06:15.072 03:06:49 -- accel/accel.sh@20 -- # val=software 00:06:15.072 03:06:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.072 03:06:49 -- accel/accel.sh@22 -- # accel_module=software 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # IFS=: 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # read -r var val 00:06:15.072 03:06:49 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib 00:06:15.072 03:06:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # IFS=: 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # read -r var val 00:06:15.072 03:06:49 -- accel/accel.sh@20 -- # val=32 00:06:15.072 03:06:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # IFS=: 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # read -r var val 00:06:15.072 03:06:49 -- accel/accel.sh@20 -- # val=32 00:06:15.072 03:06:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # IFS=: 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # read -r var val 00:06:15.072 03:06:49 -- accel/accel.sh@20 -- # val=1 00:06:15.072 03:06:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # IFS=: 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # read -r var val 00:06:15.072 03:06:49 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:15.072 03:06:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # IFS=: 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # read -r var val 00:06:15.072 03:06:49 -- accel/accel.sh@20 -- # val=Yes 00:06:15.072 03:06:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # IFS=: 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # read -r var val 00:06:15.072 03:06:49 -- accel/accel.sh@20 -- # val= 00:06:15.072 03:06:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # IFS=: 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # read -r var val 00:06:15.072 03:06:49 -- accel/accel.sh@20 -- # val= 00:06:15.072 03:06:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # IFS=: 00:06:15.072 03:06:49 -- accel/accel.sh@19 -- # read -r var val 00:06:16.456 03:06:50 -- accel/accel.sh@20 -- # val= 00:06:16.456 03:06:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.456 03:06:50 -- accel/accel.sh@19 -- # IFS=: 00:06:16.456 03:06:50 -- accel/accel.sh@19 -- # read -r var val 00:06:16.456 03:06:50 -- accel/accel.sh@20 -- # val= 00:06:16.456 03:06:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.456 03:06:50 -- accel/accel.sh@19 -- # IFS=: 00:06:16.456 03:06:50 -- accel/accel.sh@19 -- # read -r var val 00:06:16.456 03:06:50 -- accel/accel.sh@20 -- # val= 00:06:16.456 03:06:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.456 03:06:50 -- accel/accel.sh@19 -- # IFS=: 00:06:16.456 03:06:50 -- accel/accel.sh@19 -- # read -r var val 00:06:16.456 03:06:50 -- accel/accel.sh@20 -- # val= 00:06:16.456 03:06:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.456 03:06:50 -- accel/accel.sh@19 -- # IFS=: 00:06:16.456 03:06:50 -- accel/accel.sh@19 -- # read -r var val 00:06:16.456 03:06:50 -- accel/accel.sh@20 -- # val= 00:06:16.456 03:06:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.456 03:06:50 -- accel/accel.sh@19 -- # IFS=: 00:06:16.456 03:06:50 -- accel/accel.sh@19 -- # read -r var val 00:06:16.456 03:06:50 -- accel/accel.sh@20 -- # val= 00:06:16.456 03:06:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.456 03:06:50 -- accel/accel.sh@19 -- # IFS=: 00:06:16.456 03:06:50 -- accel/accel.sh@19 -- # read -r var val 00:06:16.456 03:06:50 -- accel/accel.sh@20 -- # val= 00:06:16.456 03:06:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.456 03:06:50 -- accel/accel.sh@19 -- # IFS=: 00:06:16.456 03:06:50 -- accel/accel.sh@19 -- # read -r var val 00:06:16.456 03:06:50 -- accel/accel.sh@20 -- # val= 00:06:16.456 03:06:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.456 03:06:50 -- accel/accel.sh@19 -- # IFS=: 00:06:16.456 03:06:50 -- accel/accel.sh@19 -- # read -r var val 00:06:16.456 03:06:50 -- accel/accel.sh@20 -- # val= 00:06:16.456 03:06:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.456 03:06:50 -- accel/accel.sh@19 -- # IFS=: 00:06:16.456 03:06:50 -- accel/accel.sh@19 -- # read -r var val 00:06:16.456 03:06:50 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:16.456 03:06:50 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:06:16.456 03:06:50 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:16.456 00:06:16.456 real 0m1.384s 00:06:16.456 user 0m4.633s 00:06:16.456 sys 0m0.127s 00:06:16.457 03:06:50 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:16.457 03:06:50 -- common/autotest_common.sh@10 -- # set +x 00:06:16.457 ************************************ 00:06:16.457 END TEST accel_decomp_full_mcore 00:06:16.457 ************************************ 00:06:16.457 03:06:50 -- accel/accel.sh@121 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:16.457 03:06:50 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:16.457 03:06:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:16.457 03:06:50 -- common/autotest_common.sh@10 -- # set +x 00:06:16.457 ************************************ 00:06:16.457 START TEST accel_decomp_mthread 00:06:16.457 ************************************ 00:06:16.457 03:06:50 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:16.457 03:06:50 -- accel/accel.sh@16 -- # local accel_opc 00:06:16.457 03:06:50 -- accel/accel.sh@17 -- # local accel_module 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # IFS=: 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # read -r var val 00:06:16.457 03:06:50 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:16.457 03:06:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:16.457 03:06:50 -- accel/accel.sh@12 -- # build_accel_config 00:06:16.457 03:06:50 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:16.457 03:06:50 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:16.457 03:06:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:16.457 03:06:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:16.457 03:06:50 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:16.457 03:06:50 -- accel/accel.sh@40 -- # local IFS=, 00:06:16.457 03:06:50 -- accel/accel.sh@41 -- # jq -r . 00:06:16.457 [2024-04-25 03:06:50.712550] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:06:16.457 [2024-04-25 03:06:50.712594] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3921857 ] 00:06:16.457 EAL: No free 2048 kB hugepages reported on node 1 00:06:16.457 [2024-04-25 03:06:50.771182] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:16.457 [2024-04-25 03:06:50.840111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:16.457 03:06:50 -- accel/accel.sh@20 -- # val= 00:06:16.457 03:06:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # IFS=: 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # read -r var val 00:06:16.457 03:06:50 -- accel/accel.sh@20 -- # val= 00:06:16.457 03:06:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # IFS=: 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # read -r var val 00:06:16.457 03:06:50 -- accel/accel.sh@20 -- # val= 00:06:16.457 03:06:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # IFS=: 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # read -r var val 00:06:16.457 03:06:50 -- accel/accel.sh@20 -- # val=0x1 00:06:16.457 03:06:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # IFS=: 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # read -r var val 00:06:16.457 03:06:50 -- accel/accel.sh@20 -- # val= 00:06:16.457 03:06:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # IFS=: 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # read -r var val 00:06:16.457 03:06:50 -- accel/accel.sh@20 -- # val= 00:06:16.457 03:06:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # IFS=: 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # read -r var val 00:06:16.457 03:06:50 -- accel/accel.sh@20 -- # val=decompress 00:06:16.457 03:06:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.457 03:06:50 -- accel/accel.sh@23 -- # accel_opc=decompress 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # IFS=: 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # read -r var val 00:06:16.457 03:06:50 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:16.457 03:06:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # IFS=: 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # read -r var val 00:06:16.457 03:06:50 -- accel/accel.sh@20 -- # val= 00:06:16.457 03:06:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # IFS=: 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # read -r var val 00:06:16.457 03:06:50 -- accel/accel.sh@20 -- # val=software 00:06:16.457 03:06:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.457 03:06:50 -- accel/accel.sh@22 -- # accel_module=software 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # IFS=: 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # read -r var val 00:06:16.457 03:06:50 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib 00:06:16.457 03:06:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # IFS=: 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # read -r var val 00:06:16.457 03:06:50 -- accel/accel.sh@20 -- # val=32 00:06:16.457 03:06:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # IFS=: 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # read -r var val 00:06:16.457 03:06:50 -- accel/accel.sh@20 -- # val=32 00:06:16.457 03:06:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # IFS=: 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # read -r var val 00:06:16.457 03:06:50 -- accel/accel.sh@20 -- # val=2 00:06:16.457 03:06:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # IFS=: 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # read -r var val 00:06:16.457 03:06:50 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:16.457 03:06:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # IFS=: 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # read -r var val 00:06:16.457 03:06:50 -- accel/accel.sh@20 -- # val=Yes 00:06:16.457 03:06:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # IFS=: 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # read -r var val 00:06:16.457 03:06:50 -- accel/accel.sh@20 -- # val= 00:06:16.457 03:06:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # IFS=: 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # read -r var val 00:06:16.457 03:06:50 -- accel/accel.sh@20 -- # val= 00:06:16.457 03:06:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # IFS=: 00:06:16.457 03:06:50 -- accel/accel.sh@19 -- # read -r var val 00:06:17.832 03:06:52 -- accel/accel.sh@20 -- # val= 00:06:17.832 03:06:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:17.832 03:06:52 -- accel/accel.sh@19 -- # IFS=: 00:06:17.832 03:06:52 -- accel/accel.sh@19 -- # read -r var val 00:06:17.832 03:06:52 -- accel/accel.sh@20 -- # val= 00:06:17.832 03:06:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:17.832 03:06:52 -- accel/accel.sh@19 -- # IFS=: 00:06:17.832 03:06:52 -- accel/accel.sh@19 -- # read -r var val 00:06:17.832 03:06:52 -- accel/accel.sh@20 -- # val= 00:06:17.832 03:06:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:17.832 03:06:52 -- accel/accel.sh@19 -- # IFS=: 00:06:17.832 03:06:52 -- accel/accel.sh@19 -- # read -r var val 00:06:17.832 03:06:52 -- accel/accel.sh@20 -- # val= 00:06:17.832 03:06:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:17.832 03:06:52 -- accel/accel.sh@19 -- # IFS=: 00:06:17.832 03:06:52 -- accel/accel.sh@19 -- # read -r var val 00:06:17.832 03:06:52 -- accel/accel.sh@20 -- # val= 00:06:17.832 03:06:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:17.832 03:06:52 -- accel/accel.sh@19 -- # IFS=: 00:06:17.832 03:06:52 -- accel/accel.sh@19 -- # read -r var val 00:06:17.832 03:06:52 -- accel/accel.sh@20 -- # val= 00:06:17.832 03:06:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:17.832 03:06:52 -- accel/accel.sh@19 -- # IFS=: 00:06:17.832 03:06:52 -- accel/accel.sh@19 -- # read -r var val 00:06:17.832 03:06:52 -- accel/accel.sh@20 -- # val= 00:06:17.832 03:06:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:17.832 03:06:52 -- accel/accel.sh@19 -- # IFS=: 00:06:17.832 03:06:52 -- accel/accel.sh@19 -- # read -r var val 00:06:17.832 03:06:52 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:17.832 03:06:52 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:06:17.832 03:06:52 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:17.832 00:06:17.832 real 0m1.359s 00:06:17.832 user 0m1.257s 00:06:17.832 sys 0m0.114s 00:06:17.832 03:06:52 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:17.832 03:06:52 -- common/autotest_common.sh@10 -- # set +x 00:06:17.832 ************************************ 00:06:17.832 END TEST accel_decomp_mthread 00:06:17.832 ************************************ 00:06:17.832 03:06:52 -- accel/accel.sh@122 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:17.832 03:06:52 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:17.832 03:06:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:17.832 03:06:52 -- common/autotest_common.sh@10 -- # set +x 00:06:17.832 ************************************ 00:06:17.832 START TEST accel_deomp_full_mthread 00:06:17.832 ************************************ 00:06:17.833 03:06:52 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:17.833 03:06:52 -- accel/accel.sh@16 -- # local accel_opc 00:06:17.833 03:06:52 -- accel/accel.sh@17 -- # local accel_module 00:06:17.833 03:06:52 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:17.833 03:06:52 -- accel/accel.sh@19 -- # IFS=: 00:06:17.833 03:06:52 -- accel/accel.sh@19 -- # read -r var val 00:06:17.833 03:06:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:17.833 03:06:52 -- accel/accel.sh@12 -- # build_accel_config 00:06:17.833 03:06:52 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:17.833 03:06:52 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:17.833 03:06:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:17.833 03:06:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:17.833 03:06:52 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:17.833 03:06:52 -- accel/accel.sh@40 -- # local IFS=, 00:06:17.833 03:06:52 -- accel/accel.sh@41 -- # jq -r . 00:06:17.833 [2024-04-25 03:06:52.206589] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:06:17.833 [2024-04-25 03:06:52.206624] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3922113 ] 00:06:17.833 EAL: No free 2048 kB hugepages reported on node 1 00:06:17.833 [2024-04-25 03:06:52.266132] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:18.091 [2024-04-25 03:06:52.336629] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:18.091 03:06:52 -- accel/accel.sh@20 -- # val= 00:06:18.091 03:06:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # IFS=: 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # read -r var val 00:06:18.091 03:06:52 -- accel/accel.sh@20 -- # val= 00:06:18.091 03:06:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # IFS=: 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # read -r var val 00:06:18.091 03:06:52 -- accel/accel.sh@20 -- # val= 00:06:18.091 03:06:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # IFS=: 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # read -r var val 00:06:18.091 03:06:52 -- accel/accel.sh@20 -- # val=0x1 00:06:18.091 03:06:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # IFS=: 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # read -r var val 00:06:18.091 03:06:52 -- accel/accel.sh@20 -- # val= 00:06:18.091 03:06:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # IFS=: 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # read -r var val 00:06:18.091 03:06:52 -- accel/accel.sh@20 -- # val= 00:06:18.091 03:06:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # IFS=: 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # read -r var val 00:06:18.091 03:06:52 -- accel/accel.sh@20 -- # val=decompress 00:06:18.091 03:06:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.091 03:06:52 -- accel/accel.sh@23 -- # accel_opc=decompress 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # IFS=: 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # read -r var val 00:06:18.091 03:06:52 -- accel/accel.sh@20 -- # val='111250 bytes' 00:06:18.091 03:06:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # IFS=: 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # read -r var val 00:06:18.091 03:06:52 -- accel/accel.sh@20 -- # val= 00:06:18.091 03:06:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # IFS=: 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # read -r var val 00:06:18.091 03:06:52 -- accel/accel.sh@20 -- # val=software 00:06:18.091 03:06:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.091 03:06:52 -- accel/accel.sh@22 -- # accel_module=software 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # IFS=: 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # read -r var val 00:06:18.091 03:06:52 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib 00:06:18.091 03:06:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # IFS=: 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # read -r var val 00:06:18.091 03:06:52 -- accel/accel.sh@20 -- # val=32 00:06:18.091 03:06:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # IFS=: 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # read -r var val 00:06:18.091 03:06:52 -- accel/accel.sh@20 -- # val=32 00:06:18.091 03:06:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # IFS=: 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # read -r var val 00:06:18.091 03:06:52 -- accel/accel.sh@20 -- # val=2 00:06:18.091 03:06:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # IFS=: 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # read -r var val 00:06:18.091 03:06:52 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:18.091 03:06:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # IFS=: 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # read -r var val 00:06:18.091 03:06:52 -- accel/accel.sh@20 -- # val=Yes 00:06:18.091 03:06:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # IFS=: 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # read -r var val 00:06:18.091 03:06:52 -- accel/accel.sh@20 -- # val= 00:06:18.091 03:06:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # IFS=: 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # read -r var val 00:06:18.091 03:06:52 -- accel/accel.sh@20 -- # val= 00:06:18.091 03:06:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # IFS=: 00:06:18.091 03:06:52 -- accel/accel.sh@19 -- # read -r var val 00:06:19.467 03:06:53 -- accel/accel.sh@20 -- # val= 00:06:19.467 03:06:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.467 03:06:53 -- accel/accel.sh@19 -- # IFS=: 00:06:19.467 03:06:53 -- accel/accel.sh@19 -- # read -r var val 00:06:19.467 03:06:53 -- accel/accel.sh@20 -- # val= 00:06:19.467 03:06:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.467 03:06:53 -- accel/accel.sh@19 -- # IFS=: 00:06:19.467 03:06:53 -- accel/accel.sh@19 -- # read -r var val 00:06:19.467 03:06:53 -- accel/accel.sh@20 -- # val= 00:06:19.467 03:06:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.467 03:06:53 -- accel/accel.sh@19 -- # IFS=: 00:06:19.467 03:06:53 -- accel/accel.sh@19 -- # read -r var val 00:06:19.467 03:06:53 -- accel/accel.sh@20 -- # val= 00:06:19.467 03:06:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.467 03:06:53 -- accel/accel.sh@19 -- # IFS=: 00:06:19.467 03:06:53 -- accel/accel.sh@19 -- # read -r var val 00:06:19.467 03:06:53 -- accel/accel.sh@20 -- # val= 00:06:19.467 03:06:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.467 03:06:53 -- accel/accel.sh@19 -- # IFS=: 00:06:19.467 03:06:53 -- accel/accel.sh@19 -- # read -r var val 00:06:19.467 03:06:53 -- accel/accel.sh@20 -- # val= 00:06:19.467 03:06:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.467 03:06:53 -- accel/accel.sh@19 -- # IFS=: 00:06:19.467 03:06:53 -- accel/accel.sh@19 -- # read -r var val 00:06:19.467 03:06:53 -- accel/accel.sh@20 -- # val= 00:06:19.467 03:06:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.467 03:06:53 -- accel/accel.sh@19 -- # IFS=: 00:06:19.467 03:06:53 -- accel/accel.sh@19 -- # read -r var val 00:06:19.467 03:06:53 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:19.467 03:06:53 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:06:19.467 03:06:53 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:19.467 00:06:19.467 real 0m1.373s 00:06:19.467 user 0m1.270s 00:06:19.467 sys 0m0.116s 00:06:19.467 03:06:53 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:19.467 03:06:53 -- common/autotest_common.sh@10 -- # set +x 00:06:19.467 ************************************ 00:06:19.467 END TEST accel_deomp_full_mthread 00:06:19.467 ************************************ 00:06:19.467 03:06:53 -- accel/accel.sh@124 -- # [[ n == y ]] 00:06:19.467 03:06:53 -- accel/accel.sh@137 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:19.467 03:06:53 -- accel/accel.sh@137 -- # build_accel_config 00:06:19.467 03:06:53 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:19.467 03:06:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:19.467 03:06:53 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:19.468 03:06:53 -- common/autotest_common.sh@10 -- # set +x 00:06:19.468 03:06:53 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:19.468 03:06:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:19.468 03:06:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:19.468 03:06:53 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:19.468 03:06:53 -- accel/accel.sh@40 -- # local IFS=, 00:06:19.468 03:06:53 -- accel/accel.sh@41 -- # jq -r . 00:06:19.468 ************************************ 00:06:19.468 START TEST accel_dif_functional_tests 00:06:19.468 ************************************ 00:06:19.468 03:06:53 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:19.468 [2024-04-25 03:06:53.776240] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:06:19.468 [2024-04-25 03:06:53.776279] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3922365 ] 00:06:19.468 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.468 [2024-04-25 03:06:53.835898] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:19.468 [2024-04-25 03:06:53.911490] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:19.468 [2024-04-25 03:06:53.911587] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:19.468 [2024-04-25 03:06:53.911588] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:19.727 00:06:19.727 00:06:19.727 CUnit - A unit testing framework for C - Version 2.1-3 00:06:19.727 http://cunit.sourceforge.net/ 00:06:19.727 00:06:19.727 00:06:19.727 Suite: accel_dif 00:06:19.727 Test: verify: DIF generated, GUARD check ...passed 00:06:19.727 Test: verify: DIF generated, APPTAG check ...passed 00:06:19.727 Test: verify: DIF generated, REFTAG check ...passed 00:06:19.727 Test: verify: DIF not generated, GUARD check ...[2024-04-25 03:06:53.979754] dif.c: 826:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:19.727 [2024-04-25 03:06:53.979791] dif.c: 826:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:19.727 passed 00:06:19.727 Test: verify: DIF not generated, APPTAG check ...[2024-04-25 03:06:53.979819] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:19.727 [2024-04-25 03:06:53.979833] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:19.727 passed 00:06:19.727 Test: verify: DIF not generated, REFTAG check ...[2024-04-25 03:06:53.979850] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:19.727 [2024-04-25 03:06:53.979869] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:19.727 passed 00:06:19.727 Test: verify: APPTAG correct, APPTAG check ...passed 00:06:19.727 Test: verify: APPTAG incorrect, APPTAG check ...[2024-04-25 03:06:53.979911] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:06:19.727 passed 00:06:19.727 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:06:19.727 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:06:19.727 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:06:19.727 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-04-25 03:06:53.980011] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:06:19.727 passed 00:06:19.727 Test: generate copy: DIF generated, GUARD check ...passed 00:06:19.727 Test: generate copy: DIF generated, APTTAG check ...passed 00:06:19.727 Test: generate copy: DIF generated, REFTAG check ...passed 00:06:19.727 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:06:19.727 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:06:19.727 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:06:19.727 Test: generate copy: iovecs-len validate ...[2024-04-25 03:06:53.980176] dif.c:1190:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:06:19.727 passed 00:06:19.727 Test: generate copy: buffer alignment validate ...passed 00:06:19.727 00:06:19.727 Run Summary: Type Total Ran Passed Failed Inactive 00:06:19.727 suites 1 1 n/a 0 0 00:06:19.727 tests 20 20 20 0 0 00:06:19.727 asserts 204 204 204 0 n/a 00:06:19.727 00:06:19.727 Elapsed time = 0.002 seconds 00:06:19.727 00:06:19.727 real 0m0.437s 00:06:19.727 user 0m0.610s 00:06:19.727 sys 0m0.143s 00:06:19.728 03:06:54 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:19.728 03:06:54 -- common/autotest_common.sh@10 -- # set +x 00:06:19.728 ************************************ 00:06:19.728 END TEST accel_dif_functional_tests 00:06:19.728 ************************************ 00:06:19.728 00:06:19.728 real 0m33.733s 00:06:19.728 user 0m36.153s 00:06:19.728 sys 0m5.238s 00:06:19.728 03:06:54 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:19.728 03:06:54 -- common/autotest_common.sh@10 -- # set +x 00:06:19.728 ************************************ 00:06:19.728 END TEST accel 00:06:19.728 ************************************ 00:06:19.986 03:06:54 -- spdk/autotest.sh@180 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:19.986 03:06:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:19.986 03:06:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:19.986 03:06:54 -- common/autotest_common.sh@10 -- # set +x 00:06:19.986 ************************************ 00:06:19.986 START TEST accel_rpc 00:06:19.986 ************************************ 00:06:19.986 03:06:54 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:19.986 * Looking for test storage... 00:06:19.986 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel 00:06:19.986 03:06:54 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:19.986 03:06:54 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=3922515 00:06:19.986 03:06:54 -- accel/accel_rpc.sh@15 -- # waitforlisten 3922515 00:06:19.986 03:06:54 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:06:19.987 03:06:54 -- common/autotest_common.sh@817 -- # '[' -z 3922515 ']' 00:06:19.987 03:06:54 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:19.987 03:06:54 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:19.987 03:06:54 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:19.987 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:19.987 03:06:54 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:19.987 03:06:54 -- common/autotest_common.sh@10 -- # set +x 00:06:20.245 [2024-04-25 03:06:54.499190] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:06:20.245 [2024-04-25 03:06:54.499236] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3922515 ] 00:06:20.245 EAL: No free 2048 kB hugepages reported on node 1 00:06:20.245 [2024-04-25 03:06:54.559500] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:20.245 [2024-04-25 03:06:54.635653] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:20.811 03:06:55 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:20.811 03:06:55 -- common/autotest_common.sh@850 -- # return 0 00:06:20.811 03:06:55 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:06:20.811 03:06:55 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:06:20.811 03:06:55 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:06:20.811 03:06:55 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:06:20.811 03:06:55 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:06:20.811 03:06:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:20.811 03:06:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:20.811 03:06:55 -- common/autotest_common.sh@10 -- # set +x 00:06:21.070 ************************************ 00:06:21.070 START TEST accel_assign_opcode 00:06:21.070 ************************************ 00:06:21.070 03:06:55 -- common/autotest_common.sh@1111 -- # accel_assign_opcode_test_suite 00:06:21.070 03:06:55 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:06:21.070 03:06:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:21.070 03:06:55 -- common/autotest_common.sh@10 -- # set +x 00:06:21.070 [2024-04-25 03:06:55.421918] accel_rpc.c: 167:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:06:21.070 03:06:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:21.070 03:06:55 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:06:21.070 03:06:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:21.070 03:06:55 -- common/autotest_common.sh@10 -- # set +x 00:06:21.070 [2024-04-25 03:06:55.429932] accel_rpc.c: 167:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:06:21.070 03:06:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:21.070 03:06:55 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:06:21.070 03:06:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:21.070 03:06:55 -- common/autotest_common.sh@10 -- # set +x 00:06:21.328 03:06:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:21.328 03:06:55 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:06:21.328 03:06:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:21.328 03:06:55 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:06:21.328 03:06:55 -- common/autotest_common.sh@10 -- # set +x 00:06:21.328 03:06:55 -- accel/accel_rpc.sh@42 -- # grep software 00:06:21.328 03:06:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:21.328 software 00:06:21.328 00:06:21.328 real 0m0.232s 00:06:21.328 user 0m0.042s 00:06:21.328 sys 0m0.014s 00:06:21.328 03:06:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:21.328 03:06:55 -- common/autotest_common.sh@10 -- # set +x 00:06:21.328 ************************************ 00:06:21.328 END TEST accel_assign_opcode 00:06:21.328 ************************************ 00:06:21.328 03:06:55 -- accel/accel_rpc.sh@55 -- # killprocess 3922515 00:06:21.328 03:06:55 -- common/autotest_common.sh@936 -- # '[' -z 3922515 ']' 00:06:21.328 03:06:55 -- common/autotest_common.sh@940 -- # kill -0 3922515 00:06:21.328 03:06:55 -- common/autotest_common.sh@941 -- # uname 00:06:21.328 03:06:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:21.328 03:06:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3922515 00:06:21.328 03:06:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:21.328 03:06:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:21.328 03:06:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3922515' 00:06:21.328 killing process with pid 3922515 00:06:21.328 03:06:55 -- common/autotest_common.sh@955 -- # kill 3922515 00:06:21.328 03:06:55 -- common/autotest_common.sh@960 -- # wait 3922515 00:06:21.588 00:06:21.588 real 0m1.693s 00:06:21.588 user 0m1.804s 00:06:21.588 sys 0m0.454s 00:06:21.588 03:06:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:21.588 03:06:56 -- common/autotest_common.sh@10 -- # set +x 00:06:21.588 ************************************ 00:06:21.588 END TEST accel_rpc 00:06:21.588 ************************************ 00:06:21.847 03:06:56 -- spdk/autotest.sh@181 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/app/cmdline.sh 00:06:21.847 03:06:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:21.847 03:06:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:21.847 03:06:56 -- common/autotest_common.sh@10 -- # set +x 00:06:21.847 ************************************ 00:06:21.847 START TEST app_cmdline 00:06:21.847 ************************************ 00:06:21.847 03:06:56 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/app/cmdline.sh 00:06:21.847 * Looking for test storage... 00:06:21.847 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/app 00:06:21.847 03:06:56 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:06:21.847 03:06:56 -- app/cmdline.sh@17 -- # spdk_tgt_pid=3922978 00:06:21.847 03:06:56 -- app/cmdline.sh@18 -- # waitforlisten 3922978 00:06:21.847 03:06:56 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:06:21.847 03:06:56 -- common/autotest_common.sh@817 -- # '[' -z 3922978 ']' 00:06:21.847 03:06:56 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:21.847 03:06:56 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:21.847 03:06:56 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:21.847 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:21.847 03:06:56 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:21.847 03:06:56 -- common/autotest_common.sh@10 -- # set +x 00:06:22.108 [2024-04-25 03:06:56.370438] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:06:22.108 [2024-04-25 03:06:56.370482] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3922978 ] 00:06:22.109 EAL: No free 2048 kB hugepages reported on node 1 00:06:22.109 [2024-04-25 03:06:56.431060] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:22.109 [2024-04-25 03:06:56.506651] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:22.674 03:06:57 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:22.674 03:06:57 -- common/autotest_common.sh@850 -- # return 0 00:06:22.674 03:06:57 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:06:22.931 { 00:06:22.931 "version": "SPDK v24.05-pre git sha1 abd932d6f", 00:06:22.931 "fields": { 00:06:22.931 "major": 24, 00:06:22.931 "minor": 5, 00:06:22.931 "patch": 0, 00:06:22.931 "suffix": "-pre", 00:06:22.931 "commit": "abd932d6f" 00:06:22.931 } 00:06:22.931 } 00:06:22.931 03:06:57 -- app/cmdline.sh@22 -- # expected_methods=() 00:06:22.931 03:06:57 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:06:22.931 03:06:57 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:06:22.932 03:06:57 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:06:22.932 03:06:57 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:06:22.932 03:06:57 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:06:22.932 03:06:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:22.932 03:06:57 -- app/cmdline.sh@26 -- # sort 00:06:22.932 03:06:57 -- common/autotest_common.sh@10 -- # set +x 00:06:22.932 03:06:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:22.932 03:06:57 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:06:22.932 03:06:57 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:06:22.932 03:06:57 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:22.932 03:06:57 -- common/autotest_common.sh@638 -- # local es=0 00:06:22.932 03:06:57 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:22.932 03:06:57 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:06:22.932 03:06:57 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:22.932 03:06:57 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:06:22.932 03:06:57 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:22.932 03:06:57 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:06:22.932 03:06:57 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:22.932 03:06:57 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:06:22.932 03:06:57 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py ]] 00:06:22.932 03:06:57 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:23.189 request: 00:06:23.189 { 00:06:23.189 "method": "env_dpdk_get_mem_stats", 00:06:23.189 "req_id": 1 00:06:23.189 } 00:06:23.189 Got JSON-RPC error response 00:06:23.189 response: 00:06:23.189 { 00:06:23.189 "code": -32601, 00:06:23.189 "message": "Method not found" 00:06:23.189 } 00:06:23.189 03:06:57 -- common/autotest_common.sh@641 -- # es=1 00:06:23.189 03:06:57 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:06:23.189 03:06:57 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:06:23.189 03:06:57 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:06:23.189 03:06:57 -- app/cmdline.sh@1 -- # killprocess 3922978 00:06:23.189 03:06:57 -- common/autotest_common.sh@936 -- # '[' -z 3922978 ']' 00:06:23.189 03:06:57 -- common/autotest_common.sh@940 -- # kill -0 3922978 00:06:23.189 03:06:57 -- common/autotest_common.sh@941 -- # uname 00:06:23.189 03:06:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:23.189 03:06:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3922978 00:06:23.189 03:06:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:23.189 03:06:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:23.189 03:06:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3922978' 00:06:23.189 killing process with pid 3922978 00:06:23.189 03:06:57 -- common/autotest_common.sh@955 -- # kill 3922978 00:06:23.189 03:06:57 -- common/autotest_common.sh@960 -- # wait 3922978 00:06:23.447 00:06:23.447 real 0m1.674s 00:06:23.447 user 0m1.969s 00:06:23.447 sys 0m0.432s 00:06:23.447 03:06:57 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:23.447 03:06:57 -- common/autotest_common.sh@10 -- # set +x 00:06:23.447 ************************************ 00:06:23.447 END TEST app_cmdline 00:06:23.447 ************************************ 00:06:23.447 03:06:57 -- spdk/autotest.sh@182 -- # run_test version /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/app/version.sh 00:06:23.447 03:06:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:23.447 03:06:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:23.447 03:06:57 -- common/autotest_common.sh@10 -- # set +x 00:06:23.706 ************************************ 00:06:23.706 START TEST version 00:06:23.706 ************************************ 00:06:23.706 03:06:58 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/app/version.sh 00:06:23.706 * Looking for test storage... 00:06:23.706 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/app 00:06:23.706 03:06:58 -- app/version.sh@17 -- # get_header_version major 00:06:23.706 03:06:58 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/include/spdk/version.h 00:06:23.706 03:06:58 -- app/version.sh@14 -- # cut -f2 00:06:23.706 03:06:58 -- app/version.sh@14 -- # tr -d '"' 00:06:23.706 03:06:58 -- app/version.sh@17 -- # major=24 00:06:23.706 03:06:58 -- app/version.sh@18 -- # get_header_version minor 00:06:23.706 03:06:58 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/include/spdk/version.h 00:06:23.706 03:06:58 -- app/version.sh@14 -- # cut -f2 00:06:23.706 03:06:58 -- app/version.sh@14 -- # tr -d '"' 00:06:23.706 03:06:58 -- app/version.sh@18 -- # minor=5 00:06:23.706 03:06:58 -- app/version.sh@19 -- # get_header_version patch 00:06:23.706 03:06:58 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/include/spdk/version.h 00:06:23.706 03:06:58 -- app/version.sh@14 -- # cut -f2 00:06:23.706 03:06:58 -- app/version.sh@14 -- # tr -d '"' 00:06:23.706 03:06:58 -- app/version.sh@19 -- # patch=0 00:06:23.706 03:06:58 -- app/version.sh@20 -- # get_header_version suffix 00:06:23.706 03:06:58 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/include/spdk/version.h 00:06:23.706 03:06:58 -- app/version.sh@14 -- # cut -f2 00:06:23.706 03:06:58 -- app/version.sh@14 -- # tr -d '"' 00:06:23.706 03:06:58 -- app/version.sh@20 -- # suffix=-pre 00:06:23.706 03:06:58 -- app/version.sh@22 -- # version=24.5 00:06:23.706 03:06:58 -- app/version.sh@25 -- # (( patch != 0 )) 00:06:23.706 03:06:58 -- app/version.sh@28 -- # version=24.5rc0 00:06:23.706 03:06:58 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python 00:06:23.706 03:06:58 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:06:23.964 03:06:58 -- app/version.sh@30 -- # py_version=24.5rc0 00:06:23.964 03:06:58 -- app/version.sh@31 -- # [[ 24.5rc0 == \2\4\.\5\r\c\0 ]] 00:06:23.964 00:06:23.964 real 0m0.157s 00:06:23.964 user 0m0.073s 00:06:23.964 sys 0m0.120s 00:06:23.964 03:06:58 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:23.964 03:06:58 -- common/autotest_common.sh@10 -- # set +x 00:06:23.964 ************************************ 00:06:23.964 END TEST version 00:06:23.964 ************************************ 00:06:23.964 03:06:58 -- spdk/autotest.sh@184 -- # '[' 0 -eq 1 ']' 00:06:23.964 03:06:58 -- spdk/autotest.sh@194 -- # uname -s 00:06:23.964 03:06:58 -- spdk/autotest.sh@194 -- # [[ Linux == Linux ]] 00:06:23.964 03:06:58 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:06:23.964 03:06:58 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:06:23.964 03:06:58 -- spdk/autotest.sh@207 -- # '[' 0 -eq 1 ']' 00:06:23.964 03:06:58 -- spdk/autotest.sh@254 -- # '[' 0 -eq 1 ']' 00:06:23.964 03:06:58 -- spdk/autotest.sh@258 -- # timing_exit lib 00:06:23.964 03:06:58 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:23.964 03:06:58 -- common/autotest_common.sh@10 -- # set +x 00:06:23.964 03:06:58 -- spdk/autotest.sh@260 -- # '[' 0 -eq 1 ']' 00:06:23.964 03:06:58 -- spdk/autotest.sh@268 -- # '[' 0 -eq 1 ']' 00:06:23.964 03:06:58 -- spdk/autotest.sh@277 -- # '[' 1 -eq 1 ']' 00:06:23.964 03:06:58 -- spdk/autotest.sh@278 -- # export NET_TYPE 00:06:23.964 03:06:58 -- spdk/autotest.sh@281 -- # '[' rdma = rdma ']' 00:06:23.964 03:06:58 -- spdk/autotest.sh@282 -- # run_test nvmf_rdma /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=rdma 00:06:23.964 03:06:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:23.964 03:06:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:23.964 03:06:58 -- common/autotest_common.sh@10 -- # set +x 00:06:23.964 ************************************ 00:06:23.964 START TEST nvmf_rdma 00:06:23.964 ************************************ 00:06:23.964 03:06:58 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=rdma 00:06:24.222 * Looking for test storage... 00:06:24.222 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf 00:06:24.222 03:06:58 -- nvmf/nvmf.sh@10 -- # uname -s 00:06:24.222 03:06:58 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:06:24.222 03:06:58 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:06:24.222 03:06:58 -- nvmf/common.sh@7 -- # uname -s 00:06:24.222 03:06:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:24.222 03:06:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:24.222 03:06:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:24.222 03:06:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:24.222 03:06:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:24.222 03:06:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:24.222 03:06:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:24.222 03:06:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:24.222 03:06:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:24.222 03:06:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:24.222 03:06:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:06:24.222 03:06:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:06:24.222 03:06:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:24.222 03:06:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:24.222 03:06:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:24.222 03:06:58 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:06:24.222 03:06:58 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:06:24.222 03:06:58 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:24.222 03:06:58 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:24.222 03:06:58 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:24.223 03:06:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:24.223 03:06:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:24.223 03:06:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:24.223 03:06:58 -- paths/export.sh@5 -- # export PATH 00:06:24.223 03:06:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:24.223 03:06:58 -- nvmf/common.sh@47 -- # : 0 00:06:24.223 03:06:58 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:06:24.223 03:06:58 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:06:24.223 03:06:58 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:06:24.223 03:06:58 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:24.223 03:06:58 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:24.223 03:06:58 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:06:24.223 03:06:58 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:06:24.223 03:06:58 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:06:24.223 03:06:58 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:06:24.223 03:06:58 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:06:24.223 03:06:58 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:06:24.223 03:06:58 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:24.223 03:06:58 -- common/autotest_common.sh@10 -- # set +x 00:06:24.223 03:06:58 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:06:24.223 03:06:58 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=rdma 00:06:24.223 03:06:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:24.223 03:06:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:24.223 03:06:58 -- common/autotest_common.sh@10 -- # set +x 00:06:24.223 ************************************ 00:06:24.223 START TEST nvmf_example 00:06:24.223 ************************************ 00:06:24.223 03:06:58 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=rdma 00:06:24.223 * Looking for test storage... 00:06:24.484 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:06:24.484 03:06:58 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:06:24.484 03:06:58 -- nvmf/common.sh@7 -- # uname -s 00:06:24.484 03:06:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:24.484 03:06:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:24.484 03:06:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:24.484 03:06:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:24.484 03:06:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:24.484 03:06:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:24.484 03:06:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:24.484 03:06:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:24.484 03:06:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:24.484 03:06:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:24.484 03:06:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:06:24.484 03:06:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:06:24.484 03:06:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:24.484 03:06:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:24.484 03:06:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:24.484 03:06:58 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:06:24.484 03:06:58 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:06:24.484 03:06:58 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:24.484 03:06:58 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:24.484 03:06:58 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:24.484 03:06:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:24.484 03:06:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:24.484 03:06:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:24.484 03:06:58 -- paths/export.sh@5 -- # export PATH 00:06:24.484 03:06:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:24.484 03:06:58 -- nvmf/common.sh@47 -- # : 0 00:06:24.484 03:06:58 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:06:24.484 03:06:58 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:06:24.484 03:06:58 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:06:24.484 03:06:58 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:24.484 03:06:58 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:24.484 03:06:58 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:06:24.484 03:06:58 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:06:24.484 03:06:58 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:06:24.484 03:06:58 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:06:24.484 03:06:58 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:06:24.484 03:06:58 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:06:24.484 03:06:58 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:06:24.484 03:06:58 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:06:24.484 03:06:58 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:06:24.484 03:06:58 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:06:24.484 03:06:58 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:06:24.484 03:06:58 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:24.484 03:06:58 -- common/autotest_common.sh@10 -- # set +x 00:06:24.484 03:06:58 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:06:24.484 03:06:58 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:06:24.484 03:06:58 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:24.484 03:06:58 -- nvmf/common.sh@437 -- # prepare_net_devs 00:06:24.484 03:06:58 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:06:24.484 03:06:58 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:06:24.484 03:06:58 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:24.484 03:06:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:24.484 03:06:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:24.484 03:06:58 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:06:24.484 03:06:58 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:06:24.484 03:06:58 -- nvmf/common.sh@285 -- # xtrace_disable 00:06:24.484 03:06:58 -- common/autotest_common.sh@10 -- # set +x 00:06:31.051 03:07:04 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:31.051 03:07:04 -- nvmf/common.sh@291 -- # pci_devs=() 00:06:31.051 03:07:04 -- nvmf/common.sh@291 -- # local -a pci_devs 00:06:31.051 03:07:04 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:06:31.051 03:07:04 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:06:31.051 03:07:04 -- nvmf/common.sh@293 -- # pci_drivers=() 00:06:31.051 03:07:04 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:06:31.051 03:07:04 -- nvmf/common.sh@295 -- # net_devs=() 00:06:31.051 03:07:04 -- nvmf/common.sh@295 -- # local -ga net_devs 00:06:31.051 03:07:04 -- nvmf/common.sh@296 -- # e810=() 00:06:31.051 03:07:04 -- nvmf/common.sh@296 -- # local -ga e810 00:06:31.051 03:07:04 -- nvmf/common.sh@297 -- # x722=() 00:06:31.051 03:07:04 -- nvmf/common.sh@297 -- # local -ga x722 00:06:31.051 03:07:04 -- nvmf/common.sh@298 -- # mlx=() 00:06:31.051 03:07:04 -- nvmf/common.sh@298 -- # local -ga mlx 00:06:31.051 03:07:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:31.051 03:07:04 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:31.051 03:07:04 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:31.051 03:07:04 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:31.051 03:07:04 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:31.051 03:07:04 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:31.051 03:07:04 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:31.051 03:07:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:31.051 03:07:04 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:31.051 03:07:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:31.051 03:07:04 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:31.051 03:07:04 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:06:31.051 03:07:04 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:06:31.051 03:07:04 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:06:31.051 03:07:04 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:06:31.051 03:07:04 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:06:31.051 03:07:04 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:06:31.051 03:07:04 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:06:31.051 03:07:04 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:06:31.051 03:07:04 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:06:31.051 03:07:04 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:06:31.051 Found 0000:af:00.0 (0x8086 - 0x159b) 00:06:31.051 03:07:04 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:06:31.051 03:07:04 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:06:31.051 03:07:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:31.051 03:07:04 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:31.051 03:07:04 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:06:31.051 03:07:04 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:06:31.051 03:07:04 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:06:31.051 03:07:04 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:06:31.051 Found 0000:af:00.1 (0x8086 - 0x159b) 00:06:31.051 03:07:04 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:06:31.051 03:07:04 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:06:31.051 03:07:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:31.051 03:07:04 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:31.051 03:07:04 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:06:31.051 03:07:04 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:06:31.051 03:07:04 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:06:31.051 03:07:04 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:06:31.051 03:07:04 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:06:31.051 03:07:04 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:06:31.051 03:07:04 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:06:31.051 03:07:04 -- nvmf/common.sh@377 -- # modinfo irdma 00:06:31.051 03:07:04 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:06:31.051 03:07:04 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:06:31.051 03:07:04 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:31.051 03:07:04 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:06:31.051 03:07:04 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:31.051 03:07:04 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:06:31.051 Found net devices under 0000:af:00.0: cvl_0_0 00:06:31.051 03:07:04 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:06:31.051 03:07:04 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:06:31.051 03:07:04 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:31.051 03:07:04 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:06:31.051 03:07:04 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:31.051 03:07:04 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:06:31.051 Found net devices under 0000:af:00.1: cvl_0_1 00:06:31.051 03:07:04 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:06:31.051 03:07:04 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:06:31.051 03:07:04 -- nvmf/common.sh@403 -- # is_hw=yes 00:06:31.051 03:07:04 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:06:31.051 03:07:04 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:06:31.051 03:07:04 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:06:31.051 03:07:04 -- nvmf/common.sh@409 -- # rdma_device_init 00:06:31.051 03:07:04 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:06:31.051 03:07:04 -- nvmf/common.sh@58 -- # uname 00:06:31.051 03:07:04 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:06:31.051 03:07:04 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:06:31.051 03:07:04 -- nvmf/common.sh@63 -- # modprobe ib_core 00:06:31.051 03:07:04 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:06:31.051 03:07:04 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:06:31.051 03:07:04 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:06:31.051 03:07:04 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:06:31.051 03:07:04 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:06:31.051 03:07:04 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:06:31.051 03:07:04 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:06:31.051 03:07:04 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:06:31.051 03:07:04 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:06:31.051 03:07:04 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:06:31.051 03:07:04 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:06:31.051 03:07:04 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:06:31.051 03:07:04 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:06:31.051 03:07:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:31.051 03:07:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:31.051 03:07:04 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:06:31.051 03:07:04 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:06:31.051 03:07:04 -- nvmf/common.sh@105 -- # continue 2 00:06:31.051 03:07:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:31.051 03:07:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:31.051 03:07:04 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:06:31.051 03:07:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:31.051 03:07:04 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:06:31.051 03:07:04 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:06:31.051 03:07:04 -- nvmf/common.sh@105 -- # continue 2 00:06:31.051 03:07:04 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:06:31.051 03:07:04 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:06:31.051 03:07:04 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:06:31.051 03:07:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:06:31.051 03:07:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:31.051 03:07:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:31.051 03:07:04 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:06:31.051 03:07:04 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:06:31.051 03:07:04 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:06:31.051 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:06:31.051 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:06:31.051 altname enp175s0f0np0 00:06:31.051 altname ens801f0np0 00:06:31.051 inet 192.168.100.8/24 scope global cvl_0_0 00:06:31.051 valid_lft forever preferred_lft forever 00:06:31.051 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:06:31.051 valid_lft forever preferred_lft forever 00:06:31.051 03:07:04 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:06:31.051 03:07:04 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:06:31.051 03:07:04 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:06:31.052 03:07:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:06:31.052 03:07:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:31.052 03:07:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:31.052 03:07:04 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:06:31.052 03:07:04 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:06:31.052 03:07:04 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:06:31.052 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:06:31.052 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:06:31.052 altname enp175s0f1np1 00:06:31.052 altname ens801f1np1 00:06:31.052 inet 192.168.100.9/24 scope global cvl_0_1 00:06:31.052 valid_lft forever preferred_lft forever 00:06:31.052 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:06:31.052 valid_lft forever preferred_lft forever 00:06:31.052 03:07:04 -- nvmf/common.sh@411 -- # return 0 00:06:31.052 03:07:04 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:06:31.052 03:07:04 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:06:31.052 03:07:04 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:06:31.052 03:07:04 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:06:31.052 03:07:04 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:06:31.052 03:07:04 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:06:31.052 03:07:04 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:06:31.052 03:07:04 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:06:31.052 03:07:04 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:06:31.052 03:07:04 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:06:31.052 03:07:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:31.052 03:07:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:31.052 03:07:04 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:06:31.052 03:07:04 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:06:31.052 03:07:04 -- nvmf/common.sh@105 -- # continue 2 00:06:31.052 03:07:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:31.052 03:07:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:31.052 03:07:04 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:06:31.052 03:07:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:31.052 03:07:04 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:06:31.052 03:07:04 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:06:31.052 03:07:04 -- nvmf/common.sh@105 -- # continue 2 00:06:31.052 03:07:04 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:06:31.052 03:07:04 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:06:31.052 03:07:04 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:06:31.052 03:07:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:31.052 03:07:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:06:31.052 03:07:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:31.052 03:07:04 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:06:31.052 03:07:04 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:06:31.052 03:07:04 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:06:31.052 03:07:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:31.052 03:07:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:06:31.052 03:07:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:31.052 03:07:04 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:06:31.052 192.168.100.9' 00:06:31.052 03:07:04 -- nvmf/common.sh@446 -- # head -n 1 00:06:31.052 03:07:04 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:06:31.052 192.168.100.9' 00:06:31.052 03:07:04 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:06:31.052 03:07:04 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:06:31.052 192.168.100.9' 00:06:31.052 03:07:04 -- nvmf/common.sh@447 -- # tail -n +2 00:06:31.052 03:07:04 -- nvmf/common.sh@447 -- # head -n 1 00:06:31.052 03:07:04 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:06:31.052 03:07:04 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:06:31.052 03:07:04 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:06:31.052 03:07:04 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:06:31.052 03:07:04 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:06:31.052 03:07:04 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:06:31.052 03:07:04 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:06:31.052 03:07:04 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:06:31.052 03:07:04 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:31.052 03:07:04 -- common/autotest_common.sh@10 -- # set +x 00:06:31.052 03:07:04 -- target/nvmf_example.sh@29 -- # '[' rdma == tcp ']' 00:06:31.052 03:07:04 -- target/nvmf_example.sh@34 -- # nvmfpid=3926893 00:06:31.052 03:07:04 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:31.052 03:07:04 -- target/nvmf_example.sh@33 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:06:31.052 03:07:04 -- target/nvmf_example.sh@36 -- # waitforlisten 3926893 00:06:31.052 03:07:04 -- common/autotest_common.sh@817 -- # '[' -z 3926893 ']' 00:06:31.052 03:07:04 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:31.052 03:07:04 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:31.052 03:07:04 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:31.052 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:31.052 03:07:04 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:31.052 03:07:04 -- common/autotest_common.sh@10 -- # set +x 00:06:31.052 EAL: No free 2048 kB hugepages reported on node 1 00:06:31.312 03:07:05 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:31.312 03:07:05 -- common/autotest_common.sh@850 -- # return 0 00:06:31.312 03:07:05 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:06:31.312 03:07:05 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:31.312 03:07:05 -- common/autotest_common.sh@10 -- # set +x 00:06:31.312 03:07:05 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:06:31.312 03:07:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:31.312 03:07:05 -- common/autotest_common.sh@10 -- # set +x 00:06:31.312 03:07:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:31.312 03:07:05 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:06:31.312 03:07:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:31.312 03:07:05 -- common/autotest_common.sh@10 -- # set +x 00:06:31.312 03:07:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:31.312 03:07:05 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:06:31.312 03:07:05 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:31.312 03:07:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:31.312 03:07:05 -- common/autotest_common.sh@10 -- # set +x 00:06:31.312 03:07:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:31.312 03:07:05 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:06:31.312 03:07:05 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:31.312 03:07:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:31.312 03:07:05 -- common/autotest_common.sh@10 -- # set +x 00:06:31.312 03:07:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:31.312 03:07:05 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:06:31.312 03:07:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:31.312 03:07:05 -- common/autotest_common.sh@10 -- # set +x 00:06:31.312 03:07:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:31.312 03:07:05 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:06:31.312 03:07:05 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:06:31.312 EAL: No free 2048 kB hugepages reported on node 1 00:06:43.525 Initializing NVMe Controllers 00:06:43.525 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:06:43.525 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:43.525 Initialization complete. Launching workers. 00:06:43.525 ======================================================== 00:06:43.525 Latency(us) 00:06:43.525 Device Information : IOPS MiB/s Average min max 00:06:43.525 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 25952.13 101.38 2466.01 515.11 12999.09 00:06:43.525 ======================================================== 00:06:43.525 Total : 25952.13 101.38 2466.01 515.11 12999.09 00:06:43.525 00:06:43.525 03:07:16 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:43.525 03:07:16 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:43.525 03:07:16 -- nvmf/common.sh@477 -- # nvmfcleanup 00:06:43.525 03:07:16 -- nvmf/common.sh@117 -- # sync 00:06:43.525 03:07:16 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:06:43.525 03:07:16 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:06:43.525 03:07:16 -- nvmf/common.sh@120 -- # set +e 00:06:43.525 03:07:16 -- nvmf/common.sh@121 -- # for i in {1..20} 00:06:43.525 03:07:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:06:43.525 rmmod nvme_rdma 00:06:43.525 rmmod nvme_fabrics 00:06:43.525 03:07:16 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:06:43.525 03:07:16 -- nvmf/common.sh@124 -- # set -e 00:06:43.525 03:07:16 -- nvmf/common.sh@125 -- # return 0 00:06:43.525 03:07:16 -- nvmf/common.sh@478 -- # '[' -n 3926893 ']' 00:06:43.525 03:07:16 -- nvmf/common.sh@479 -- # killprocess 3926893 00:06:43.525 03:07:16 -- common/autotest_common.sh@936 -- # '[' -z 3926893 ']' 00:06:43.525 03:07:16 -- common/autotest_common.sh@940 -- # kill -0 3926893 00:06:43.525 03:07:16 -- common/autotest_common.sh@941 -- # uname 00:06:43.525 03:07:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:43.525 03:07:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3926893 00:06:43.525 03:07:17 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:06:43.525 03:07:17 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:06:43.525 03:07:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3926893' 00:06:43.525 killing process with pid 3926893 00:06:43.525 03:07:17 -- common/autotest_common.sh@955 -- # kill 3926893 00:06:43.525 03:07:17 -- common/autotest_common.sh@960 -- # wait 3926893 00:06:43.525 [2024-04-25 03:07:17.060057] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:06:43.525 nvmf threads initialize successfully 00:06:43.525 bdev subsystem init successfully 00:06:43.525 created a nvmf target service 00:06:43.525 create targets's poll groups done 00:06:43.525 all subsystems of target started 00:06:43.525 nvmf target is running 00:06:43.525 all subsystems of target stopped 00:06:43.525 destroy targets's poll groups done 00:06:43.525 destroyed the nvmf target service 00:06:43.525 bdev subsystem finish successfully 00:06:43.525 nvmf threads destroy successfully 00:06:43.525 03:07:17 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:06:43.525 03:07:17 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:06:43.525 03:07:17 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:43.525 03:07:17 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:43.525 03:07:17 -- common/autotest_common.sh@10 -- # set +x 00:06:43.525 00:06:43.525 real 0m18.628s 00:06:43.525 user 0m51.036s 00:06:43.525 sys 0m4.948s 00:06:43.525 03:07:17 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:43.525 03:07:17 -- common/autotest_common.sh@10 -- # set +x 00:06:43.525 ************************************ 00:06:43.525 END TEST nvmf_example 00:06:43.525 ************************************ 00:06:43.525 03:07:17 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=rdma 00:06:43.525 03:07:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:43.525 03:07:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:43.525 03:07:17 -- common/autotest_common.sh@10 -- # set +x 00:06:43.525 ************************************ 00:06:43.525 START TEST nvmf_filesystem 00:06:43.525 ************************************ 00:06:43.525 03:07:17 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=rdma 00:06:43.525 * Looking for test storage... 00:06:43.525 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:06:43.525 03:07:17 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/autotest_common.sh 00:06:43.525 03:07:17 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:43.525 03:07:17 -- common/autotest_common.sh@34 -- # set -e 00:06:43.525 03:07:17 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:43.525 03:07:17 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:43.525 03:07:17 -- common/autotest_common.sh@38 -- # '[' -z /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output ']' 00:06:43.525 03:07:17 -- common/autotest_common.sh@43 -- # [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:43.525 03:07:17 -- common/autotest_common.sh@44 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/build_config.sh 00:06:43.525 03:07:17 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:43.525 03:07:17 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:43.525 03:07:17 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:43.525 03:07:17 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:43.525 03:07:17 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:43.525 03:07:17 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:43.525 03:07:17 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:43.525 03:07:17 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:43.525 03:07:17 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:43.525 03:07:17 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:43.525 03:07:17 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:43.525 03:07:17 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:43.525 03:07:17 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:43.525 03:07:17 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:43.525 03:07:17 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:43.525 03:07:17 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:43.526 03:07:17 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:43.526 03:07:17 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:43.526 03:07:17 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/env_dpdk 00:06:43.526 03:07:17 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:43.526 03:07:17 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:43.526 03:07:17 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:43.526 03:07:17 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:43.526 03:07:17 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:43.526 03:07:17 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:43.526 03:07:17 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:43.526 03:07:17 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:43.526 03:07:17 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:43.526 03:07:17 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:43.526 03:07:17 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:43.526 03:07:17 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:43.526 03:07:17 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:43.526 03:07:17 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:43.526 03:07:17 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:43.526 03:07:17 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:43.526 03:07:17 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build 00:06:43.526 03:07:17 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:43.526 03:07:17 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:43.526 03:07:17 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:43.526 03:07:17 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:43.526 03:07:17 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:43.526 03:07:17 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:43.526 03:07:17 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:43.526 03:07:17 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:43.526 03:07:17 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:43.526 03:07:17 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:43.526 03:07:17 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:43.526 03:07:17 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:43.526 03:07:17 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:43.526 03:07:17 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:43.526 03:07:17 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:06:43.526 03:07:17 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:43.526 03:07:17 -- common/build_config.sh@53 -- # CONFIG_HAVE_EVP_MAC=y 00:06:43.526 03:07:17 -- common/build_config.sh@54 -- # CONFIG_URING_ZNS=n 00:06:43.526 03:07:17 -- common/build_config.sh@55 -- # CONFIG_WERROR=y 00:06:43.526 03:07:17 -- common/build_config.sh@56 -- # CONFIG_HAVE_LIBBSD=n 00:06:43.526 03:07:17 -- common/build_config.sh@57 -- # CONFIG_UBSAN=y 00:06:43.526 03:07:17 -- common/build_config.sh@58 -- # CONFIG_IPSEC_MB_DIR= 00:06:43.526 03:07:17 -- common/build_config.sh@59 -- # CONFIG_GOLANG=n 00:06:43.526 03:07:17 -- common/build_config.sh@60 -- # CONFIG_ISAL=y 00:06:43.526 03:07:17 -- common/build_config.sh@61 -- # CONFIG_IDXD_KERNEL=n 00:06:43.526 03:07:17 -- common/build_config.sh@62 -- # CONFIG_DPDK_LIB_DIR= 00:06:43.526 03:07:17 -- common/build_config.sh@63 -- # CONFIG_RDMA_PROV=verbs 00:06:43.526 03:07:17 -- common/build_config.sh@64 -- # CONFIG_APPS=y 00:06:43.526 03:07:17 -- common/build_config.sh@65 -- # CONFIG_SHARED=y 00:06:43.526 03:07:17 -- common/build_config.sh@66 -- # CONFIG_HAVE_KEYUTILS=n 00:06:43.526 03:07:17 -- common/build_config.sh@67 -- # CONFIG_FC_PATH= 00:06:43.526 03:07:17 -- common/build_config.sh@68 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:43.526 03:07:17 -- common/build_config.sh@69 -- # CONFIG_FC=n 00:06:43.526 03:07:17 -- common/build_config.sh@70 -- # CONFIG_AVAHI=n 00:06:43.526 03:07:17 -- common/build_config.sh@71 -- # CONFIG_FIO_PLUGIN=y 00:06:43.526 03:07:17 -- common/build_config.sh@72 -- # CONFIG_RAID5F=n 00:06:43.526 03:07:17 -- common/build_config.sh@73 -- # CONFIG_EXAMPLES=y 00:06:43.526 03:07:17 -- common/build_config.sh@74 -- # CONFIG_TESTS=y 00:06:43.526 03:07:17 -- common/build_config.sh@75 -- # CONFIG_CRYPTO_MLX5=n 00:06:43.526 03:07:17 -- common/build_config.sh@76 -- # CONFIG_MAX_LCORES= 00:06:43.526 03:07:17 -- common/build_config.sh@77 -- # CONFIG_IPSEC_MB=n 00:06:43.526 03:07:17 -- common/build_config.sh@78 -- # CONFIG_PGO_DIR= 00:06:43.526 03:07:17 -- common/build_config.sh@79 -- # CONFIG_DEBUG=y 00:06:43.526 03:07:17 -- common/build_config.sh@80 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:43.526 03:07:17 -- common/build_config.sh@81 -- # CONFIG_CROSS_PREFIX= 00:06:43.526 03:07:17 -- common/build_config.sh@82 -- # CONFIG_URING=n 00:06:43.526 03:07:17 -- common/autotest_common.sh@53 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/applications.sh 00:06:43.526 03:07:17 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/applications.sh 00:06:43.526 03:07:17 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common 00:06:43.526 03:07:17 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common 00:06:43.526 03:07:17 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:06:43.526 03:07:17 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin 00:06:43.526 03:07:17 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/app 00:06:43.526 03:07:17 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples 00:06:43.526 03:07:17 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:43.526 03:07:17 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:43.526 03:07:17 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:43.526 03:07:17 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:43.526 03:07:17 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:43.526 03:07:17 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:43.526 03:07:17 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/include/spdk/config.h ]] 00:06:43.526 03:07:17 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:43.526 #define SPDK_CONFIG_H 00:06:43.526 #define SPDK_CONFIG_APPS 1 00:06:43.526 #define SPDK_CONFIG_ARCH native 00:06:43.526 #undef SPDK_CONFIG_ASAN 00:06:43.526 #undef SPDK_CONFIG_AVAHI 00:06:43.526 #undef SPDK_CONFIG_CET 00:06:43.526 #define SPDK_CONFIG_COVERAGE 1 00:06:43.526 #define SPDK_CONFIG_CROSS_PREFIX 00:06:43.526 #undef SPDK_CONFIG_CRYPTO 00:06:43.526 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:43.526 #undef SPDK_CONFIG_CUSTOMOCF 00:06:43.526 #undef SPDK_CONFIG_DAOS 00:06:43.526 #define SPDK_CONFIG_DAOS_DIR 00:06:43.526 #define SPDK_CONFIG_DEBUG 1 00:06:43.526 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:43.526 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build 00:06:43.526 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:43.526 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:43.526 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:43.526 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/env_dpdk 00:06:43.526 #define SPDK_CONFIG_EXAMPLES 1 00:06:43.526 #undef SPDK_CONFIG_FC 00:06:43.526 #define SPDK_CONFIG_FC_PATH 00:06:43.526 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:43.526 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:43.526 #undef SPDK_CONFIG_FUSE 00:06:43.526 #undef SPDK_CONFIG_FUZZER 00:06:43.526 #define SPDK_CONFIG_FUZZER_LIB 00:06:43.526 #undef SPDK_CONFIG_GOLANG 00:06:43.526 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:43.526 #define SPDK_CONFIG_HAVE_EVP_MAC 1 00:06:43.526 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:43.526 #undef SPDK_CONFIG_HAVE_KEYUTILS 00:06:43.526 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:43.526 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:43.526 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:43.526 #define SPDK_CONFIG_IDXD 1 00:06:43.526 #undef SPDK_CONFIG_IDXD_KERNEL 00:06:43.526 #undef SPDK_CONFIG_IPSEC_MB 00:06:43.526 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:43.526 #define SPDK_CONFIG_ISAL 1 00:06:43.526 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:43.526 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:43.526 #define SPDK_CONFIG_LIBDIR 00:06:43.526 #undef SPDK_CONFIG_LTO 00:06:43.526 #define SPDK_CONFIG_MAX_LCORES 00:06:43.526 #define SPDK_CONFIG_NVME_CUSE 1 00:06:43.526 #undef SPDK_CONFIG_OCF 00:06:43.526 #define SPDK_CONFIG_OCF_PATH 00:06:43.526 #define SPDK_CONFIG_OPENSSL_PATH 00:06:43.526 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:43.526 #define SPDK_CONFIG_PGO_DIR 00:06:43.526 #undef SPDK_CONFIG_PGO_USE 00:06:43.526 #define SPDK_CONFIG_PREFIX /usr/local 00:06:43.526 #undef SPDK_CONFIG_RAID5F 00:06:43.526 #undef SPDK_CONFIG_RBD 00:06:43.526 #define SPDK_CONFIG_RDMA 1 00:06:43.526 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:43.526 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:43.526 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:43.526 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:43.526 #define SPDK_CONFIG_SHARED 1 00:06:43.526 #undef SPDK_CONFIG_SMA 00:06:43.526 #define SPDK_CONFIG_TESTS 1 00:06:43.526 #undef SPDK_CONFIG_TSAN 00:06:43.526 #define SPDK_CONFIG_UBLK 1 00:06:43.526 #define SPDK_CONFIG_UBSAN 1 00:06:43.526 #undef SPDK_CONFIG_UNIT_TESTS 00:06:43.526 #undef SPDK_CONFIG_URING 00:06:43.526 #define SPDK_CONFIG_URING_PATH 00:06:43.526 #undef SPDK_CONFIG_URING_ZNS 00:06:43.526 #undef SPDK_CONFIG_USDT 00:06:43.526 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:43.526 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:43.526 #undef SPDK_CONFIG_VFIO_USER 00:06:43.526 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:43.526 #define SPDK_CONFIG_VHOST 1 00:06:43.526 #define SPDK_CONFIG_VIRTIO 1 00:06:43.526 #undef SPDK_CONFIG_VTUNE 00:06:43.526 #define SPDK_CONFIG_VTUNE_DIR 00:06:43.526 #define SPDK_CONFIG_WERROR 1 00:06:43.526 #define SPDK_CONFIG_WPDK_DIR 00:06:43.526 #undef SPDK_CONFIG_XNVME 00:06:43.526 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:43.526 03:07:17 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:43.526 03:07:17 -- common/autotest_common.sh@54 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:06:43.526 03:07:17 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:43.526 03:07:17 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:43.526 03:07:17 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:43.527 03:07:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.527 03:07:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.527 03:07:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.527 03:07:17 -- paths/export.sh@5 -- # export PATH 00:06:43.527 03:07:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.527 03:07:17 -- common/autotest_common.sh@55 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/common 00:06:43.527 03:07:17 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/common 00:06:43.527 03:07:17 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm 00:06:43.527 03:07:17 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm 00:06:43.527 03:07:17 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:43.527 03:07:17 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:06:43.527 03:07:17 -- pm/common@67 -- # TEST_TAG=N/A 00:06:43.527 03:07:17 -- pm/common@68 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/.run_test_name 00:06:43.527 03:07:17 -- pm/common@70 -- # PM_OUTPUTDIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power 00:06:43.527 03:07:17 -- pm/common@71 -- # uname -s 00:06:43.527 03:07:17 -- pm/common@71 -- # PM_OS=Linux 00:06:43.527 03:07:17 -- pm/common@73 -- # MONITOR_RESOURCES=(collect-cpu-load collect-vmstat) 00:06:43.527 03:07:17 -- pm/common@74 -- # [[ Linux == FreeBSD ]] 00:06:43.527 03:07:17 -- pm/common@76 -- # [[ Linux == Linux ]] 00:06:43.527 03:07:17 -- pm/common@76 -- # [[ ............................... != QEMU ]] 00:06:43.527 03:07:17 -- pm/common@76 -- # [[ ! -e /.dockerenv ]] 00:06:43.527 03:07:17 -- pm/common@79 -- # MONITOR_RESOURCES+=(collect-cpu-temp) 00:06:43.527 03:07:17 -- pm/common@80 -- # MONITOR_RESOURCES+=(collect-bmc-pm) 00:06:43.527 03:07:17 -- pm/common@83 -- # MONITOR_RESOURCES_PIDS=() 00:06:43.527 03:07:17 -- pm/common@83 -- # declare -A MONITOR_RESOURCES_PIDS 00:06:43.527 03:07:17 -- pm/common@85 -- # mkdir -p /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power 00:06:43.527 03:07:17 -- common/autotest_common.sh@57 -- # : 1 00:06:43.527 03:07:17 -- common/autotest_common.sh@58 -- # export RUN_NIGHTLY 00:06:43.527 03:07:17 -- common/autotest_common.sh@61 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@62 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:43.527 03:07:17 -- common/autotest_common.sh@63 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@64 -- # export SPDK_RUN_VALGRIND 00:06:43.527 03:07:17 -- common/autotest_common.sh@65 -- # : 1 00:06:43.527 03:07:17 -- common/autotest_common.sh@66 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:43.527 03:07:17 -- common/autotest_common.sh@67 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@68 -- # export SPDK_TEST_UNITTEST 00:06:43.527 03:07:17 -- common/autotest_common.sh@69 -- # : 00:06:43.527 03:07:17 -- common/autotest_common.sh@70 -- # export SPDK_TEST_AUTOBUILD 00:06:43.527 03:07:17 -- common/autotest_common.sh@71 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@72 -- # export SPDK_TEST_RELEASE_BUILD 00:06:43.527 03:07:17 -- common/autotest_common.sh@73 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@74 -- # export SPDK_TEST_ISAL 00:06:43.527 03:07:17 -- common/autotest_common.sh@75 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@76 -- # export SPDK_TEST_ISCSI 00:06:43.527 03:07:17 -- common/autotest_common.sh@77 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@78 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:43.527 03:07:17 -- common/autotest_common.sh@79 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@80 -- # export SPDK_TEST_NVME 00:06:43.527 03:07:17 -- common/autotest_common.sh@81 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@82 -- # export SPDK_TEST_NVME_PMR 00:06:43.527 03:07:17 -- common/autotest_common.sh@83 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@84 -- # export SPDK_TEST_NVME_BP 00:06:43.527 03:07:17 -- common/autotest_common.sh@85 -- # : 1 00:06:43.527 03:07:17 -- common/autotest_common.sh@86 -- # export SPDK_TEST_NVME_CLI 00:06:43.527 03:07:17 -- common/autotest_common.sh@87 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@88 -- # export SPDK_TEST_NVME_CUSE 00:06:43.527 03:07:17 -- common/autotest_common.sh@89 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@90 -- # export SPDK_TEST_NVME_FDP 00:06:43.527 03:07:17 -- common/autotest_common.sh@91 -- # : 1 00:06:43.527 03:07:17 -- common/autotest_common.sh@92 -- # export SPDK_TEST_NVMF 00:06:43.527 03:07:17 -- common/autotest_common.sh@93 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@94 -- # export SPDK_TEST_VFIOUSER 00:06:43.527 03:07:17 -- common/autotest_common.sh@95 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@96 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:43.527 03:07:17 -- common/autotest_common.sh@97 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@98 -- # export SPDK_TEST_FUZZER 00:06:43.527 03:07:17 -- common/autotest_common.sh@99 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@100 -- # export SPDK_TEST_FUZZER_SHORT 00:06:43.527 03:07:17 -- common/autotest_common.sh@101 -- # : rdma 00:06:43.527 03:07:17 -- common/autotest_common.sh@102 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:43.527 03:07:17 -- common/autotest_common.sh@103 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@104 -- # export SPDK_TEST_RBD 00:06:43.527 03:07:17 -- common/autotest_common.sh@105 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@106 -- # export SPDK_TEST_VHOST 00:06:43.527 03:07:17 -- common/autotest_common.sh@107 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@108 -- # export SPDK_TEST_BLOCKDEV 00:06:43.527 03:07:17 -- common/autotest_common.sh@109 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@110 -- # export SPDK_TEST_IOAT 00:06:43.527 03:07:17 -- common/autotest_common.sh@111 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@112 -- # export SPDK_TEST_BLOBFS 00:06:43.527 03:07:17 -- common/autotest_common.sh@113 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@114 -- # export SPDK_TEST_VHOST_INIT 00:06:43.527 03:07:17 -- common/autotest_common.sh@115 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@116 -- # export SPDK_TEST_LVOL 00:06:43.527 03:07:17 -- common/autotest_common.sh@117 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@118 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:43.527 03:07:17 -- common/autotest_common.sh@119 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@120 -- # export SPDK_RUN_ASAN 00:06:43.527 03:07:17 -- common/autotest_common.sh@121 -- # : 1 00:06:43.527 03:07:17 -- common/autotest_common.sh@122 -- # export SPDK_RUN_UBSAN 00:06:43.527 03:07:17 -- common/autotest_common.sh@123 -- # : 00:06:43.527 03:07:17 -- common/autotest_common.sh@124 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:43.527 03:07:17 -- common/autotest_common.sh@125 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@126 -- # export SPDK_RUN_NON_ROOT 00:06:43.527 03:07:17 -- common/autotest_common.sh@127 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@128 -- # export SPDK_TEST_CRYPTO 00:06:43.527 03:07:17 -- common/autotest_common.sh@129 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@130 -- # export SPDK_TEST_FTL 00:06:43.527 03:07:17 -- common/autotest_common.sh@131 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@132 -- # export SPDK_TEST_OCF 00:06:43.527 03:07:17 -- common/autotest_common.sh@133 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@134 -- # export SPDK_TEST_VMD 00:06:43.527 03:07:17 -- common/autotest_common.sh@135 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@136 -- # export SPDK_TEST_OPAL 00:06:43.527 03:07:17 -- common/autotest_common.sh@137 -- # : 00:06:43.527 03:07:17 -- common/autotest_common.sh@138 -- # export SPDK_TEST_NATIVE_DPDK 00:06:43.527 03:07:17 -- common/autotest_common.sh@139 -- # : true 00:06:43.527 03:07:17 -- common/autotest_common.sh@140 -- # export SPDK_AUTOTEST_X 00:06:43.527 03:07:17 -- common/autotest_common.sh@141 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@142 -- # export SPDK_TEST_RAID5 00:06:43.527 03:07:17 -- common/autotest_common.sh@143 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@144 -- # export SPDK_TEST_URING 00:06:43.527 03:07:17 -- common/autotest_common.sh@145 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@146 -- # export SPDK_TEST_USDT 00:06:43.527 03:07:17 -- common/autotest_common.sh@147 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@148 -- # export SPDK_TEST_USE_IGB_UIO 00:06:43.527 03:07:17 -- common/autotest_common.sh@149 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@150 -- # export SPDK_TEST_SCHEDULER 00:06:43.527 03:07:17 -- common/autotest_common.sh@151 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@152 -- # export SPDK_TEST_SCANBUILD 00:06:43.527 03:07:17 -- common/autotest_common.sh@153 -- # : e810 00:06:43.527 03:07:17 -- common/autotest_common.sh@154 -- # export SPDK_TEST_NVMF_NICS 00:06:43.527 03:07:17 -- common/autotest_common.sh@155 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@156 -- # export SPDK_TEST_SMA 00:06:43.527 03:07:17 -- common/autotest_common.sh@157 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@158 -- # export SPDK_TEST_DAOS 00:06:43.527 03:07:17 -- common/autotest_common.sh@159 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@160 -- # export SPDK_TEST_XNVME 00:06:43.527 03:07:17 -- common/autotest_common.sh@161 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@162 -- # export SPDK_TEST_ACCEL_DSA 00:06:43.527 03:07:17 -- common/autotest_common.sh@163 -- # : 0 00:06:43.527 03:07:17 -- common/autotest_common.sh@164 -- # export SPDK_TEST_ACCEL_IAA 00:06:43.527 03:07:17 -- common/autotest_common.sh@166 -- # : 00:06:43.527 03:07:17 -- common/autotest_common.sh@167 -- # export SPDK_TEST_FUZZER_TARGET 00:06:43.527 03:07:17 -- common/autotest_common.sh@168 -- # : 0 00:06:43.528 03:07:17 -- common/autotest_common.sh@169 -- # export SPDK_TEST_NVMF_MDNS 00:06:43.528 03:07:17 -- common/autotest_common.sh@170 -- # : 0 00:06:43.528 03:07:17 -- common/autotest_common.sh@171 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:43.528 03:07:17 -- common/autotest_common.sh@174 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib 00:06:43.528 03:07:17 -- common/autotest_common.sh@174 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib 00:06:43.528 03:07:17 -- common/autotest_common.sh@175 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib 00:06:43.528 03:07:17 -- common/autotest_common.sh@175 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib 00:06:43.528 03:07:17 -- common/autotest_common.sh@176 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:43.528 03:07:17 -- common/autotest_common.sh@176 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:43.528 03:07:17 -- common/autotest_common.sh@177 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:43.528 03:07:17 -- common/autotest_common.sh@177 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:43.528 03:07:17 -- common/autotest_common.sh@180 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:43.528 03:07:17 -- common/autotest_common.sh@180 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:43.528 03:07:17 -- common/autotest_common.sh@184 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python 00:06:43.528 03:07:17 -- common/autotest_common.sh@184 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python 00:06:43.528 03:07:17 -- common/autotest_common.sh@188 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:43.528 03:07:17 -- common/autotest_common.sh@188 -- # PYTHONDONTWRITEBYTECODE=1 00:06:43.528 03:07:17 -- common/autotest_common.sh@192 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:43.528 03:07:17 -- common/autotest_common.sh@192 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:43.528 03:07:17 -- common/autotest_common.sh@193 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:43.528 03:07:17 -- common/autotest_common.sh@193 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:43.528 03:07:17 -- common/autotest_common.sh@197 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:43.528 03:07:17 -- common/autotest_common.sh@198 -- # rm -rf /var/tmp/asan_suppression_file 00:06:43.528 03:07:17 -- common/autotest_common.sh@199 -- # cat 00:06:43.528 03:07:17 -- common/autotest_common.sh@225 -- # echo leak:libfuse3.so 00:06:43.528 03:07:17 -- common/autotest_common.sh@227 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:43.528 03:07:17 -- common/autotest_common.sh@227 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:43.528 03:07:17 -- common/autotest_common.sh@229 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:43.528 03:07:17 -- common/autotest_common.sh@229 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:43.528 03:07:17 -- common/autotest_common.sh@231 -- # '[' -z /var/spdk/dependencies ']' 00:06:43.528 03:07:17 -- common/autotest_common.sh@234 -- # export DEPENDENCY_DIR 00:06:43.528 03:07:17 -- common/autotest_common.sh@238 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin 00:06:43.528 03:07:17 -- common/autotest_common.sh@238 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin 00:06:43.528 03:07:17 -- common/autotest_common.sh@239 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples 00:06:43.528 03:07:17 -- common/autotest_common.sh@239 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples 00:06:43.528 03:07:17 -- common/autotest_common.sh@242 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:43.528 03:07:17 -- common/autotest_common.sh@242 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:43.528 03:07:17 -- common/autotest_common.sh@243 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:43.528 03:07:17 -- common/autotest_common.sh@243 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:43.528 03:07:17 -- common/autotest_common.sh@245 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:43.528 03:07:17 -- common/autotest_common.sh@245 -- # AR_TOOL=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:43.528 03:07:17 -- common/autotest_common.sh@248 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:43.528 03:07:17 -- common/autotest_common.sh@248 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:43.528 03:07:17 -- common/autotest_common.sh@251 -- # '[' 0 -eq 0 ']' 00:06:43.528 03:07:17 -- common/autotest_common.sh@252 -- # export valgrind= 00:06:43.528 03:07:17 -- common/autotest_common.sh@252 -- # valgrind= 00:06:43.528 03:07:17 -- common/autotest_common.sh@258 -- # uname -s 00:06:43.528 03:07:17 -- common/autotest_common.sh@258 -- # '[' Linux = Linux ']' 00:06:43.528 03:07:17 -- common/autotest_common.sh@259 -- # HUGEMEM=4096 00:06:43.528 03:07:17 -- common/autotest_common.sh@260 -- # export CLEAR_HUGE=yes 00:06:43.528 03:07:17 -- common/autotest_common.sh@260 -- # CLEAR_HUGE=yes 00:06:43.528 03:07:17 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:06:43.528 03:07:17 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:06:43.528 03:07:17 -- common/autotest_common.sh@268 -- # MAKE=make 00:06:43.528 03:07:17 -- common/autotest_common.sh@269 -- # MAKEFLAGS=-j96 00:06:43.528 03:07:17 -- common/autotest_common.sh@285 -- # export HUGEMEM=4096 00:06:43.528 03:07:17 -- common/autotest_common.sh@285 -- # HUGEMEM=4096 00:06:43.528 03:07:17 -- common/autotest_common.sh@287 -- # NO_HUGE=() 00:06:43.528 03:07:17 -- common/autotest_common.sh@288 -- # TEST_MODE= 00:06:43.528 03:07:17 -- common/autotest_common.sh@289 -- # for i in "$@" 00:06:43.528 03:07:17 -- common/autotest_common.sh@290 -- # case "$i" in 00:06:43.528 03:07:17 -- common/autotest_common.sh@295 -- # TEST_TRANSPORT=rdma 00:06:43.528 03:07:17 -- common/autotest_common.sh@307 -- # [[ -z 3929030 ]] 00:06:43.528 03:07:17 -- common/autotest_common.sh@307 -- # kill -0 3929030 00:06:43.528 03:07:17 -- common/autotest_common.sh@1666 -- # set_test_storage 2147483648 00:06:43.528 03:07:17 -- common/autotest_common.sh@317 -- # [[ -v testdir ]] 00:06:43.528 03:07:17 -- common/autotest_common.sh@319 -- # local requested_size=2147483648 00:06:43.528 03:07:17 -- common/autotest_common.sh@320 -- # local mount target_dir 00:06:43.528 03:07:17 -- common/autotest_common.sh@322 -- # local -A mounts fss sizes avails uses 00:06:43.528 03:07:17 -- common/autotest_common.sh@323 -- # local source fs size avail mount use 00:06:43.528 03:07:17 -- common/autotest_common.sh@325 -- # local storage_fallback storage_candidates 00:06:43.528 03:07:17 -- common/autotest_common.sh@327 -- # mktemp -udt spdk.XXXXXX 00:06:43.528 03:07:17 -- common/autotest_common.sh@327 -- # storage_fallback=/tmp/spdk.m8syWk 00:06:43.528 03:07:17 -- common/autotest_common.sh@332 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:43.528 03:07:17 -- common/autotest_common.sh@334 -- # [[ -n '' ]] 00:06:43.528 03:07:17 -- common/autotest_common.sh@339 -- # [[ -n '' ]] 00:06:43.528 03:07:17 -- common/autotest_common.sh@344 -- # mkdir -p /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target /tmp/spdk.m8syWk/tests/target /tmp/spdk.m8syWk 00:06:43.528 03:07:17 -- common/autotest_common.sh@347 -- # requested_size=2214592512 00:06:43.528 03:07:17 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:06:43.528 03:07:17 -- common/autotest_common.sh@316 -- # grep -v Filesystem 00:06:43.528 03:07:17 -- common/autotest_common.sh@316 -- # df -T 00:06:43.528 03:07:17 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_devtmpfs 00:06:43.528 03:07:17 -- common/autotest_common.sh@350 -- # fss["$mount"]=devtmpfs 00:06:43.528 03:07:17 -- common/autotest_common.sh@351 -- # avails["$mount"]=67108864 00:06:43.528 03:07:17 -- common/autotest_common.sh@351 -- # sizes["$mount"]=67108864 00:06:43.528 03:07:17 -- common/autotest_common.sh@352 -- # uses["$mount"]=0 00:06:43.528 03:07:17 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:06:43.528 03:07:17 -- common/autotest_common.sh@350 -- # mounts["$mount"]=/dev/pmem0 00:06:43.528 03:07:17 -- common/autotest_common.sh@350 -- # fss["$mount"]=ext2 00:06:43.528 03:07:17 -- common/autotest_common.sh@351 -- # avails["$mount"]=940740608 00:06:43.528 03:07:17 -- common/autotest_common.sh@351 -- # sizes["$mount"]=5284429824 00:06:43.528 03:07:17 -- common/autotest_common.sh@352 -- # uses["$mount"]=4343689216 00:06:43.528 03:07:17 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:06:43.528 03:07:17 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_root 00:06:43.528 03:07:17 -- common/autotest_common.sh@350 -- # fss["$mount"]=overlay 00:06:43.528 03:07:17 -- common/autotest_common.sh@351 -- # avails["$mount"]=89690718208 00:06:43.528 03:07:17 -- common/autotest_common.sh@351 -- # sizes["$mount"]=95562719232 00:06:43.528 03:07:17 -- common/autotest_common.sh@352 -- # uses["$mount"]=5872001024 00:06:43.528 03:07:17 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:06:43.528 03:07:17 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:06:43.528 03:07:17 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:06:43.528 03:07:17 -- common/autotest_common.sh@351 -- # avails["$mount"]=47780081664 00:06:43.528 03:07:17 -- common/autotest_common.sh@351 -- # sizes["$mount"]=47781359616 00:06:43.528 03:07:17 -- common/autotest_common.sh@352 -- # uses["$mount"]=1277952 00:06:43.528 03:07:17 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:06:43.528 03:07:17 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:06:43.528 03:07:17 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:06:43.529 03:07:17 -- common/autotest_common.sh@351 -- # avails["$mount"]=19102916608 00:06:43.529 03:07:17 -- common/autotest_common.sh@351 -- # sizes["$mount"]=19112546304 00:06:43.529 03:07:17 -- common/autotest_common.sh@352 -- # uses["$mount"]=9629696 00:06:43.529 03:07:17 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:06:43.529 03:07:17 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:06:43.529 03:07:17 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:06:43.529 03:07:17 -- common/autotest_common.sh@351 -- # avails["$mount"]=47780962304 00:06:43.529 03:07:17 -- common/autotest_common.sh@351 -- # sizes["$mount"]=47781359616 00:06:43.529 03:07:17 -- common/autotest_common.sh@352 -- # uses["$mount"]=397312 00:06:43.529 03:07:17 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:06:43.529 03:07:17 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:06:43.529 03:07:17 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:06:43.529 03:07:17 -- common/autotest_common.sh@351 -- # avails["$mount"]=9556267008 00:06:43.529 03:07:17 -- common/autotest_common.sh@351 -- # sizes["$mount"]=9556271104 00:06:43.529 03:07:17 -- common/autotest_common.sh@352 -- # uses["$mount"]=4096 00:06:43.529 03:07:17 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:06:43.529 03:07:17 -- common/autotest_common.sh@355 -- # printf '* Looking for test storage...\n' 00:06:43.529 * Looking for test storage... 00:06:43.529 03:07:17 -- common/autotest_common.sh@357 -- # local target_space new_size 00:06:43.529 03:07:17 -- common/autotest_common.sh@358 -- # for target_dir in "${storage_candidates[@]}" 00:06:43.529 03:07:17 -- common/autotest_common.sh@361 -- # df /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:06:43.529 03:07:17 -- common/autotest_common.sh@361 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:43.529 03:07:17 -- common/autotest_common.sh@361 -- # mount=/ 00:06:43.529 03:07:17 -- common/autotest_common.sh@363 -- # target_space=89690718208 00:06:43.529 03:07:17 -- common/autotest_common.sh@364 -- # (( target_space == 0 || target_space < requested_size )) 00:06:43.529 03:07:17 -- common/autotest_common.sh@367 -- # (( target_space >= requested_size )) 00:06:43.529 03:07:17 -- common/autotest_common.sh@369 -- # [[ overlay == tmpfs ]] 00:06:43.529 03:07:17 -- common/autotest_common.sh@369 -- # [[ overlay == ramfs ]] 00:06:43.529 03:07:17 -- common/autotest_common.sh@369 -- # [[ / == / ]] 00:06:43.529 03:07:17 -- common/autotest_common.sh@370 -- # new_size=8086593536 00:06:43.529 03:07:17 -- common/autotest_common.sh@371 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:43.529 03:07:17 -- common/autotest_common.sh@376 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:06:43.529 03:07:17 -- common/autotest_common.sh@376 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:06:43.529 03:07:17 -- common/autotest_common.sh@377 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:06:43.529 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:06:43.529 03:07:17 -- common/autotest_common.sh@378 -- # return 0 00:06:43.529 03:07:17 -- common/autotest_common.sh@1668 -- # set -o errtrace 00:06:43.529 03:07:17 -- common/autotest_common.sh@1669 -- # shopt -s extdebug 00:06:43.529 03:07:17 -- common/autotest_common.sh@1670 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:43.529 03:07:17 -- common/autotest_common.sh@1672 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:43.529 03:07:17 -- common/autotest_common.sh@1673 -- # true 00:06:43.529 03:07:17 -- common/autotest_common.sh@1675 -- # xtrace_fd 00:06:43.529 03:07:17 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:43.529 03:07:17 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:43.529 03:07:17 -- common/autotest_common.sh@27 -- # exec 00:06:43.529 03:07:17 -- common/autotest_common.sh@29 -- # exec 00:06:43.529 03:07:17 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:43.529 03:07:17 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:43.529 03:07:17 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:43.529 03:07:17 -- common/autotest_common.sh@18 -- # set -x 00:06:43.529 03:07:17 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:06:43.529 03:07:17 -- nvmf/common.sh@7 -- # uname -s 00:06:43.529 03:07:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:43.529 03:07:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:43.529 03:07:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:43.529 03:07:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:43.529 03:07:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:43.529 03:07:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:43.529 03:07:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:43.529 03:07:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:43.529 03:07:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:43.529 03:07:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:43.529 03:07:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:06:43.529 03:07:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:06:43.529 03:07:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:43.529 03:07:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:43.529 03:07:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:43.529 03:07:17 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:06:43.529 03:07:17 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:06:43.529 03:07:17 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:43.529 03:07:17 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:43.529 03:07:17 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:43.529 03:07:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.529 03:07:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.529 03:07:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.529 03:07:17 -- paths/export.sh@5 -- # export PATH 00:06:43.529 03:07:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.529 03:07:17 -- nvmf/common.sh@47 -- # : 0 00:06:43.529 03:07:17 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:06:43.529 03:07:17 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:06:43.529 03:07:17 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:06:43.529 03:07:17 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:43.529 03:07:17 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:43.529 03:07:17 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:06:43.529 03:07:17 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:06:43.529 03:07:17 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:06:43.529 03:07:17 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:43.529 03:07:17 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:43.529 03:07:17 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:43.529 03:07:17 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:06:43.529 03:07:17 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:43.529 03:07:17 -- nvmf/common.sh@437 -- # prepare_net_devs 00:06:43.529 03:07:17 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:06:43.529 03:07:17 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:06:43.529 03:07:17 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:43.529 03:07:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:43.529 03:07:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:43.529 03:07:17 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:06:43.529 03:07:17 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:06:43.529 03:07:17 -- nvmf/common.sh@285 -- # xtrace_disable 00:06:43.529 03:07:17 -- common/autotest_common.sh@10 -- # set +x 00:06:48.804 03:07:23 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:48.804 03:07:23 -- nvmf/common.sh@291 -- # pci_devs=() 00:06:48.804 03:07:23 -- nvmf/common.sh@291 -- # local -a pci_devs 00:06:48.804 03:07:23 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:06:48.804 03:07:23 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:06:48.804 03:07:23 -- nvmf/common.sh@293 -- # pci_drivers=() 00:06:48.804 03:07:23 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:06:48.804 03:07:23 -- nvmf/common.sh@295 -- # net_devs=() 00:06:48.804 03:07:23 -- nvmf/common.sh@295 -- # local -ga net_devs 00:06:48.804 03:07:23 -- nvmf/common.sh@296 -- # e810=() 00:06:48.804 03:07:23 -- nvmf/common.sh@296 -- # local -ga e810 00:06:48.804 03:07:23 -- nvmf/common.sh@297 -- # x722=() 00:06:48.804 03:07:23 -- nvmf/common.sh@297 -- # local -ga x722 00:06:48.804 03:07:23 -- nvmf/common.sh@298 -- # mlx=() 00:06:48.804 03:07:23 -- nvmf/common.sh@298 -- # local -ga mlx 00:06:48.804 03:07:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:48.804 03:07:23 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:48.804 03:07:23 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:48.804 03:07:23 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:48.804 03:07:23 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:48.804 03:07:23 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:48.804 03:07:23 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:48.804 03:07:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:48.804 03:07:23 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:48.804 03:07:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:48.804 03:07:23 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:48.804 03:07:23 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:06:48.804 03:07:23 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:06:48.804 03:07:23 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:06:48.804 03:07:23 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:06:48.804 03:07:23 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:06:48.804 03:07:23 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:06:48.804 03:07:23 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:06:48.804 03:07:23 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:06:48.804 03:07:23 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:06:48.804 03:07:23 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:06:48.804 Found 0000:af:00.0 (0x8086 - 0x159b) 00:06:48.804 03:07:23 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:06:48.804 03:07:23 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:06:48.804 03:07:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:48.804 03:07:23 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:48.804 03:07:23 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:06:48.804 03:07:23 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:06:48.805 03:07:23 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:06:48.805 03:07:23 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:06:48.805 Found 0000:af:00.1 (0x8086 - 0x159b) 00:06:48.805 03:07:23 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:06:48.805 03:07:23 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:06:48.805 03:07:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:48.805 03:07:23 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:48.805 03:07:23 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:06:48.805 03:07:23 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:06:48.805 03:07:23 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:06:48.805 03:07:23 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:06:48.805 03:07:23 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:06:48.805 03:07:23 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:06:48.805 03:07:23 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:06:48.805 03:07:23 -- nvmf/common.sh@377 -- # modinfo irdma 00:06:48.805 03:07:23 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:06:48.805 03:07:23 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:06:48.805 03:07:23 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:48.805 03:07:23 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:06:48.805 03:07:23 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:48.805 03:07:23 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:06:48.805 Found net devices under 0000:af:00.0: cvl_0_0 00:06:48.805 03:07:23 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:06:48.805 03:07:23 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:06:48.805 03:07:23 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:48.805 03:07:23 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:06:48.805 03:07:23 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:48.805 03:07:23 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:06:48.805 Found net devices under 0000:af:00.1: cvl_0_1 00:06:48.805 03:07:23 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:06:48.805 03:07:23 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:06:48.805 03:07:23 -- nvmf/common.sh@403 -- # is_hw=yes 00:06:48.805 03:07:23 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:06:48.805 03:07:23 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:06:48.805 03:07:23 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:06:48.805 03:07:23 -- nvmf/common.sh@409 -- # rdma_device_init 00:06:48.805 03:07:23 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:06:48.805 03:07:23 -- nvmf/common.sh@58 -- # uname 00:06:48.805 03:07:23 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:06:48.805 03:07:23 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:06:48.805 03:07:23 -- nvmf/common.sh@63 -- # modprobe ib_core 00:06:48.805 03:07:23 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:06:48.805 03:07:23 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:06:48.805 03:07:23 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:06:48.805 03:07:23 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:06:48.805 03:07:23 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:06:48.805 03:07:23 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:06:48.805 03:07:23 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:06:48.805 03:07:23 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:06:48.805 03:07:23 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:06:48.805 03:07:23 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:06:48.805 03:07:23 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:06:48.805 03:07:23 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:06:48.805 03:07:23 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:06:48.805 03:07:23 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:48.805 03:07:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:48.805 03:07:23 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:06:48.805 03:07:23 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:06:48.805 03:07:23 -- nvmf/common.sh@105 -- # continue 2 00:06:48.805 03:07:23 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:48.805 03:07:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:48.805 03:07:23 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:06:48.805 03:07:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:48.805 03:07:23 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:06:48.805 03:07:23 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:06:48.805 03:07:23 -- nvmf/common.sh@105 -- # continue 2 00:06:48.805 03:07:23 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:06:48.805 03:07:23 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:06:48.805 03:07:23 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:06:48.805 03:07:23 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:06:48.805 03:07:23 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:48.805 03:07:23 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:48.805 03:07:23 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:06:48.805 03:07:23 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:06:48.805 03:07:23 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:06:48.805 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:06:48.805 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:06:48.805 altname enp175s0f0np0 00:06:48.805 altname ens801f0np0 00:06:48.805 inet 192.168.100.8/24 scope global cvl_0_0 00:06:48.805 valid_lft forever preferred_lft forever 00:06:48.805 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:06:48.805 valid_lft forever preferred_lft forever 00:06:48.805 03:07:23 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:06:48.805 03:07:23 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:06:48.805 03:07:23 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:06:48.805 03:07:23 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:06:48.805 03:07:23 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:48.805 03:07:23 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:48.805 03:07:23 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:06:48.805 03:07:23 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:06:48.805 03:07:23 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:06:48.805 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:06:48.805 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:06:48.805 altname enp175s0f1np1 00:06:48.805 altname ens801f1np1 00:06:48.805 inet 192.168.100.9/24 scope global cvl_0_1 00:06:48.805 valid_lft forever preferred_lft forever 00:06:48.805 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:06:48.805 valid_lft forever preferred_lft forever 00:06:48.805 03:07:23 -- nvmf/common.sh@411 -- # return 0 00:06:48.805 03:07:23 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:06:48.805 03:07:23 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:06:48.805 03:07:23 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:06:48.805 03:07:23 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:06:48.805 03:07:23 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:06:48.805 03:07:23 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:06:48.805 03:07:23 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:06:48.805 03:07:23 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:06:48.805 03:07:23 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:06:48.805 03:07:23 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:06:48.805 03:07:23 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:48.805 03:07:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:48.805 03:07:23 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:06:48.805 03:07:23 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:06:48.805 03:07:23 -- nvmf/common.sh@105 -- # continue 2 00:06:48.805 03:07:23 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:48.805 03:07:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:48.805 03:07:23 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:06:48.805 03:07:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:48.805 03:07:23 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:06:48.805 03:07:23 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:06:48.805 03:07:23 -- nvmf/common.sh@105 -- # continue 2 00:06:48.805 03:07:23 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:06:48.805 03:07:23 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:06:48.805 03:07:23 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:06:48.805 03:07:23 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:06:48.805 03:07:23 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:48.805 03:07:23 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:48.805 03:07:23 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:06:48.805 03:07:23 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:06:48.805 03:07:23 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:06:48.805 03:07:23 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:06:48.805 03:07:23 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:48.805 03:07:23 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:48.805 03:07:23 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:06:48.805 192.168.100.9' 00:06:48.805 03:07:23 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:06:48.805 192.168.100.9' 00:06:48.805 03:07:23 -- nvmf/common.sh@446 -- # head -n 1 00:06:48.805 03:07:23 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:06:48.805 03:07:23 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:06:48.805 192.168.100.9' 00:06:48.805 03:07:23 -- nvmf/common.sh@447 -- # tail -n +2 00:06:48.805 03:07:23 -- nvmf/common.sh@447 -- # head -n 1 00:06:48.805 03:07:23 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:06:48.805 03:07:23 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:06:48.805 03:07:23 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:06:48.805 03:07:23 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:06:48.805 03:07:23 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:06:48.805 03:07:23 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:06:48.805 03:07:23 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:06:48.805 03:07:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:48.805 03:07:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:48.805 03:07:23 -- common/autotest_common.sh@10 -- # set +x 00:06:49.064 ************************************ 00:06:49.064 START TEST nvmf_filesystem_no_in_capsule 00:06:49.064 ************************************ 00:06:49.064 03:07:23 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_part 0 00:06:49.064 03:07:23 -- target/filesystem.sh@47 -- # in_capsule=0 00:06:49.064 03:07:23 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:49.064 03:07:23 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:06:49.064 03:07:23 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:49.064 03:07:23 -- common/autotest_common.sh@10 -- # set +x 00:06:49.064 03:07:23 -- nvmf/common.sh@470 -- # nvmfpid=3932428 00:06:49.064 03:07:23 -- nvmf/common.sh@471 -- # waitforlisten 3932428 00:06:49.064 03:07:23 -- common/autotest_common.sh@817 -- # '[' -z 3932428 ']' 00:06:49.064 03:07:23 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:49.064 03:07:23 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:49.064 03:07:23 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:49.064 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:49.064 03:07:23 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:49.064 03:07:23 -- common/autotest_common.sh@10 -- # set +x 00:06:49.064 03:07:23 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:49.064 [2024-04-25 03:07:23.436056] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:06:49.064 [2024-04-25 03:07:23.436097] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:49.064 EAL: No free 2048 kB hugepages reported on node 1 00:06:49.064 [2024-04-25 03:07:23.497251] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:49.323 [2024-04-25 03:07:23.575731] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:49.323 [2024-04-25 03:07:23.575764] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:49.323 [2024-04-25 03:07:23.575771] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:06:49.323 [2024-04-25 03:07:23.575777] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:06:49.323 [2024-04-25 03:07:23.575782] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:49.323 [2024-04-25 03:07:23.575829] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:49.323 [2024-04-25 03:07:23.575844] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:49.323 [2024-04-25 03:07:23.575935] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:49.323 [2024-04-25 03:07:23.575937] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:49.891 03:07:24 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:49.891 03:07:24 -- common/autotest_common.sh@850 -- # return 0 00:06:49.891 03:07:24 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:06:49.891 03:07:24 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:49.891 03:07:24 -- common/autotest_common.sh@10 -- # set +x 00:06:49.891 03:07:24 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:49.891 03:07:24 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:49.891 03:07:24 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -c 0 00:06:49.891 03:07:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:49.891 03:07:24 -- common/autotest_common.sh@10 -- # set +x 00:06:49.891 [2024-04-25 03:07:24.282747] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:06:49.891 [2024-04-25 03:07:24.297120] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x17b2ea0/0x17b24e0) succeed. 00:06:49.891 [2024-04-25 03:07:24.306945] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x17b4210/0x17b2a60) succeed. 00:06:49.891 [2024-04-25 03:07:24.306967] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:06:49.891 03:07:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:49.891 03:07:24 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:49.891 03:07:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:49.891 03:07:24 -- common/autotest_common.sh@10 -- # set +x 00:06:50.150 Malloc1 00:06:50.150 03:07:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:50.150 03:07:24 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:50.150 03:07:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:50.150 03:07:24 -- common/autotest_common.sh@10 -- # set +x 00:06:50.150 03:07:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:50.150 03:07:24 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:50.150 03:07:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:50.150 03:07:24 -- common/autotest_common.sh@10 -- # set +x 00:06:50.150 03:07:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:50.150 03:07:24 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:06:50.150 03:07:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:50.150 03:07:24 -- common/autotest_common.sh@10 -- # set +x 00:06:50.150 [2024-04-25 03:07:24.466070] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:06:50.150 03:07:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:50.150 03:07:24 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:50.150 03:07:24 -- common/autotest_common.sh@1364 -- # local bdev_name=Malloc1 00:06:50.150 03:07:24 -- common/autotest_common.sh@1365 -- # local bdev_info 00:06:50.150 03:07:24 -- common/autotest_common.sh@1366 -- # local bs 00:06:50.150 03:07:24 -- common/autotest_common.sh@1367 -- # local nb 00:06:50.150 03:07:24 -- common/autotest_common.sh@1368 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:50.150 03:07:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:50.150 03:07:24 -- common/autotest_common.sh@10 -- # set +x 00:06:50.150 03:07:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:50.150 03:07:24 -- common/autotest_common.sh@1368 -- # bdev_info='[ 00:06:50.150 { 00:06:50.150 "name": "Malloc1", 00:06:50.150 "aliases": [ 00:06:50.150 "355fa4e9-e93d-4cc1-9775-5c33f750c0a0" 00:06:50.150 ], 00:06:50.150 "product_name": "Malloc disk", 00:06:50.150 "block_size": 512, 00:06:50.150 "num_blocks": 1048576, 00:06:50.150 "uuid": "355fa4e9-e93d-4cc1-9775-5c33f750c0a0", 00:06:50.150 "assigned_rate_limits": { 00:06:50.150 "rw_ios_per_sec": 0, 00:06:50.150 "rw_mbytes_per_sec": 0, 00:06:50.150 "r_mbytes_per_sec": 0, 00:06:50.150 "w_mbytes_per_sec": 0 00:06:50.150 }, 00:06:50.150 "claimed": true, 00:06:50.150 "claim_type": "exclusive_write", 00:06:50.150 "zoned": false, 00:06:50.150 "supported_io_types": { 00:06:50.150 "read": true, 00:06:50.150 "write": true, 00:06:50.150 "unmap": true, 00:06:50.150 "write_zeroes": true, 00:06:50.150 "flush": true, 00:06:50.150 "reset": true, 00:06:50.150 "compare": false, 00:06:50.150 "compare_and_write": false, 00:06:50.150 "abort": true, 00:06:50.150 "nvme_admin": false, 00:06:50.150 "nvme_io": false 00:06:50.150 }, 00:06:50.150 "memory_domains": [ 00:06:50.150 { 00:06:50.150 "dma_device_id": "system", 00:06:50.150 "dma_device_type": 1 00:06:50.150 }, 00:06:50.150 { 00:06:50.150 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:50.150 "dma_device_type": 2 00:06:50.150 } 00:06:50.150 ], 00:06:50.150 "driver_specific": {} 00:06:50.150 } 00:06:50.150 ]' 00:06:50.150 03:07:24 -- common/autotest_common.sh@1369 -- # jq '.[] .block_size' 00:06:50.150 03:07:24 -- common/autotest_common.sh@1369 -- # bs=512 00:06:50.150 03:07:24 -- common/autotest_common.sh@1370 -- # jq '.[] .num_blocks' 00:06:50.150 03:07:24 -- common/autotest_common.sh@1370 -- # nb=1048576 00:06:50.150 03:07:24 -- common/autotest_common.sh@1373 -- # bdev_size=512 00:06:50.150 03:07:24 -- common/autotest_common.sh@1374 -- # echo 512 00:06:50.150 03:07:24 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:50.151 03:07:24 -- target/filesystem.sh@60 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:06:50.409 03:07:24 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:50.409 03:07:24 -- common/autotest_common.sh@1184 -- # local i=0 00:06:50.409 03:07:24 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:06:50.409 03:07:24 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:06:50.409 03:07:24 -- common/autotest_common.sh@1191 -- # sleep 2 00:06:52.314 03:07:26 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:06:52.314 03:07:26 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:06:52.314 03:07:26 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:06:52.573 03:07:26 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:06:52.573 03:07:26 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:06:52.573 03:07:26 -- common/autotest_common.sh@1194 -- # return 0 00:06:52.573 03:07:26 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:06:52.573 03:07:26 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:06:52.573 03:07:26 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:06:52.573 03:07:26 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:06:52.573 03:07:26 -- setup/common.sh@76 -- # local dev=nvme0n1 00:06:52.573 03:07:26 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:06:52.573 03:07:26 -- setup/common.sh@80 -- # echo 536870912 00:06:52.573 03:07:26 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:06:52.573 03:07:26 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:06:52.573 03:07:26 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:06:52.573 03:07:26 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:06:52.573 03:07:26 -- target/filesystem.sh@69 -- # partprobe 00:06:52.832 03:07:27 -- target/filesystem.sh@70 -- # sleep 1 00:06:53.834 03:07:28 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:06:53.834 03:07:28 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:06:53.834 03:07:28 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:53.834 03:07:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:53.834 03:07:28 -- common/autotest_common.sh@10 -- # set +x 00:06:53.834 ************************************ 00:06:53.834 START TEST filesystem_ext4 00:06:53.834 ************************************ 00:06:53.834 03:07:28 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create ext4 nvme0n1 00:06:53.834 03:07:28 -- target/filesystem.sh@18 -- # fstype=ext4 00:06:53.834 03:07:28 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:53.834 03:07:28 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:06:53.834 03:07:28 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:06:53.834 03:07:28 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:53.834 03:07:28 -- common/autotest_common.sh@914 -- # local i=0 00:06:53.834 03:07:28 -- common/autotest_common.sh@915 -- # local force 00:06:53.834 03:07:28 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:06:53.834 03:07:28 -- common/autotest_common.sh@918 -- # force=-F 00:06:53.834 03:07:28 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:06:53.834 mke2fs 1.46.5 (30-Dec-2021) 00:06:53.834 Discarding device blocks: 0/522240 done 00:06:53.834 Creating filesystem with 522240 1k blocks and 130560 inodes 00:06:53.834 Filesystem UUID: b25df32f-79a8-4d9f-aa31-a1fa33e92fb4 00:06:53.834 Superblock backups stored on blocks: 00:06:53.834 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:06:53.834 00:06:53.834 Allocating group tables: 0/64 done 00:06:53.834 Writing inode tables: 0/64 done 00:06:53.834 Creating journal (8192 blocks): done 00:06:53.834 Writing superblocks and filesystem accounting information: 0/64 done 00:06:53.834 00:06:53.834 03:07:28 -- common/autotest_common.sh@931 -- # return 0 00:06:53.834 03:07:28 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:54.093 03:07:28 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:54.093 03:07:28 -- target/filesystem.sh@25 -- # sync 00:06:54.093 03:07:28 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:54.093 03:07:28 -- target/filesystem.sh@27 -- # sync 00:06:54.093 03:07:28 -- target/filesystem.sh@29 -- # i=0 00:06:54.093 03:07:28 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:54.093 03:07:28 -- target/filesystem.sh@37 -- # kill -0 3932428 00:06:54.093 03:07:28 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:54.093 03:07:28 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:54.093 03:07:28 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:54.093 03:07:28 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:54.093 00:06:54.093 real 0m0.175s 00:06:54.093 user 0m0.029s 00:06:54.093 sys 0m0.057s 00:06:54.093 03:07:28 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:54.093 03:07:28 -- common/autotest_common.sh@10 -- # set +x 00:06:54.093 ************************************ 00:06:54.093 END TEST filesystem_ext4 00:06:54.093 ************************************ 00:06:54.093 03:07:28 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:06:54.094 03:07:28 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:54.094 03:07:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:54.094 03:07:28 -- common/autotest_common.sh@10 -- # set +x 00:06:54.094 ************************************ 00:06:54.094 START TEST filesystem_btrfs 00:06:54.094 ************************************ 00:06:54.094 03:07:28 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create btrfs nvme0n1 00:06:54.094 03:07:28 -- target/filesystem.sh@18 -- # fstype=btrfs 00:06:54.094 03:07:28 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:54.094 03:07:28 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:06:54.094 03:07:28 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:06:54.094 03:07:28 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:54.094 03:07:28 -- common/autotest_common.sh@914 -- # local i=0 00:06:54.094 03:07:28 -- common/autotest_common.sh@915 -- # local force 00:06:54.094 03:07:28 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:06:54.094 03:07:28 -- common/autotest_common.sh@920 -- # force=-f 00:06:54.094 03:07:28 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:06:54.353 btrfs-progs v6.6.2 00:06:54.353 See https://btrfs.readthedocs.io for more information. 00:06:54.353 00:06:54.353 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:06:54.353 NOTE: several default settings have changed in version 5.15, please make sure 00:06:54.353 this does not affect your deployments: 00:06:54.353 - DUP for metadata (-m dup) 00:06:54.353 - enabled no-holes (-O no-holes) 00:06:54.353 - enabled free-space-tree (-R free-space-tree) 00:06:54.353 00:06:54.353 Label: (null) 00:06:54.353 UUID: 066bb052-9bf1-4723-ab13-e2f10af2da2a 00:06:54.353 Node size: 16384 00:06:54.353 Sector size: 4096 00:06:54.353 Filesystem size: 510.00MiB 00:06:54.353 Block group profiles: 00:06:54.353 Data: single 8.00MiB 00:06:54.353 Metadata: DUP 32.00MiB 00:06:54.353 System: DUP 8.00MiB 00:06:54.353 SSD detected: yes 00:06:54.353 Zoned device: no 00:06:54.353 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:06:54.353 Runtime features: free-space-tree 00:06:54.353 Checksum: crc32c 00:06:54.353 Number of devices: 1 00:06:54.353 Devices: 00:06:54.353 ID SIZE PATH 00:06:54.353 1 510.00MiB /dev/nvme0n1p1 00:06:54.353 00:06:54.353 03:07:28 -- common/autotest_common.sh@931 -- # return 0 00:06:54.353 03:07:28 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:54.353 03:07:28 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:54.353 03:07:28 -- target/filesystem.sh@25 -- # sync 00:06:54.353 03:07:28 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:54.353 03:07:28 -- target/filesystem.sh@27 -- # sync 00:06:54.353 03:07:28 -- target/filesystem.sh@29 -- # i=0 00:06:54.353 03:07:28 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:54.353 03:07:28 -- target/filesystem.sh@37 -- # kill -0 3932428 00:06:54.353 03:07:28 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:54.353 03:07:28 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:54.613 03:07:28 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:54.613 03:07:28 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:54.613 00:06:54.613 real 0m0.299s 00:06:54.613 user 0m0.032s 00:06:54.613 sys 0m0.160s 00:06:54.613 03:07:28 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:54.613 03:07:28 -- common/autotest_common.sh@10 -- # set +x 00:06:54.613 ************************************ 00:06:54.613 END TEST filesystem_btrfs 00:06:54.613 ************************************ 00:06:54.613 03:07:28 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:06:54.613 03:07:28 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:54.613 03:07:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:54.613 03:07:28 -- common/autotest_common.sh@10 -- # set +x 00:06:54.613 ************************************ 00:06:54.613 START TEST filesystem_xfs 00:06:54.613 ************************************ 00:06:54.613 03:07:29 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create xfs nvme0n1 00:06:54.613 03:07:29 -- target/filesystem.sh@18 -- # fstype=xfs 00:06:54.613 03:07:29 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:54.613 03:07:29 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:06:54.613 03:07:29 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:06:54.613 03:07:29 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:54.613 03:07:29 -- common/autotest_common.sh@914 -- # local i=0 00:06:54.613 03:07:29 -- common/autotest_common.sh@915 -- # local force 00:06:54.613 03:07:29 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:06:54.613 03:07:29 -- common/autotest_common.sh@920 -- # force=-f 00:06:54.613 03:07:29 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:06:54.872 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:06:54.872 = sectsz=512 attr=2, projid32bit=1 00:06:54.872 = crc=1 finobt=1, sparse=1, rmapbt=0 00:06:54.872 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:06:54.872 data = bsize=4096 blocks=130560, imaxpct=25 00:06:54.872 = sunit=0 swidth=0 blks 00:06:54.872 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:06:54.872 log =internal log bsize=4096 blocks=16384, version=2 00:06:54.872 = sectsz=512 sunit=0 blks, lazy-count=1 00:06:54.872 realtime =none extsz=4096 blocks=0, rtextents=0 00:06:54.872 Discarding blocks...Done. 00:06:54.872 03:07:29 -- common/autotest_common.sh@931 -- # return 0 00:06:54.872 03:07:29 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:55.440 03:07:29 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:55.440 03:07:29 -- target/filesystem.sh@25 -- # sync 00:06:55.440 03:07:29 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:55.440 03:07:29 -- target/filesystem.sh@27 -- # sync 00:06:55.440 03:07:29 -- target/filesystem.sh@29 -- # i=0 00:06:55.440 03:07:29 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:55.440 03:07:29 -- target/filesystem.sh@37 -- # kill -0 3932428 00:06:55.440 03:07:29 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:55.440 03:07:29 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:55.440 03:07:29 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:55.440 03:07:29 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:55.440 00:06:55.440 real 0m0.668s 00:06:55.440 user 0m0.016s 00:06:55.440 sys 0m0.105s 00:06:55.440 03:07:29 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:55.440 03:07:29 -- common/autotest_common.sh@10 -- # set +x 00:06:55.440 ************************************ 00:06:55.440 END TEST filesystem_xfs 00:06:55.440 ************************************ 00:06:55.440 03:07:29 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:06:55.440 03:07:29 -- target/filesystem.sh@93 -- # sync 00:06:55.441 03:07:29 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:06:56.377 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:06:56.377 03:07:30 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:06:56.377 03:07:30 -- common/autotest_common.sh@1205 -- # local i=0 00:06:56.377 03:07:30 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:06:56.377 03:07:30 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:56.377 03:07:30 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:06:56.377 03:07:30 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:56.377 03:07:30 -- common/autotest_common.sh@1217 -- # return 0 00:06:56.377 03:07:30 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:06:56.377 03:07:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:56.377 03:07:30 -- common/autotest_common.sh@10 -- # set +x 00:06:56.377 03:07:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:56.378 03:07:30 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:06:56.378 03:07:30 -- target/filesystem.sh@101 -- # killprocess 3932428 00:06:56.378 03:07:30 -- common/autotest_common.sh@936 -- # '[' -z 3932428 ']' 00:06:56.378 03:07:30 -- common/autotest_common.sh@940 -- # kill -0 3932428 00:06:56.378 03:07:30 -- common/autotest_common.sh@941 -- # uname 00:06:56.378 03:07:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:56.378 03:07:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3932428 00:06:56.378 03:07:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:56.378 03:07:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:56.378 03:07:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3932428' 00:06:56.378 killing process with pid 3932428 00:06:56.378 03:07:30 -- common/autotest_common.sh@955 -- # kill 3932428 00:06:56.378 03:07:30 -- common/autotest_common.sh@960 -- # wait 3932428 00:06:56.378 [2024-04-25 03:07:30.742644] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:06:56.637 03:07:31 -- target/filesystem.sh@102 -- # nvmfpid= 00:06:56.637 00:06:56.637 real 0m7.711s 00:06:56.637 user 0m30.222s 00:06:56.637 sys 0m1.243s 00:06:56.637 03:07:31 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:56.637 03:07:31 -- common/autotest_common.sh@10 -- # set +x 00:06:56.637 ************************************ 00:06:56.637 END TEST nvmf_filesystem_no_in_capsule 00:06:56.637 ************************************ 00:06:56.637 03:07:31 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:06:56.637 03:07:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:56.637 03:07:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:56.637 03:07:31 -- common/autotest_common.sh@10 -- # set +x 00:06:56.896 ************************************ 00:06:56.896 START TEST nvmf_filesystem_in_capsule 00:06:56.896 ************************************ 00:06:56.896 03:07:31 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_part 4096 00:06:56.896 03:07:31 -- target/filesystem.sh@47 -- # in_capsule=4096 00:06:56.896 03:07:31 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:56.896 03:07:31 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:06:56.896 03:07:31 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:56.896 03:07:31 -- common/autotest_common.sh@10 -- # set +x 00:06:56.896 03:07:31 -- nvmf/common.sh@470 -- # nvmfpid=3933957 00:06:56.896 03:07:31 -- nvmf/common.sh@471 -- # waitforlisten 3933957 00:06:56.896 03:07:31 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:56.896 03:07:31 -- common/autotest_common.sh@817 -- # '[' -z 3933957 ']' 00:06:56.896 03:07:31 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:56.896 03:07:31 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:56.896 03:07:31 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:56.896 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:56.896 03:07:31 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:56.896 03:07:31 -- common/autotest_common.sh@10 -- # set +x 00:06:56.896 [2024-04-25 03:07:31.325067] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:06:56.896 [2024-04-25 03:07:31.325112] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:56.896 EAL: No free 2048 kB hugepages reported on node 1 00:06:56.896 [2024-04-25 03:07:31.388351] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:57.154 [2024-04-25 03:07:31.458794] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:57.154 [2024-04-25 03:07:31.458836] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:57.154 [2024-04-25 03:07:31.458842] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:06:57.154 [2024-04-25 03:07:31.458848] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:06:57.154 [2024-04-25 03:07:31.458852] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:57.154 [2024-04-25 03:07:31.458952] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:57.154 [2024-04-25 03:07:31.459071] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:57.154 [2024-04-25 03:07:31.459163] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:57.154 [2024-04-25 03:07:31.459164] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:57.722 03:07:32 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:57.722 03:07:32 -- common/autotest_common.sh@850 -- # return 0 00:06:57.722 03:07:32 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:06:57.722 03:07:32 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:57.722 03:07:32 -- common/autotest_common.sh@10 -- # set +x 00:06:57.722 03:07:32 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:57.722 03:07:32 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:57.722 03:07:32 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -c 4096 00:06:57.722 03:07:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:57.722 03:07:32 -- common/autotest_common.sh@10 -- # set +x 00:06:57.722 [2024-04-25 03:07:32.178309] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x204fea0/0x204f4e0) succeed. 00:06:57.722 [2024-04-25 03:07:32.188331] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x2051210/0x204fa60) succeed. 00:06:57.722 [2024-04-25 03:07:32.188353] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:06:57.722 03:07:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:57.722 03:07:32 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:57.722 03:07:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:57.722 03:07:32 -- common/autotest_common.sh@10 -- # set +x 00:06:57.981 Malloc1 00:06:57.981 03:07:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:57.981 03:07:32 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:57.981 03:07:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:57.981 03:07:32 -- common/autotest_common.sh@10 -- # set +x 00:06:57.981 03:07:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:57.981 03:07:32 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:57.981 03:07:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:57.981 03:07:32 -- common/autotest_common.sh@10 -- # set +x 00:06:57.981 03:07:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:57.981 03:07:32 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:06:57.981 03:07:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:57.981 03:07:32 -- common/autotest_common.sh@10 -- # set +x 00:06:57.981 [2024-04-25 03:07:32.347473] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:06:57.981 03:07:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:57.981 03:07:32 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:57.981 03:07:32 -- common/autotest_common.sh@1364 -- # local bdev_name=Malloc1 00:06:57.981 03:07:32 -- common/autotest_common.sh@1365 -- # local bdev_info 00:06:57.981 03:07:32 -- common/autotest_common.sh@1366 -- # local bs 00:06:57.981 03:07:32 -- common/autotest_common.sh@1367 -- # local nb 00:06:57.981 03:07:32 -- common/autotest_common.sh@1368 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:57.981 03:07:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:57.981 03:07:32 -- common/autotest_common.sh@10 -- # set +x 00:06:57.981 03:07:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:57.981 03:07:32 -- common/autotest_common.sh@1368 -- # bdev_info='[ 00:06:57.981 { 00:06:57.981 "name": "Malloc1", 00:06:57.981 "aliases": [ 00:06:57.981 "d288602c-9e6c-4b93-8647-80b2302420bf" 00:06:57.981 ], 00:06:57.981 "product_name": "Malloc disk", 00:06:57.981 "block_size": 512, 00:06:57.981 "num_blocks": 1048576, 00:06:57.981 "uuid": "d288602c-9e6c-4b93-8647-80b2302420bf", 00:06:57.981 "assigned_rate_limits": { 00:06:57.981 "rw_ios_per_sec": 0, 00:06:57.981 "rw_mbytes_per_sec": 0, 00:06:57.981 "r_mbytes_per_sec": 0, 00:06:57.981 "w_mbytes_per_sec": 0 00:06:57.981 }, 00:06:57.981 "claimed": true, 00:06:57.981 "claim_type": "exclusive_write", 00:06:57.981 "zoned": false, 00:06:57.981 "supported_io_types": { 00:06:57.981 "read": true, 00:06:57.981 "write": true, 00:06:57.981 "unmap": true, 00:06:57.981 "write_zeroes": true, 00:06:57.981 "flush": true, 00:06:57.981 "reset": true, 00:06:57.981 "compare": false, 00:06:57.981 "compare_and_write": false, 00:06:57.981 "abort": true, 00:06:57.981 "nvme_admin": false, 00:06:57.981 "nvme_io": false 00:06:57.981 }, 00:06:57.981 "memory_domains": [ 00:06:57.981 { 00:06:57.981 "dma_device_id": "system", 00:06:57.981 "dma_device_type": 1 00:06:57.981 }, 00:06:57.981 { 00:06:57.981 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:57.981 "dma_device_type": 2 00:06:57.981 } 00:06:57.981 ], 00:06:57.981 "driver_specific": {} 00:06:57.981 } 00:06:57.981 ]' 00:06:57.981 03:07:32 -- common/autotest_common.sh@1369 -- # jq '.[] .block_size' 00:06:57.981 03:07:32 -- common/autotest_common.sh@1369 -- # bs=512 00:06:57.981 03:07:32 -- common/autotest_common.sh@1370 -- # jq '.[] .num_blocks' 00:06:57.981 03:07:32 -- common/autotest_common.sh@1370 -- # nb=1048576 00:06:57.981 03:07:32 -- common/autotest_common.sh@1373 -- # bdev_size=512 00:06:57.981 03:07:32 -- common/autotest_common.sh@1374 -- # echo 512 00:06:57.981 03:07:32 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:57.981 03:07:32 -- target/filesystem.sh@60 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:06:58.239 03:07:32 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:58.239 03:07:32 -- common/autotest_common.sh@1184 -- # local i=0 00:06:58.240 03:07:32 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:06:58.240 03:07:32 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:06:58.240 03:07:32 -- common/autotest_common.sh@1191 -- # sleep 2 00:07:00.773 03:07:34 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:07:00.773 03:07:34 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:07:00.773 03:07:34 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:07:00.773 03:07:34 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:07:00.773 03:07:34 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:07:00.773 03:07:34 -- common/autotest_common.sh@1194 -- # return 0 00:07:00.773 03:07:34 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:00.773 03:07:34 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:00.773 03:07:34 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:00.773 03:07:34 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:00.773 03:07:34 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:00.773 03:07:34 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:00.773 03:07:34 -- setup/common.sh@80 -- # echo 536870912 00:07:00.773 03:07:34 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:00.773 03:07:34 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:00.773 03:07:34 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:00.773 03:07:34 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:00.773 03:07:34 -- target/filesystem.sh@69 -- # partprobe 00:07:00.773 03:07:34 -- target/filesystem.sh@70 -- # sleep 1 00:07:01.711 03:07:35 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:07:01.711 03:07:35 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:01.711 03:07:35 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:01.711 03:07:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:01.711 03:07:35 -- common/autotest_common.sh@10 -- # set +x 00:07:01.711 ************************************ 00:07:01.711 START TEST filesystem_in_capsule_ext4 00:07:01.711 ************************************ 00:07:01.711 03:07:36 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:01.711 03:07:36 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:01.711 03:07:36 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:01.711 03:07:36 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:01.711 03:07:36 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:01.711 03:07:36 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:01.711 03:07:36 -- common/autotest_common.sh@914 -- # local i=0 00:07:01.711 03:07:36 -- common/autotest_common.sh@915 -- # local force 00:07:01.711 03:07:36 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:01.711 03:07:36 -- common/autotest_common.sh@918 -- # force=-F 00:07:01.711 03:07:36 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:01.711 mke2fs 1.46.5 (30-Dec-2021) 00:07:01.711 Discarding device blocks: 0/522240 done 00:07:01.711 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:01.711 Filesystem UUID: 26802f35-1b44-4a64-8907-f201215567ab 00:07:01.711 Superblock backups stored on blocks: 00:07:01.711 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:01.711 00:07:01.711 Allocating group tables: 0/64 done 00:07:01.711 Writing inode tables: 0/64 done 00:07:01.711 Creating journal (8192 blocks): done 00:07:01.711 Writing superblocks and filesystem accounting information: 0/64 done 00:07:01.711 00:07:01.711 03:07:36 -- common/autotest_common.sh@931 -- # return 0 00:07:01.711 03:07:36 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:01.711 03:07:36 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:01.711 03:07:36 -- target/filesystem.sh@25 -- # sync 00:07:01.711 03:07:36 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:01.711 03:07:36 -- target/filesystem.sh@27 -- # sync 00:07:01.711 03:07:36 -- target/filesystem.sh@29 -- # i=0 00:07:01.711 03:07:36 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:01.993 03:07:36 -- target/filesystem.sh@37 -- # kill -0 3933957 00:07:01.993 03:07:36 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:01.993 03:07:36 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:01.993 03:07:36 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:01.993 03:07:36 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:01.993 00:07:01.993 real 0m0.174s 00:07:01.993 user 0m0.016s 00:07:01.993 sys 0m0.072s 00:07:01.993 03:07:36 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:01.993 03:07:36 -- common/autotest_common.sh@10 -- # set +x 00:07:01.993 ************************************ 00:07:01.993 END TEST filesystem_in_capsule_ext4 00:07:01.993 ************************************ 00:07:01.993 03:07:36 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:01.993 03:07:36 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:01.993 03:07:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:01.993 03:07:36 -- common/autotest_common.sh@10 -- # set +x 00:07:01.993 ************************************ 00:07:01.993 START TEST filesystem_in_capsule_btrfs 00:07:01.993 ************************************ 00:07:01.993 03:07:36 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:01.993 03:07:36 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:01.993 03:07:36 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:01.993 03:07:36 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:01.993 03:07:36 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:01.993 03:07:36 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:01.993 03:07:36 -- common/autotest_common.sh@914 -- # local i=0 00:07:01.993 03:07:36 -- common/autotest_common.sh@915 -- # local force 00:07:01.993 03:07:36 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:01.993 03:07:36 -- common/autotest_common.sh@920 -- # force=-f 00:07:01.993 03:07:36 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:02.253 btrfs-progs v6.6.2 00:07:02.253 See https://btrfs.readthedocs.io for more information. 00:07:02.253 00:07:02.253 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:02.253 NOTE: several default settings have changed in version 5.15, please make sure 00:07:02.253 this does not affect your deployments: 00:07:02.253 - DUP for metadata (-m dup) 00:07:02.253 - enabled no-holes (-O no-holes) 00:07:02.253 - enabled free-space-tree (-R free-space-tree) 00:07:02.253 00:07:02.253 Label: (null) 00:07:02.253 UUID: f449da95-3349-4f04-8aba-5bd95398b423 00:07:02.253 Node size: 16384 00:07:02.253 Sector size: 4096 00:07:02.253 Filesystem size: 510.00MiB 00:07:02.253 Block group profiles: 00:07:02.253 Data: single 8.00MiB 00:07:02.253 Metadata: DUP 32.00MiB 00:07:02.253 System: DUP 8.00MiB 00:07:02.253 SSD detected: yes 00:07:02.253 Zoned device: no 00:07:02.253 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:07:02.253 Runtime features: free-space-tree 00:07:02.253 Checksum: crc32c 00:07:02.253 Number of devices: 1 00:07:02.253 Devices: 00:07:02.253 ID SIZE PATH 00:07:02.253 1 510.00MiB /dev/nvme0n1p1 00:07:02.253 00:07:02.253 03:07:36 -- common/autotest_common.sh@931 -- # return 0 00:07:02.253 03:07:36 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:02.253 03:07:36 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:02.253 03:07:36 -- target/filesystem.sh@25 -- # sync 00:07:02.253 03:07:36 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:02.253 03:07:36 -- target/filesystem.sh@27 -- # sync 00:07:02.253 03:07:36 -- target/filesystem.sh@29 -- # i=0 00:07:02.253 03:07:36 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:02.253 03:07:36 -- target/filesystem.sh@37 -- # kill -0 3933957 00:07:02.253 03:07:36 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:02.253 03:07:36 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:02.253 03:07:36 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:02.253 03:07:36 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:02.253 00:07:02.253 real 0m0.246s 00:07:02.253 user 0m0.027s 00:07:02.253 sys 0m0.121s 00:07:02.253 03:07:36 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:02.253 03:07:36 -- common/autotest_common.sh@10 -- # set +x 00:07:02.253 ************************************ 00:07:02.253 END TEST filesystem_in_capsule_btrfs 00:07:02.253 ************************************ 00:07:02.253 03:07:36 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:07:02.253 03:07:36 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:02.253 03:07:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:02.253 03:07:36 -- common/autotest_common.sh@10 -- # set +x 00:07:02.512 ************************************ 00:07:02.512 START TEST filesystem_in_capsule_xfs 00:07:02.512 ************************************ 00:07:02.512 03:07:36 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create xfs nvme0n1 00:07:02.512 03:07:36 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:02.512 03:07:36 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:02.512 03:07:36 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:02.512 03:07:36 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:02.512 03:07:36 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:02.512 03:07:36 -- common/autotest_common.sh@914 -- # local i=0 00:07:02.512 03:07:36 -- common/autotest_common.sh@915 -- # local force 00:07:02.512 03:07:36 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:02.512 03:07:36 -- common/autotest_common.sh@920 -- # force=-f 00:07:02.512 03:07:36 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:02.512 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:02.512 = sectsz=512 attr=2, projid32bit=1 00:07:02.512 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:02.512 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:02.512 data = bsize=4096 blocks=130560, imaxpct=25 00:07:02.512 = sunit=0 swidth=0 blks 00:07:02.512 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:02.512 log =internal log bsize=4096 blocks=16384, version=2 00:07:02.512 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:02.513 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:02.513 Discarding blocks...Done. 00:07:02.513 03:07:36 -- common/autotest_common.sh@931 -- # return 0 00:07:02.513 03:07:36 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:02.513 03:07:36 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:02.513 03:07:36 -- target/filesystem.sh@25 -- # sync 00:07:02.513 03:07:36 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:02.513 03:07:36 -- target/filesystem.sh@27 -- # sync 00:07:02.513 03:07:36 -- target/filesystem.sh@29 -- # i=0 00:07:02.513 03:07:36 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:02.770 03:07:37 -- target/filesystem.sh@37 -- # kill -0 3933957 00:07:02.770 03:07:37 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:02.770 03:07:37 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:02.770 03:07:37 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:02.770 03:07:37 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:02.770 00:07:02.770 real 0m0.196s 00:07:02.770 user 0m0.026s 00:07:02.770 sys 0m0.064s 00:07:02.771 03:07:37 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:02.771 03:07:37 -- common/autotest_common.sh@10 -- # set +x 00:07:02.771 ************************************ 00:07:02.771 END TEST filesystem_in_capsule_xfs 00:07:02.771 ************************************ 00:07:02.771 03:07:37 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:02.771 03:07:37 -- target/filesystem.sh@93 -- # sync 00:07:02.771 03:07:37 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:03.706 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:03.706 03:07:37 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:03.706 03:07:37 -- common/autotest_common.sh@1205 -- # local i=0 00:07:03.706 03:07:37 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:07:03.706 03:07:37 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:03.706 03:07:37 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:07:03.706 03:07:37 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:03.706 03:07:37 -- common/autotest_common.sh@1217 -- # return 0 00:07:03.706 03:07:37 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:03.706 03:07:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:03.706 03:07:37 -- common/autotest_common.sh@10 -- # set +x 00:07:03.706 03:07:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:03.706 03:07:37 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:03.706 03:07:37 -- target/filesystem.sh@101 -- # killprocess 3933957 00:07:03.706 03:07:37 -- common/autotest_common.sh@936 -- # '[' -z 3933957 ']' 00:07:03.706 03:07:37 -- common/autotest_common.sh@940 -- # kill -0 3933957 00:07:03.706 03:07:37 -- common/autotest_common.sh@941 -- # uname 00:07:03.706 03:07:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:03.706 03:07:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3933957 00:07:03.706 03:07:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:03.706 03:07:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:03.706 03:07:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3933957' 00:07:03.706 killing process with pid 3933957 00:07:03.706 03:07:38 -- common/autotest_common.sh@955 -- # kill 3933957 00:07:03.706 03:07:38 -- common/autotest_common.sh@960 -- # wait 3933957 00:07:03.706 [2024-04-25 03:07:38.059116] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:07:03.965 03:07:38 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:03.965 00:07:03.965 real 0m7.141s 00:07:03.965 user 0m27.955s 00:07:03.965 sys 0m1.169s 00:07:03.965 03:07:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:03.965 03:07:38 -- common/autotest_common.sh@10 -- # set +x 00:07:03.965 ************************************ 00:07:03.965 END TEST nvmf_filesystem_in_capsule 00:07:03.965 ************************************ 00:07:03.965 03:07:38 -- target/filesystem.sh@108 -- # nvmftestfini 00:07:03.965 03:07:38 -- nvmf/common.sh@477 -- # nvmfcleanup 00:07:03.965 03:07:38 -- nvmf/common.sh@117 -- # sync 00:07:03.965 03:07:38 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:07:03.965 03:07:38 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:07:03.965 03:07:38 -- nvmf/common.sh@120 -- # set +e 00:07:03.965 03:07:38 -- nvmf/common.sh@121 -- # for i in {1..20} 00:07:03.965 03:07:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:07:03.965 rmmod nvme_rdma 00:07:04.224 rmmod nvme_fabrics 00:07:04.224 03:07:38 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:07:04.224 03:07:38 -- nvmf/common.sh@124 -- # set -e 00:07:04.224 03:07:38 -- nvmf/common.sh@125 -- # return 0 00:07:04.224 03:07:38 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:07:04.224 03:07:38 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:07:04.224 03:07:38 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:07:04.224 00:07:04.224 real 0m21.083s 00:07:04.224 user 0m59.972s 00:07:04.224 sys 0m6.836s 00:07:04.224 03:07:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:04.224 03:07:38 -- common/autotest_common.sh@10 -- # set +x 00:07:04.224 ************************************ 00:07:04.224 END TEST nvmf_filesystem 00:07:04.224 ************************************ 00:07:04.224 03:07:38 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=rdma 00:07:04.224 03:07:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:04.224 03:07:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:04.224 03:07:38 -- common/autotest_common.sh@10 -- # set +x 00:07:04.224 ************************************ 00:07:04.224 START TEST nvmf_discovery 00:07:04.224 ************************************ 00:07:04.224 03:07:38 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=rdma 00:07:04.224 * Looking for test storage... 00:07:04.224 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:07:04.224 03:07:38 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:07:04.224 03:07:38 -- nvmf/common.sh@7 -- # uname -s 00:07:04.224 03:07:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:04.224 03:07:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:04.224 03:07:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:04.224 03:07:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:04.224 03:07:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:04.224 03:07:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:04.224 03:07:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:04.224 03:07:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:04.224 03:07:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:04.224 03:07:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:04.483 03:07:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:07:04.483 03:07:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:07:04.483 03:07:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:04.483 03:07:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:04.483 03:07:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:04.483 03:07:38 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:04.483 03:07:38 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:07:04.483 03:07:38 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:04.483 03:07:38 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:04.483 03:07:38 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:04.483 03:07:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:04.483 03:07:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:04.483 03:07:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:04.483 03:07:38 -- paths/export.sh@5 -- # export PATH 00:07:04.483 03:07:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:04.483 03:07:38 -- nvmf/common.sh@47 -- # : 0 00:07:04.483 03:07:38 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:07:04.483 03:07:38 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:07:04.483 03:07:38 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:04.483 03:07:38 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:04.483 03:07:38 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:04.483 03:07:38 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:07:04.483 03:07:38 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:07:04.483 03:07:38 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:07:04.483 03:07:38 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:07:04.483 03:07:38 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:07:04.483 03:07:38 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:07:04.483 03:07:38 -- target/discovery.sh@15 -- # hash nvme 00:07:04.483 03:07:38 -- target/discovery.sh@20 -- # nvmftestinit 00:07:04.483 03:07:38 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:07:04.483 03:07:38 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:04.483 03:07:38 -- nvmf/common.sh@437 -- # prepare_net_devs 00:07:04.483 03:07:38 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:07:04.483 03:07:38 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:07:04.484 03:07:38 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:04.484 03:07:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:04.484 03:07:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:04.484 03:07:38 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:07:04.484 03:07:38 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:07:04.484 03:07:38 -- nvmf/common.sh@285 -- # xtrace_disable 00:07:04.484 03:07:38 -- common/autotest_common.sh@10 -- # set +x 00:07:09.784 03:07:44 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:09.784 03:07:44 -- nvmf/common.sh@291 -- # pci_devs=() 00:07:09.784 03:07:44 -- nvmf/common.sh@291 -- # local -a pci_devs 00:07:09.784 03:07:44 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:07:09.784 03:07:44 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:07:09.784 03:07:44 -- nvmf/common.sh@293 -- # pci_drivers=() 00:07:09.784 03:07:44 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:07:09.784 03:07:44 -- nvmf/common.sh@295 -- # net_devs=() 00:07:09.784 03:07:44 -- nvmf/common.sh@295 -- # local -ga net_devs 00:07:09.784 03:07:44 -- nvmf/common.sh@296 -- # e810=() 00:07:09.784 03:07:44 -- nvmf/common.sh@296 -- # local -ga e810 00:07:09.784 03:07:44 -- nvmf/common.sh@297 -- # x722=() 00:07:09.784 03:07:44 -- nvmf/common.sh@297 -- # local -ga x722 00:07:09.784 03:07:44 -- nvmf/common.sh@298 -- # mlx=() 00:07:09.784 03:07:44 -- nvmf/common.sh@298 -- # local -ga mlx 00:07:09.784 03:07:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:09.784 03:07:44 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:09.784 03:07:44 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:09.784 03:07:44 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:09.784 03:07:44 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:09.784 03:07:44 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:09.784 03:07:44 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:09.784 03:07:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:09.784 03:07:44 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:09.784 03:07:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:09.784 03:07:44 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:09.784 03:07:44 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:07:09.784 03:07:44 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:07:09.784 03:07:44 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:07:09.784 03:07:44 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:07:09.784 03:07:44 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:07:09.784 03:07:44 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:07:09.784 03:07:44 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:07:09.784 03:07:44 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:07:09.784 03:07:44 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:09.784 03:07:44 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:07:09.784 Found 0000:af:00.0 (0x8086 - 0x159b) 00:07:09.784 03:07:44 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:07:09.784 03:07:44 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:07:09.784 03:07:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:09.784 03:07:44 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:09.784 03:07:44 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:07:09.784 03:07:44 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:09.784 03:07:44 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:09.784 03:07:44 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:07:09.784 Found 0000:af:00.1 (0x8086 - 0x159b) 00:07:09.784 03:07:44 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:07:09.784 03:07:44 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:07:09.784 03:07:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:09.784 03:07:44 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:09.784 03:07:44 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:07:09.784 03:07:44 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:09.784 03:07:44 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:07:09.784 03:07:44 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:07:09.784 03:07:44 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:07:09.784 03:07:44 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:07:09.784 03:07:44 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:07:09.784 03:07:44 -- nvmf/common.sh@377 -- # modinfo irdma 00:07:09.784 03:07:44 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:07:09.784 03:07:44 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:09.784 03:07:44 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:09.784 03:07:44 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:09.784 03:07:44 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:09.784 03:07:44 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:07:09.784 Found net devices under 0000:af:00.0: cvl_0_0 00:07:09.784 03:07:44 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:09.784 03:07:44 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:09.784 03:07:44 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:09.784 03:07:44 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:09.784 03:07:44 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:09.784 03:07:44 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:07:09.784 Found net devices under 0000:af:00.1: cvl_0_1 00:07:09.784 03:07:44 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:09.784 03:07:44 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:07:09.784 03:07:44 -- nvmf/common.sh@403 -- # is_hw=yes 00:07:09.784 03:07:44 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:07:09.784 03:07:44 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:07:09.784 03:07:44 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:07:09.784 03:07:44 -- nvmf/common.sh@409 -- # rdma_device_init 00:07:09.784 03:07:44 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:07:09.784 03:07:44 -- nvmf/common.sh@58 -- # uname 00:07:09.784 03:07:44 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:07:09.784 03:07:44 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:07:09.784 03:07:44 -- nvmf/common.sh@63 -- # modprobe ib_core 00:07:09.784 03:07:44 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:07:09.784 03:07:44 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:07:09.784 03:07:44 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:07:09.784 03:07:44 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:07:09.784 03:07:44 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:07:09.784 03:07:44 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:07:09.784 03:07:44 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:07:09.784 03:07:44 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:07:09.784 03:07:44 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:09.784 03:07:44 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:09.784 03:07:44 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:09.784 03:07:44 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:10.043 03:07:44 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:10.043 03:07:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:10.043 03:07:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:10.043 03:07:44 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:07:10.043 03:07:44 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:07:10.043 03:07:44 -- nvmf/common.sh@105 -- # continue 2 00:07:10.043 03:07:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:10.043 03:07:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:10.043 03:07:44 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:07:10.043 03:07:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:10.043 03:07:44 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:07:10.043 03:07:44 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:07:10.043 03:07:44 -- nvmf/common.sh@105 -- # continue 2 00:07:10.043 03:07:44 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:10.043 03:07:44 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:07:10.043 03:07:44 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:07:10.043 03:07:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:07:10.043 03:07:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:10.043 03:07:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:10.043 03:07:44 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:07:10.043 03:07:44 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:07:10.043 03:07:44 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:07:10.043 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:07:10.043 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:07:10.043 altname enp175s0f0np0 00:07:10.043 altname ens801f0np0 00:07:10.043 inet 192.168.100.8/24 scope global cvl_0_0 00:07:10.043 valid_lft forever preferred_lft forever 00:07:10.043 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:07:10.043 valid_lft forever preferred_lft forever 00:07:10.043 03:07:44 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:10.043 03:07:44 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:07:10.043 03:07:44 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:07:10.043 03:07:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:07:10.043 03:07:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:10.043 03:07:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:10.043 03:07:44 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:07:10.043 03:07:44 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:07:10.043 03:07:44 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:07:10.043 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:07:10.043 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:07:10.043 altname enp175s0f1np1 00:07:10.043 altname ens801f1np1 00:07:10.044 inet 192.168.100.9/24 scope global cvl_0_1 00:07:10.044 valid_lft forever preferred_lft forever 00:07:10.044 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:07:10.044 valid_lft forever preferred_lft forever 00:07:10.044 03:07:44 -- nvmf/common.sh@411 -- # return 0 00:07:10.044 03:07:44 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:07:10.044 03:07:44 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:07:10.044 03:07:44 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:07:10.044 03:07:44 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:07:10.044 03:07:44 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:07:10.044 03:07:44 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:10.044 03:07:44 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:10.044 03:07:44 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:10.044 03:07:44 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:10.044 03:07:44 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:10.044 03:07:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:10.044 03:07:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:10.044 03:07:44 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:07:10.044 03:07:44 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:07:10.044 03:07:44 -- nvmf/common.sh@105 -- # continue 2 00:07:10.044 03:07:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:10.044 03:07:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:10.044 03:07:44 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:07:10.044 03:07:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:10.044 03:07:44 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:07:10.044 03:07:44 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:07:10.044 03:07:44 -- nvmf/common.sh@105 -- # continue 2 00:07:10.044 03:07:44 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:10.044 03:07:44 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:07:10.044 03:07:44 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:07:10.044 03:07:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:07:10.044 03:07:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:10.044 03:07:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:10.044 03:07:44 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:10.044 03:07:44 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:07:10.044 03:07:44 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:07:10.044 03:07:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:10.044 03:07:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:07:10.044 03:07:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:10.044 03:07:44 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:07:10.044 192.168.100.9' 00:07:10.044 03:07:44 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:07:10.044 192.168.100.9' 00:07:10.044 03:07:44 -- nvmf/common.sh@446 -- # head -n 1 00:07:10.044 03:07:44 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:07:10.044 03:07:44 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:07:10.044 192.168.100.9' 00:07:10.044 03:07:44 -- nvmf/common.sh@447 -- # tail -n +2 00:07:10.044 03:07:44 -- nvmf/common.sh@447 -- # head -n 1 00:07:10.044 03:07:44 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:07:10.044 03:07:44 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:07:10.044 03:07:44 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:07:10.044 03:07:44 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:07:10.044 03:07:44 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:07:10.044 03:07:44 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:07:10.044 03:07:44 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:10.044 03:07:44 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:07:10.044 03:07:44 -- common/autotest_common.sh@710 -- # xtrace_disable 00:07:10.044 03:07:44 -- common/autotest_common.sh@10 -- # set +x 00:07:10.044 03:07:44 -- nvmf/common.sh@470 -- # nvmfpid=3938860 00:07:10.044 03:07:44 -- nvmf/common.sh@471 -- # waitforlisten 3938860 00:07:10.044 03:07:44 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:10.044 03:07:44 -- common/autotest_common.sh@817 -- # '[' -z 3938860 ']' 00:07:10.044 03:07:44 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:10.044 03:07:44 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:10.044 03:07:44 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:10.044 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:10.044 03:07:44 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:10.044 03:07:44 -- common/autotest_common.sh@10 -- # set +x 00:07:10.044 [2024-04-25 03:07:44.462411] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:07:10.044 [2024-04-25 03:07:44.462461] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:10.044 EAL: No free 2048 kB hugepages reported on node 1 00:07:10.044 [2024-04-25 03:07:44.523137] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:10.303 [2024-04-25 03:07:44.595336] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:10.303 [2024-04-25 03:07:44.595378] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:10.303 [2024-04-25 03:07:44.595384] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:07:10.303 [2024-04-25 03:07:44.595390] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:07:10.303 [2024-04-25 03:07:44.595394] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:10.303 [2024-04-25 03:07:44.595488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:10.303 [2024-04-25 03:07:44.595605] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:10.303 [2024-04-25 03:07:44.595672] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:10.303 [2024-04-25 03:07:44.595673] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:10.870 03:07:45 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:10.870 03:07:45 -- common/autotest_common.sh@850 -- # return 0 00:07:10.870 03:07:45 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:07:10.870 03:07:45 -- common/autotest_common.sh@716 -- # xtrace_disable 00:07:10.870 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:10.870 03:07:45 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:10.870 03:07:45 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:07:10.870 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:10.870 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:10.870 [2024-04-25 03:07:45.315081] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0xd15ea0/0xd154e0) succeed. 00:07:10.870 [2024-04-25 03:07:45.325044] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0xd17210/0xd15a60) succeed. 00:07:10.870 [2024-04-25 03:07:45.325065] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:07:10.870 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:10.870 03:07:45 -- target/discovery.sh@26 -- # seq 1 4 00:07:10.870 03:07:45 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:10.870 03:07:45 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:07:10.870 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:10.870 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:10.870 Null1 00:07:10.870 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:10.870 03:07:45 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:10.870 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:10.870 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:10.870 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:11.129 03:07:45 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:07:11.129 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:11.129 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.129 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:11.129 03:07:45 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:07:11.129 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:11.129 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.129 [2024-04-25 03:07:45.389452] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:07:11.129 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:11.129 03:07:45 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:11.129 03:07:45 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:07:11.129 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:11.129 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.129 Null2 00:07:11.129 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:11.129 03:07:45 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:07:11.129 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:11.129 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.129 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:11.129 03:07:45 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:07:11.129 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:11.129 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.129 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:11.129 03:07:45 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:07:11.129 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:11.129 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.129 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:11.129 03:07:45 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:11.129 03:07:45 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:07:11.129 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:11.129 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.129 Null3 00:07:11.129 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:11.129 03:07:45 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:07:11.129 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:11.129 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.129 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:11.129 03:07:45 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:07:11.129 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:11.129 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.129 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:11.129 03:07:45 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t rdma -a 192.168.100.8 -s 4420 00:07:11.129 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:11.129 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.129 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:11.129 03:07:45 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:11.129 03:07:45 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:07:11.129 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:11.129 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.129 Null4 00:07:11.129 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:11.129 03:07:45 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:07:11.129 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:11.129 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.129 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:11.129 03:07:45 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:07:11.129 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:11.129 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.129 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:11.129 03:07:45 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t rdma -a 192.168.100.8 -s 4420 00:07:11.129 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:11.129 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.129 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:11.129 03:07:45 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:07:11.129 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:11.129 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.129 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:11.130 03:07:45 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 192.168.100.8 -s 4430 00:07:11.130 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:11.130 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.130 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:11.130 03:07:45 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 4420 00:07:11.130 00:07:11.130 Discovery Log Number of Records 6, Generation counter 6 00:07:11.130 =====Discovery Log Entry 0====== 00:07:11.130 trtype: rdma 00:07:11.130 adrfam: ipv4 00:07:11.130 subtype: current discovery subsystem 00:07:11.130 treq: not required 00:07:11.130 portid: 0 00:07:11.130 trsvcid: 4420 00:07:11.130 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:11.130 traddr: 192.168.100.8 00:07:11.130 eflags: explicit discovery connections, duplicate discovery information 00:07:11.130 rdma_prtype: not specified 00:07:11.130 rdma_qptype: connected 00:07:11.130 rdma_cms: rdma-cm 00:07:11.130 rdma_pkey: 0x0000 00:07:11.130 =====Discovery Log Entry 1====== 00:07:11.130 trtype: rdma 00:07:11.130 adrfam: ipv4 00:07:11.130 subtype: nvme subsystem 00:07:11.130 treq: not required 00:07:11.130 portid: 0 00:07:11.130 trsvcid: 4420 00:07:11.130 subnqn: nqn.2016-06.io.spdk:cnode1 00:07:11.130 traddr: 192.168.100.8 00:07:11.130 eflags: none 00:07:11.130 rdma_prtype: not specified 00:07:11.130 rdma_qptype: connected 00:07:11.130 rdma_cms: rdma-cm 00:07:11.130 rdma_pkey: 0x0000 00:07:11.130 =====Discovery Log Entry 2====== 00:07:11.130 trtype: rdma 00:07:11.130 adrfam: ipv4 00:07:11.130 subtype: nvme subsystem 00:07:11.130 treq: not required 00:07:11.130 portid: 0 00:07:11.130 trsvcid: 4420 00:07:11.130 subnqn: nqn.2016-06.io.spdk:cnode2 00:07:11.130 traddr: 192.168.100.8 00:07:11.130 eflags: none 00:07:11.130 rdma_prtype: not specified 00:07:11.130 rdma_qptype: connected 00:07:11.130 rdma_cms: rdma-cm 00:07:11.130 rdma_pkey: 0x0000 00:07:11.130 =====Discovery Log Entry 3====== 00:07:11.130 trtype: rdma 00:07:11.130 adrfam: ipv4 00:07:11.130 subtype: nvme subsystem 00:07:11.130 treq: not required 00:07:11.130 portid: 0 00:07:11.130 trsvcid: 4420 00:07:11.130 subnqn: nqn.2016-06.io.spdk:cnode3 00:07:11.130 traddr: 192.168.100.8 00:07:11.130 eflags: none 00:07:11.130 rdma_prtype: not specified 00:07:11.130 rdma_qptype: connected 00:07:11.130 rdma_cms: rdma-cm 00:07:11.130 rdma_pkey: 0x0000 00:07:11.130 =====Discovery Log Entry 4====== 00:07:11.130 trtype: rdma 00:07:11.130 adrfam: ipv4 00:07:11.130 subtype: nvme subsystem 00:07:11.130 treq: not required 00:07:11.130 portid: 0 00:07:11.130 trsvcid: 4420 00:07:11.130 subnqn: nqn.2016-06.io.spdk:cnode4 00:07:11.130 traddr: 192.168.100.8 00:07:11.130 eflags: none 00:07:11.130 rdma_prtype: not specified 00:07:11.130 rdma_qptype: connected 00:07:11.130 rdma_cms: rdma-cm 00:07:11.130 rdma_pkey: 0x0000 00:07:11.130 =====Discovery Log Entry 5====== 00:07:11.130 trtype: rdma 00:07:11.130 adrfam: ipv4 00:07:11.130 subtype: discovery subsystem referral 00:07:11.130 treq: not required 00:07:11.130 portid: 0 00:07:11.130 trsvcid: 4430 00:07:11.130 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:11.130 traddr: 192.168.100.8 00:07:11.130 eflags: none 00:07:11.130 rdma_prtype: unrecognized 00:07:11.130 rdma_qptype: unrecognized 00:07:11.130 rdma_cms: unrecognized 00:07:11.130 rdma_pkey: 0x0000 00:07:11.130 03:07:45 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:07:11.130 Perform nvmf subsystem discovery via RPC 00:07:11.130 03:07:45 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:07:11.130 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:11.130 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.130 [2024-04-25 03:07:45.626252] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:07:11.389 [ 00:07:11.389 { 00:07:11.389 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:07:11.389 "subtype": "Discovery", 00:07:11.389 "listen_addresses": [ 00:07:11.389 { 00:07:11.389 "transport": "RDMA", 00:07:11.389 "trtype": "RDMA", 00:07:11.389 "adrfam": "IPv4", 00:07:11.389 "traddr": "192.168.100.8", 00:07:11.389 "trsvcid": "4420" 00:07:11.389 } 00:07:11.389 ], 00:07:11.389 "allow_any_host": true, 00:07:11.389 "hosts": [] 00:07:11.389 }, 00:07:11.389 { 00:07:11.389 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:07:11.389 "subtype": "NVMe", 00:07:11.389 "listen_addresses": [ 00:07:11.389 { 00:07:11.389 "transport": "RDMA", 00:07:11.389 "trtype": "RDMA", 00:07:11.389 "adrfam": "IPv4", 00:07:11.389 "traddr": "192.168.100.8", 00:07:11.389 "trsvcid": "4420" 00:07:11.389 } 00:07:11.389 ], 00:07:11.389 "allow_any_host": true, 00:07:11.389 "hosts": [], 00:07:11.389 "serial_number": "SPDK00000000000001", 00:07:11.389 "model_number": "SPDK bdev Controller", 00:07:11.389 "max_namespaces": 32, 00:07:11.389 "min_cntlid": 1, 00:07:11.389 "max_cntlid": 65519, 00:07:11.389 "namespaces": [ 00:07:11.389 { 00:07:11.389 "nsid": 1, 00:07:11.389 "bdev_name": "Null1", 00:07:11.389 "name": "Null1", 00:07:11.389 "nguid": "545E651658A145B2B2F4A2C3ADFAA040", 00:07:11.389 "uuid": "545e6516-58a1-45b2-b2f4-a2c3adfaa040" 00:07:11.389 } 00:07:11.389 ] 00:07:11.389 }, 00:07:11.389 { 00:07:11.389 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:07:11.389 "subtype": "NVMe", 00:07:11.389 "listen_addresses": [ 00:07:11.389 { 00:07:11.389 "transport": "RDMA", 00:07:11.389 "trtype": "RDMA", 00:07:11.389 "adrfam": "IPv4", 00:07:11.389 "traddr": "192.168.100.8", 00:07:11.389 "trsvcid": "4420" 00:07:11.389 } 00:07:11.389 ], 00:07:11.389 "allow_any_host": true, 00:07:11.389 "hosts": [], 00:07:11.389 "serial_number": "SPDK00000000000002", 00:07:11.389 "model_number": "SPDK bdev Controller", 00:07:11.389 "max_namespaces": 32, 00:07:11.389 "min_cntlid": 1, 00:07:11.389 "max_cntlid": 65519, 00:07:11.389 "namespaces": [ 00:07:11.389 { 00:07:11.389 "nsid": 1, 00:07:11.389 "bdev_name": "Null2", 00:07:11.389 "name": "Null2", 00:07:11.389 "nguid": "25B8FAE752C441679AA8283ECB32F2BB", 00:07:11.389 "uuid": "25b8fae7-52c4-4167-9aa8-283ecb32f2bb" 00:07:11.389 } 00:07:11.389 ] 00:07:11.389 }, 00:07:11.389 { 00:07:11.389 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:07:11.389 "subtype": "NVMe", 00:07:11.389 "listen_addresses": [ 00:07:11.389 { 00:07:11.389 "transport": "RDMA", 00:07:11.389 "trtype": "RDMA", 00:07:11.389 "adrfam": "IPv4", 00:07:11.389 "traddr": "192.168.100.8", 00:07:11.389 "trsvcid": "4420" 00:07:11.389 } 00:07:11.389 ], 00:07:11.389 "allow_any_host": true, 00:07:11.389 "hosts": [], 00:07:11.389 "serial_number": "SPDK00000000000003", 00:07:11.389 "model_number": "SPDK bdev Controller", 00:07:11.389 "max_namespaces": 32, 00:07:11.389 "min_cntlid": 1, 00:07:11.389 "max_cntlid": 65519, 00:07:11.389 "namespaces": [ 00:07:11.389 { 00:07:11.389 "nsid": 1, 00:07:11.389 "bdev_name": "Null3", 00:07:11.389 "name": "Null3", 00:07:11.390 "nguid": "E00AD13B38B146B48FE522F276C7E477", 00:07:11.390 "uuid": "e00ad13b-38b1-46b4-8fe5-22f276c7e477" 00:07:11.390 } 00:07:11.390 ] 00:07:11.390 }, 00:07:11.390 { 00:07:11.390 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:07:11.390 "subtype": "NVMe", 00:07:11.390 "listen_addresses": [ 00:07:11.390 { 00:07:11.390 "transport": "RDMA", 00:07:11.390 "trtype": "RDMA", 00:07:11.390 "adrfam": "IPv4", 00:07:11.390 "traddr": "192.168.100.8", 00:07:11.390 "trsvcid": "4420" 00:07:11.390 } 00:07:11.390 ], 00:07:11.390 "allow_any_host": true, 00:07:11.390 "hosts": [], 00:07:11.390 "serial_number": "SPDK00000000000004", 00:07:11.390 "model_number": "SPDK bdev Controller", 00:07:11.390 "max_namespaces": 32, 00:07:11.390 "min_cntlid": 1, 00:07:11.390 "max_cntlid": 65519, 00:07:11.390 "namespaces": [ 00:07:11.390 { 00:07:11.390 "nsid": 1, 00:07:11.390 "bdev_name": "Null4", 00:07:11.390 "name": "Null4", 00:07:11.390 "nguid": "9EFDD7AAD7D8474E930A1C1A22E87440", 00:07:11.390 "uuid": "9efdd7aa-d7d8-474e-930a-1c1a22e87440" 00:07:11.390 } 00:07:11.390 ] 00:07:11.390 } 00:07:11.390 ] 00:07:11.390 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:11.390 03:07:45 -- target/discovery.sh@42 -- # seq 1 4 00:07:11.390 03:07:45 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:11.390 03:07:45 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:11.390 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:11.390 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.390 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:11.390 03:07:45 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:07:11.390 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:11.390 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.390 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:11.390 03:07:45 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:11.390 03:07:45 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:07:11.390 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:11.390 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.390 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:11.390 03:07:45 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:07:11.390 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:11.390 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.390 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:11.390 03:07:45 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:11.390 03:07:45 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:07:11.390 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:11.390 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.390 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:11.390 03:07:45 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:07:11.390 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:11.390 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.390 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:11.390 03:07:45 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:11.390 03:07:45 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:07:11.390 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:11.390 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.390 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:11.390 03:07:45 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:07:11.390 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:11.390 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.390 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:11.390 03:07:45 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 192.168.100.8 -s 4430 00:07:11.390 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:11.390 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.390 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:11.390 03:07:45 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:07:11.390 03:07:45 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:07:11.390 03:07:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:11.390 03:07:45 -- common/autotest_common.sh@10 -- # set +x 00:07:11.390 03:07:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:11.390 03:07:45 -- target/discovery.sh@49 -- # check_bdevs= 00:07:11.390 03:07:45 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:07:11.390 03:07:45 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:07:11.390 03:07:45 -- target/discovery.sh@57 -- # nvmftestfini 00:07:11.390 03:07:45 -- nvmf/common.sh@477 -- # nvmfcleanup 00:07:11.390 03:07:45 -- nvmf/common.sh@117 -- # sync 00:07:11.390 03:07:45 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:07:11.390 03:07:45 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:07:11.390 03:07:45 -- nvmf/common.sh@120 -- # set +e 00:07:11.390 03:07:45 -- nvmf/common.sh@121 -- # for i in {1..20} 00:07:11.390 03:07:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:07:11.390 rmmod nvme_rdma 00:07:11.390 rmmod nvme_fabrics 00:07:11.390 03:07:45 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:07:11.390 03:07:45 -- nvmf/common.sh@124 -- # set -e 00:07:11.390 03:07:45 -- nvmf/common.sh@125 -- # return 0 00:07:11.390 03:07:45 -- nvmf/common.sh@478 -- # '[' -n 3938860 ']' 00:07:11.390 03:07:45 -- nvmf/common.sh@479 -- # killprocess 3938860 00:07:11.390 03:07:45 -- common/autotest_common.sh@936 -- # '[' -z 3938860 ']' 00:07:11.390 03:07:45 -- common/autotest_common.sh@940 -- # kill -0 3938860 00:07:11.390 03:07:45 -- common/autotest_common.sh@941 -- # uname 00:07:11.390 03:07:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:11.390 03:07:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3938860 00:07:11.390 03:07:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:11.390 03:07:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:11.390 03:07:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3938860' 00:07:11.390 killing process with pid 3938860 00:07:11.390 03:07:45 -- common/autotest_common.sh@955 -- # kill 3938860 00:07:11.390 [2024-04-25 03:07:45.880456] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:07:11.390 03:07:45 -- common/autotest_common.sh@960 -- # wait 3938860 00:07:11.649 [2024-04-25 03:07:45.915015] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:07:11.649 03:07:46 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:07:11.649 03:07:46 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:07:11.649 00:07:11.649 real 0m7.475s 00:07:11.649 user 0m7.659s 00:07:11.649 sys 0m4.619s 00:07:11.649 03:07:46 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:11.649 03:07:46 -- common/autotest_common.sh@10 -- # set +x 00:07:11.649 ************************************ 00:07:11.649 END TEST nvmf_discovery 00:07:11.649 ************************************ 00:07:11.909 03:07:46 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=rdma 00:07:11.909 03:07:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:11.909 03:07:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:11.909 03:07:46 -- common/autotest_common.sh@10 -- # set +x 00:07:11.909 ************************************ 00:07:11.909 START TEST nvmf_referrals 00:07:11.909 ************************************ 00:07:11.909 03:07:46 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=rdma 00:07:11.909 * Looking for test storage... 00:07:11.909 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:07:11.909 03:07:46 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:07:11.909 03:07:46 -- nvmf/common.sh@7 -- # uname -s 00:07:11.909 03:07:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:11.909 03:07:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:11.909 03:07:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:11.909 03:07:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:11.909 03:07:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:11.909 03:07:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:11.909 03:07:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:11.909 03:07:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:11.909 03:07:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:11.909 03:07:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:11.909 03:07:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:07:11.909 03:07:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:07:11.909 03:07:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:11.909 03:07:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:11.909 03:07:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:11.909 03:07:46 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:11.909 03:07:46 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:07:11.909 03:07:46 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:11.909 03:07:46 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:11.909 03:07:46 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:11.909 03:07:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:11.909 03:07:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:11.909 03:07:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:11.909 03:07:46 -- paths/export.sh@5 -- # export PATH 00:07:11.909 03:07:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:11.909 03:07:46 -- nvmf/common.sh@47 -- # : 0 00:07:11.909 03:07:46 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:07:11.909 03:07:46 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:07:11.909 03:07:46 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:11.909 03:07:46 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:11.909 03:07:46 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:11.909 03:07:46 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:07:11.909 03:07:46 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:07:11.909 03:07:46 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:07:11.909 03:07:46 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:07:11.909 03:07:46 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:07:11.909 03:07:46 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:07:11.909 03:07:46 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:07:11.909 03:07:46 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:07:11.909 03:07:46 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:07:11.909 03:07:46 -- target/referrals.sh@37 -- # nvmftestinit 00:07:11.909 03:07:46 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:07:11.909 03:07:46 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:11.909 03:07:46 -- nvmf/common.sh@437 -- # prepare_net_devs 00:07:11.909 03:07:46 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:07:11.909 03:07:46 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:07:11.909 03:07:46 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:11.909 03:07:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:11.909 03:07:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:11.909 03:07:46 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:07:11.909 03:07:46 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:07:11.909 03:07:46 -- nvmf/common.sh@285 -- # xtrace_disable 00:07:11.909 03:07:46 -- common/autotest_common.sh@10 -- # set +x 00:07:18.505 03:07:52 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:18.505 03:07:52 -- nvmf/common.sh@291 -- # pci_devs=() 00:07:18.505 03:07:52 -- nvmf/common.sh@291 -- # local -a pci_devs 00:07:18.506 03:07:52 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:07:18.506 03:07:52 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:07:18.506 03:07:52 -- nvmf/common.sh@293 -- # pci_drivers=() 00:07:18.506 03:07:52 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:07:18.506 03:07:52 -- nvmf/common.sh@295 -- # net_devs=() 00:07:18.506 03:07:52 -- nvmf/common.sh@295 -- # local -ga net_devs 00:07:18.506 03:07:52 -- nvmf/common.sh@296 -- # e810=() 00:07:18.506 03:07:52 -- nvmf/common.sh@296 -- # local -ga e810 00:07:18.506 03:07:52 -- nvmf/common.sh@297 -- # x722=() 00:07:18.506 03:07:52 -- nvmf/common.sh@297 -- # local -ga x722 00:07:18.506 03:07:52 -- nvmf/common.sh@298 -- # mlx=() 00:07:18.506 03:07:52 -- nvmf/common.sh@298 -- # local -ga mlx 00:07:18.506 03:07:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:18.506 03:07:52 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:18.506 03:07:52 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:18.506 03:07:52 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:18.506 03:07:52 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:18.506 03:07:52 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:18.506 03:07:52 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:18.506 03:07:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:18.506 03:07:52 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:18.506 03:07:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:18.506 03:07:52 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:18.506 03:07:52 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:07:18.506 03:07:52 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:07:18.506 03:07:52 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:07:18.506 03:07:52 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:07:18.506 03:07:52 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:07:18.506 03:07:52 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:07:18.506 03:07:52 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:07:18.506 03:07:52 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:07:18.506 03:07:52 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:18.506 03:07:52 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:07:18.506 Found 0000:af:00.0 (0x8086 - 0x159b) 00:07:18.506 03:07:52 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:07:18.506 03:07:52 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:07:18.506 03:07:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:18.506 03:07:52 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:18.506 03:07:52 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:07:18.506 03:07:52 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:18.506 03:07:52 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:18.506 03:07:52 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:07:18.506 Found 0000:af:00.1 (0x8086 - 0x159b) 00:07:18.506 03:07:52 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:07:18.506 03:07:52 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:07:18.506 03:07:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:18.506 03:07:52 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:18.506 03:07:52 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:07:18.506 03:07:52 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:18.506 03:07:52 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:07:18.506 03:07:52 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:07:18.506 03:07:52 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:07:18.506 03:07:52 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:07:18.506 03:07:52 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:07:18.506 03:07:52 -- nvmf/common.sh@377 -- # modinfo irdma 00:07:18.506 03:07:52 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:07:18.506 03:07:52 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:18.506 03:07:52 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:18.506 03:07:52 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:18.506 03:07:52 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:18.506 03:07:52 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:07:18.506 Found net devices under 0000:af:00.0: cvl_0_0 00:07:18.506 03:07:52 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:18.506 03:07:52 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:18.506 03:07:52 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:18.506 03:07:52 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:18.506 03:07:52 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:18.506 03:07:52 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:07:18.506 Found net devices under 0000:af:00.1: cvl_0_1 00:07:18.506 03:07:52 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:18.506 03:07:52 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:07:18.506 03:07:52 -- nvmf/common.sh@403 -- # is_hw=yes 00:07:18.506 03:07:52 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:07:18.506 03:07:52 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:07:18.506 03:07:52 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:07:18.506 03:07:52 -- nvmf/common.sh@409 -- # rdma_device_init 00:07:18.506 03:07:52 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:07:18.506 03:07:52 -- nvmf/common.sh@58 -- # uname 00:07:18.506 03:07:52 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:07:18.506 03:07:52 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:07:18.506 03:07:52 -- nvmf/common.sh@63 -- # modprobe ib_core 00:07:18.506 03:07:52 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:07:18.506 03:07:52 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:07:18.506 03:07:52 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:07:18.506 03:07:52 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:07:18.506 03:07:52 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:07:18.506 03:07:52 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:07:18.506 03:07:52 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:07:18.506 03:07:52 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:07:18.506 03:07:52 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:18.506 03:07:52 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:18.506 03:07:52 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:18.506 03:07:52 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:18.506 03:07:52 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:18.506 03:07:52 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:18.506 03:07:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:18.506 03:07:52 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:07:18.506 03:07:52 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:07:18.506 03:07:52 -- nvmf/common.sh@105 -- # continue 2 00:07:18.506 03:07:52 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:18.506 03:07:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:18.506 03:07:52 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:07:18.506 03:07:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:18.506 03:07:52 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:07:18.506 03:07:52 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:07:18.506 03:07:52 -- nvmf/common.sh@105 -- # continue 2 00:07:18.506 03:07:52 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:18.506 03:07:52 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:07:18.506 03:07:52 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:07:18.506 03:07:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:07:18.506 03:07:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:18.506 03:07:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:18.506 03:07:52 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:07:18.506 03:07:52 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:07:18.506 03:07:52 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:07:18.506 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:07:18.506 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:07:18.506 altname enp175s0f0np0 00:07:18.506 altname ens801f0np0 00:07:18.506 inet 192.168.100.8/24 scope global cvl_0_0 00:07:18.506 valid_lft forever preferred_lft forever 00:07:18.506 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:07:18.506 valid_lft forever preferred_lft forever 00:07:18.506 03:07:52 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:18.506 03:07:52 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:07:18.506 03:07:52 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:07:18.506 03:07:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:07:18.506 03:07:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:18.506 03:07:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:18.506 03:07:52 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:07:18.506 03:07:52 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:07:18.506 03:07:52 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:07:18.506 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:07:18.506 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:07:18.506 altname enp175s0f1np1 00:07:18.506 altname ens801f1np1 00:07:18.506 inet 192.168.100.9/24 scope global cvl_0_1 00:07:18.506 valid_lft forever preferred_lft forever 00:07:18.506 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:07:18.506 valid_lft forever preferred_lft forever 00:07:18.506 03:07:52 -- nvmf/common.sh@411 -- # return 0 00:07:18.506 03:07:52 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:07:18.506 03:07:52 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:07:18.506 03:07:52 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:07:18.506 03:07:52 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:07:18.506 03:07:52 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:07:18.506 03:07:52 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:18.506 03:07:52 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:18.506 03:07:52 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:18.506 03:07:52 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:18.506 03:07:52 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:18.506 03:07:52 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:18.506 03:07:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:18.506 03:07:52 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:07:18.506 03:07:52 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:07:18.506 03:07:52 -- nvmf/common.sh@105 -- # continue 2 00:07:18.506 03:07:52 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:18.507 03:07:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:18.507 03:07:52 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:07:18.507 03:07:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:18.507 03:07:52 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:07:18.507 03:07:52 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:07:18.507 03:07:52 -- nvmf/common.sh@105 -- # continue 2 00:07:18.507 03:07:52 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:18.507 03:07:52 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:07:18.507 03:07:52 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:07:18.507 03:07:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:07:18.507 03:07:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:18.507 03:07:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:18.507 03:07:52 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:18.507 03:07:52 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:07:18.507 03:07:52 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:07:18.507 03:07:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:07:18.507 03:07:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:18.507 03:07:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:18.507 03:07:52 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:07:18.507 192.168.100.9' 00:07:18.507 03:07:52 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:07:18.507 192.168.100.9' 00:07:18.507 03:07:52 -- nvmf/common.sh@446 -- # head -n 1 00:07:18.507 03:07:52 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:07:18.507 03:07:52 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:07:18.507 192.168.100.9' 00:07:18.507 03:07:52 -- nvmf/common.sh@447 -- # tail -n +2 00:07:18.507 03:07:52 -- nvmf/common.sh@447 -- # head -n 1 00:07:18.507 03:07:52 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:07:18.507 03:07:52 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:07:18.507 03:07:52 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:07:18.507 03:07:52 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:07:18.507 03:07:52 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:07:18.507 03:07:52 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:07:18.507 03:07:52 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:07:18.507 03:07:52 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:07:18.507 03:07:52 -- common/autotest_common.sh@710 -- # xtrace_disable 00:07:18.507 03:07:52 -- common/autotest_common.sh@10 -- # set +x 00:07:18.507 03:07:52 -- nvmf/common.sh@470 -- # nvmfpid=3942589 00:07:18.507 03:07:52 -- nvmf/common.sh@471 -- # waitforlisten 3942589 00:07:18.507 03:07:52 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:18.507 03:07:52 -- common/autotest_common.sh@817 -- # '[' -z 3942589 ']' 00:07:18.507 03:07:52 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:18.507 03:07:52 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:18.507 03:07:52 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:18.507 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:18.507 03:07:52 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:18.507 03:07:52 -- common/autotest_common.sh@10 -- # set +x 00:07:18.507 [2024-04-25 03:07:52.519007] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:07:18.507 [2024-04-25 03:07:52.519052] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:18.507 EAL: No free 2048 kB hugepages reported on node 1 00:07:18.507 [2024-04-25 03:07:52.581911] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:18.507 [2024-04-25 03:07:52.653498] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:18.507 [2024-04-25 03:07:52.653540] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:18.507 [2024-04-25 03:07:52.653546] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:07:18.507 [2024-04-25 03:07:52.653552] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:07:18.507 [2024-04-25 03:07:52.653557] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:18.507 [2024-04-25 03:07:52.653604] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:18.507 [2024-04-25 03:07:52.653714] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:18.507 [2024-04-25 03:07:52.653802] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:18.507 [2024-04-25 03:07:52.653801] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:19.074 03:07:53 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:19.074 03:07:53 -- common/autotest_common.sh@850 -- # return 0 00:07:19.074 03:07:53 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:07:19.075 03:07:53 -- common/autotest_common.sh@716 -- # xtrace_disable 00:07:19.075 03:07:53 -- common/autotest_common.sh@10 -- # set +x 00:07:19.075 03:07:53 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:19.075 03:07:53 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:07:19.075 03:07:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:19.075 03:07:53 -- common/autotest_common.sh@10 -- # set +x 00:07:19.075 [2024-04-25 03:07:53.366736] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x73fea0/0x73f4e0) succeed. 00:07:19.075 [2024-04-25 03:07:53.376953] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x741210/0x73fa60) succeed. 00:07:19.075 [2024-04-25 03:07:53.376974] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:07:19.075 03:07:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:19.075 03:07:53 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t rdma -a 192.168.100.8 -s 8009 discovery 00:07:19.075 03:07:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:19.075 03:07:53 -- common/autotest_common.sh@10 -- # set +x 00:07:19.075 [2024-04-25 03:07:53.389197] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 8009 *** 00:07:19.075 03:07:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:19.075 03:07:53 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.2 -s 4430 00:07:19.075 03:07:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:19.075 03:07:53 -- common/autotest_common.sh@10 -- # set +x 00:07:19.075 03:07:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:19.075 03:07:53 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.3 -s 4430 00:07:19.075 03:07:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:19.075 03:07:53 -- common/autotest_common.sh@10 -- # set +x 00:07:19.075 03:07:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:19.075 03:07:53 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.4 -s 4430 00:07:19.075 03:07:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:19.075 03:07:53 -- common/autotest_common.sh@10 -- # set +x 00:07:19.075 03:07:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:19.075 03:07:53 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:19.075 03:07:53 -- target/referrals.sh@48 -- # jq length 00:07:19.075 03:07:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:19.075 03:07:53 -- common/autotest_common.sh@10 -- # set +x 00:07:19.075 03:07:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:19.075 03:07:53 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:07:19.075 03:07:53 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:07:19.075 03:07:53 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:19.075 03:07:53 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:19.075 03:07:53 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:19.075 03:07:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:19.075 03:07:53 -- target/referrals.sh@21 -- # sort 00:07:19.075 03:07:53 -- common/autotest_common.sh@10 -- # set +x 00:07:19.075 03:07:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:19.075 03:07:53 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:19.075 03:07:53 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:19.075 03:07:53 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:07:19.075 03:07:53 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:19.075 03:07:53 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:19.075 03:07:53 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:07:19.075 03:07:53 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:19.075 03:07:53 -- target/referrals.sh@26 -- # sort 00:07:19.506 03:07:53 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:19.506 03:07:53 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:19.506 03:07:53 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.2 -s 4430 00:07:19.506 03:07:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:19.506 03:07:53 -- common/autotest_common.sh@10 -- # set +x 00:07:19.506 03:07:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:19.506 03:07:53 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.3 -s 4430 00:07:19.506 03:07:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:19.506 03:07:53 -- common/autotest_common.sh@10 -- # set +x 00:07:19.506 03:07:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:19.506 03:07:53 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.4 -s 4430 00:07:19.506 03:07:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:19.506 03:07:53 -- common/autotest_common.sh@10 -- # set +x 00:07:19.506 03:07:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:19.506 03:07:53 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:19.506 03:07:53 -- target/referrals.sh@56 -- # jq length 00:07:19.506 03:07:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:19.506 03:07:53 -- common/autotest_common.sh@10 -- # set +x 00:07:19.506 03:07:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:19.506 03:07:53 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:07:19.506 03:07:53 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:07:19.506 03:07:53 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:19.506 03:07:53 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:19.506 03:07:53 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:07:19.506 03:07:53 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:19.506 03:07:53 -- target/referrals.sh@26 -- # sort 00:07:19.506 03:07:53 -- target/referrals.sh@26 -- # echo 00:07:19.506 03:07:53 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:07:19.506 03:07:53 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.2 -s 4430 -n discovery 00:07:19.506 03:07:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:19.506 03:07:53 -- common/autotest_common.sh@10 -- # set +x 00:07:19.506 03:07:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:19.506 03:07:53 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:19.506 03:07:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:19.506 03:07:53 -- common/autotest_common.sh@10 -- # set +x 00:07:19.506 03:07:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:19.506 03:07:53 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:07:19.506 03:07:53 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:19.506 03:07:53 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:19.506 03:07:53 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:19.506 03:07:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:19.506 03:07:53 -- target/referrals.sh@21 -- # sort 00:07:19.506 03:07:53 -- common/autotest_common.sh@10 -- # set +x 00:07:19.506 03:07:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:19.506 03:07:53 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:07:19.506 03:07:53 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:19.506 03:07:53 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:07:19.506 03:07:53 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:19.506 03:07:53 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:19.506 03:07:53 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:07:19.506 03:07:53 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:19.506 03:07:53 -- target/referrals.sh@26 -- # sort 00:07:19.506 03:07:53 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:07:19.506 03:07:53 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:19.506 03:07:53 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:07:19.506 03:07:53 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:19.506 03:07:53 -- target/referrals.sh@67 -- # jq -r .subnqn 00:07:19.506 03:07:53 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:07:19.506 03:07:53 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:19.763 03:07:54 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:07:19.763 03:07:54 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:07:19.763 03:07:54 -- target/referrals.sh@68 -- # jq -r .subnqn 00:07:19.763 03:07:54 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:19.763 03:07:54 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:07:19.763 03:07:54 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:19.763 03:07:54 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:19.763 03:07:54 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:19.763 03:07:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:19.763 03:07:54 -- common/autotest_common.sh@10 -- # set +x 00:07:19.763 03:07:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:19.763 03:07:54 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:07:19.763 03:07:54 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:19.763 03:07:54 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:19.763 03:07:54 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:19.763 03:07:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:19.763 03:07:54 -- target/referrals.sh@21 -- # sort 00:07:19.763 03:07:54 -- common/autotest_common.sh@10 -- # set +x 00:07:19.763 03:07:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:20.020 03:07:54 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:07:20.020 03:07:54 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:20.020 03:07:54 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:07:20.020 03:07:54 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:20.020 03:07:54 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:20.020 03:07:54 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:20.020 03:07:54 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:07:20.020 03:07:54 -- target/referrals.sh@26 -- # sort 00:07:20.020 03:07:54 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:07:20.020 03:07:54 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:20.020 03:07:54 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:07:20.020 03:07:54 -- target/referrals.sh@75 -- # jq -r .subnqn 00:07:20.020 03:07:54 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:20.020 03:07:54 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:07:20.020 03:07:54 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:20.278 03:07:54 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:07:20.278 03:07:54 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:07:20.278 03:07:54 -- target/referrals.sh@76 -- # jq -r .subnqn 00:07:20.278 03:07:54 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:20.278 03:07:54 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:07:20.278 03:07:54 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:20.278 03:07:54 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:20.278 03:07:54 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:07:20.278 03:07:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:20.278 03:07:54 -- common/autotest_common.sh@10 -- # set +x 00:07:20.278 03:07:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:20.278 03:07:54 -- target/referrals.sh@82 -- # jq length 00:07:20.278 03:07:54 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:20.278 03:07:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:20.278 03:07:54 -- common/autotest_common.sh@10 -- # set +x 00:07:20.278 03:07:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:20.278 03:07:54 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:07:20.278 03:07:54 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:07:20.278 03:07:54 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:20.278 03:07:54 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:20.279 03:07:54 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:07:20.279 03:07:54 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:20.279 03:07:54 -- target/referrals.sh@26 -- # sort 00:07:20.537 03:07:54 -- target/referrals.sh@26 -- # echo 00:07:20.537 03:07:54 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:07:20.537 03:07:54 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:07:20.537 03:07:54 -- target/referrals.sh@86 -- # nvmftestfini 00:07:20.537 03:07:54 -- nvmf/common.sh@477 -- # nvmfcleanup 00:07:20.537 03:07:54 -- nvmf/common.sh@117 -- # sync 00:07:20.537 03:07:54 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:07:20.537 03:07:54 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:07:20.537 03:07:54 -- nvmf/common.sh@120 -- # set +e 00:07:20.537 03:07:54 -- nvmf/common.sh@121 -- # for i in {1..20} 00:07:20.537 03:07:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:07:20.537 rmmod nvme_rdma 00:07:20.537 rmmod nvme_fabrics 00:07:20.537 03:07:54 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:07:20.537 03:07:54 -- nvmf/common.sh@124 -- # set -e 00:07:20.537 03:07:54 -- nvmf/common.sh@125 -- # return 0 00:07:20.537 03:07:54 -- nvmf/common.sh@478 -- # '[' -n 3942589 ']' 00:07:20.537 03:07:54 -- nvmf/common.sh@479 -- # killprocess 3942589 00:07:20.537 03:07:54 -- common/autotest_common.sh@936 -- # '[' -z 3942589 ']' 00:07:20.537 03:07:54 -- common/autotest_common.sh@940 -- # kill -0 3942589 00:07:20.537 03:07:54 -- common/autotest_common.sh@941 -- # uname 00:07:20.537 03:07:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:20.537 03:07:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3942589 00:07:20.537 03:07:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:20.537 03:07:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:20.537 03:07:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3942589' 00:07:20.537 killing process with pid 3942589 00:07:20.537 03:07:54 -- common/autotest_common.sh@955 -- # kill 3942589 00:07:20.537 03:07:54 -- common/autotest_common.sh@960 -- # wait 3942589 00:07:20.537 [2024-04-25 03:07:54.942379] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:07:20.795 03:07:55 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:07:20.795 03:07:55 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:07:20.795 00:07:20.795 real 0m8.894s 00:07:20.795 user 0m12.400s 00:07:20.795 sys 0m5.295s 00:07:20.795 03:07:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:20.795 03:07:55 -- common/autotest_common.sh@10 -- # set +x 00:07:20.795 ************************************ 00:07:20.795 END TEST nvmf_referrals 00:07:20.795 ************************************ 00:07:20.795 03:07:55 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=rdma 00:07:20.795 03:07:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:20.795 03:07:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:20.795 03:07:55 -- common/autotest_common.sh@10 -- # set +x 00:07:20.795 ************************************ 00:07:20.795 START TEST nvmf_connect_disconnect 00:07:20.795 ************************************ 00:07:20.795 03:07:55 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=rdma 00:07:21.054 * Looking for test storage... 00:07:21.054 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:07:21.054 03:07:55 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:07:21.054 03:07:55 -- nvmf/common.sh@7 -- # uname -s 00:07:21.054 03:07:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:21.054 03:07:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:21.054 03:07:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:21.054 03:07:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:21.054 03:07:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:21.054 03:07:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:21.054 03:07:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:21.054 03:07:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:21.054 03:07:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:21.054 03:07:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:21.054 03:07:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:07:21.055 03:07:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:07:21.055 03:07:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:21.055 03:07:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:21.055 03:07:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:21.055 03:07:55 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:21.055 03:07:55 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:07:21.055 03:07:55 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:21.055 03:07:55 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:21.055 03:07:55 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:21.055 03:07:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:21.055 03:07:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:21.055 03:07:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:21.055 03:07:55 -- paths/export.sh@5 -- # export PATH 00:07:21.055 03:07:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:21.055 03:07:55 -- nvmf/common.sh@47 -- # : 0 00:07:21.055 03:07:55 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:07:21.055 03:07:55 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:07:21.055 03:07:55 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:21.055 03:07:55 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:21.055 03:07:55 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:21.055 03:07:55 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:07:21.055 03:07:55 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:07:21.055 03:07:55 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:07:21.055 03:07:55 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:21.055 03:07:55 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:07:21.055 03:07:55 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:07:21.055 03:07:55 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:07:21.055 03:07:55 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:21.055 03:07:55 -- nvmf/common.sh@437 -- # prepare_net_devs 00:07:21.055 03:07:55 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:07:21.055 03:07:55 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:07:21.055 03:07:55 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:21.055 03:07:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:21.055 03:07:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:21.055 03:07:55 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:07:21.055 03:07:55 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:07:21.055 03:07:55 -- nvmf/common.sh@285 -- # xtrace_disable 00:07:21.055 03:07:55 -- common/autotest_common.sh@10 -- # set +x 00:07:27.621 03:08:01 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:27.621 03:08:01 -- nvmf/common.sh@291 -- # pci_devs=() 00:07:27.621 03:08:01 -- nvmf/common.sh@291 -- # local -a pci_devs 00:07:27.621 03:08:01 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:07:27.621 03:08:01 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:07:27.621 03:08:01 -- nvmf/common.sh@293 -- # pci_drivers=() 00:07:27.621 03:08:01 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:07:27.621 03:08:01 -- nvmf/common.sh@295 -- # net_devs=() 00:07:27.621 03:08:01 -- nvmf/common.sh@295 -- # local -ga net_devs 00:07:27.621 03:08:01 -- nvmf/common.sh@296 -- # e810=() 00:07:27.621 03:08:01 -- nvmf/common.sh@296 -- # local -ga e810 00:07:27.621 03:08:01 -- nvmf/common.sh@297 -- # x722=() 00:07:27.621 03:08:01 -- nvmf/common.sh@297 -- # local -ga x722 00:07:27.621 03:08:01 -- nvmf/common.sh@298 -- # mlx=() 00:07:27.621 03:08:01 -- nvmf/common.sh@298 -- # local -ga mlx 00:07:27.621 03:08:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:27.621 03:08:01 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:27.621 03:08:01 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:27.621 03:08:01 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:27.621 03:08:01 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:27.621 03:08:01 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:27.621 03:08:01 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:27.621 03:08:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:27.621 03:08:01 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:27.621 03:08:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:27.622 03:08:01 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:27.622 03:08:01 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:07:27.622 03:08:01 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:07:27.622 03:08:01 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:07:27.622 03:08:01 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:07:27.622 03:08:01 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:07:27.622 03:08:01 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:07:27.622 03:08:01 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:07:27.622 03:08:01 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:07:27.622 03:08:01 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:27.622 03:08:01 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:07:27.622 Found 0000:af:00.0 (0x8086 - 0x159b) 00:07:27.622 03:08:01 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:07:27.622 03:08:01 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:07:27.622 03:08:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:27.622 03:08:01 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:27.622 03:08:01 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:07:27.622 03:08:01 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:27.622 03:08:01 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:27.622 03:08:01 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:07:27.622 Found 0000:af:00.1 (0x8086 - 0x159b) 00:07:27.622 03:08:01 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:07:27.622 03:08:01 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:07:27.622 03:08:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:27.622 03:08:01 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:27.622 03:08:01 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:07:27.622 03:08:01 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:27.622 03:08:01 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:07:27.622 03:08:01 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:07:27.622 03:08:01 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:07:27.622 03:08:01 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:07:27.622 03:08:01 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:07:27.622 03:08:01 -- nvmf/common.sh@377 -- # modinfo irdma 00:07:27.622 03:08:01 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:07:27.622 03:08:01 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:27.622 03:08:01 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:27.622 03:08:01 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:27.622 03:08:01 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:27.622 03:08:01 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:07:27.622 Found net devices under 0000:af:00.0: cvl_0_0 00:07:27.622 03:08:01 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:27.622 03:08:01 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:27.622 03:08:01 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:27.622 03:08:01 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:27.622 03:08:01 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:27.622 03:08:01 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:07:27.622 Found net devices under 0000:af:00.1: cvl_0_1 00:07:27.622 03:08:01 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:27.622 03:08:01 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:07:27.622 03:08:01 -- nvmf/common.sh@403 -- # is_hw=yes 00:07:27.622 03:08:01 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:07:27.622 03:08:01 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:07:27.622 03:08:01 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:07:27.622 03:08:01 -- nvmf/common.sh@409 -- # rdma_device_init 00:07:27.622 03:08:01 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:07:27.622 03:08:01 -- nvmf/common.sh@58 -- # uname 00:07:27.622 03:08:01 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:07:27.622 03:08:01 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:07:27.622 03:08:01 -- nvmf/common.sh@63 -- # modprobe ib_core 00:07:27.622 03:08:01 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:07:27.622 03:08:01 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:07:27.622 03:08:01 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:07:27.622 03:08:01 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:07:27.622 03:08:01 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:07:27.622 03:08:01 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:07:27.622 03:08:01 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:07:27.622 03:08:01 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:07:27.622 03:08:01 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:27.622 03:08:01 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:27.622 03:08:01 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:27.622 03:08:01 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:27.622 03:08:01 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:27.622 03:08:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:27.622 03:08:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:27.622 03:08:01 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:07:27.622 03:08:01 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:07:27.622 03:08:01 -- nvmf/common.sh@105 -- # continue 2 00:07:27.622 03:08:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:27.622 03:08:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:27.622 03:08:01 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:07:27.622 03:08:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:27.622 03:08:01 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:07:27.622 03:08:01 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:07:27.622 03:08:01 -- nvmf/common.sh@105 -- # continue 2 00:07:27.622 03:08:01 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:27.622 03:08:01 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:07:27.622 03:08:01 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:07:27.622 03:08:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:07:27.622 03:08:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:27.622 03:08:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:27.622 03:08:01 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:07:27.622 03:08:01 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:07:27.622 03:08:01 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:07:27.622 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:07:27.622 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:07:27.622 altname enp175s0f0np0 00:07:27.622 altname ens801f0np0 00:07:27.622 inet 192.168.100.8/24 scope global cvl_0_0 00:07:27.622 valid_lft forever preferred_lft forever 00:07:27.622 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:07:27.622 valid_lft forever preferred_lft forever 00:07:27.622 03:08:01 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:27.622 03:08:01 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:07:27.622 03:08:01 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:07:27.622 03:08:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:07:27.622 03:08:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:27.622 03:08:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:27.622 03:08:01 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:07:27.622 03:08:01 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:07:27.622 03:08:01 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:07:27.622 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:07:27.622 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:07:27.622 altname enp175s0f1np1 00:07:27.622 altname ens801f1np1 00:07:27.622 inet 192.168.100.9/24 scope global cvl_0_1 00:07:27.622 valid_lft forever preferred_lft forever 00:07:27.622 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:07:27.622 valid_lft forever preferred_lft forever 00:07:27.622 03:08:01 -- nvmf/common.sh@411 -- # return 0 00:07:27.622 03:08:01 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:07:27.622 03:08:01 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:07:27.622 03:08:01 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:07:27.622 03:08:01 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:07:27.622 03:08:01 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:07:27.622 03:08:01 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:27.622 03:08:01 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:27.622 03:08:01 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:27.622 03:08:01 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:27.622 03:08:01 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:27.623 03:08:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:27.623 03:08:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:27.623 03:08:01 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:07:27.623 03:08:01 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:07:27.623 03:08:01 -- nvmf/common.sh@105 -- # continue 2 00:07:27.623 03:08:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:27.623 03:08:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:27.623 03:08:01 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:07:27.623 03:08:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:27.623 03:08:01 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:07:27.623 03:08:01 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:07:27.623 03:08:01 -- nvmf/common.sh@105 -- # continue 2 00:07:27.623 03:08:01 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:27.623 03:08:01 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:07:27.623 03:08:01 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:07:27.623 03:08:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:07:27.623 03:08:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:27.623 03:08:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:27.623 03:08:01 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:27.623 03:08:01 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:07:27.623 03:08:01 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:07:27.623 03:08:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:07:27.623 03:08:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:27.623 03:08:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:27.623 03:08:01 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:07:27.623 192.168.100.9' 00:07:27.623 03:08:01 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:07:27.623 192.168.100.9' 00:07:27.623 03:08:01 -- nvmf/common.sh@446 -- # head -n 1 00:07:27.623 03:08:01 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:07:27.623 03:08:01 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:07:27.623 192.168.100.9' 00:07:27.623 03:08:01 -- nvmf/common.sh@447 -- # head -n 1 00:07:27.623 03:08:01 -- nvmf/common.sh@447 -- # tail -n +2 00:07:27.623 03:08:01 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:07:27.623 03:08:01 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:07:27.623 03:08:01 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:07:27.623 03:08:01 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:07:27.623 03:08:01 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:07:27.623 03:08:01 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:07:27.623 03:08:01 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:07:27.623 03:08:01 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:07:27.623 03:08:01 -- common/autotest_common.sh@710 -- # xtrace_disable 00:07:27.623 03:08:01 -- common/autotest_common.sh@10 -- # set +x 00:07:27.623 03:08:01 -- nvmf/common.sh@470 -- # nvmfpid=3946561 00:07:27.623 03:08:01 -- nvmf/common.sh@471 -- # waitforlisten 3946561 00:07:27.623 03:08:01 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:27.623 03:08:01 -- common/autotest_common.sh@817 -- # '[' -z 3946561 ']' 00:07:27.623 03:08:01 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:27.623 03:08:01 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:27.623 03:08:01 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:27.623 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:27.623 03:08:01 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:27.623 03:08:01 -- common/autotest_common.sh@10 -- # set +x 00:07:27.623 [2024-04-25 03:08:01.592135] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:07:27.623 [2024-04-25 03:08:01.592181] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:27.623 EAL: No free 2048 kB hugepages reported on node 1 00:07:27.623 [2024-04-25 03:08:01.653533] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:27.623 [2024-04-25 03:08:01.724195] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:27.623 [2024-04-25 03:08:01.724236] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:27.623 [2024-04-25 03:08:01.724242] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:07:27.623 [2024-04-25 03:08:01.724248] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:07:27.623 [2024-04-25 03:08:01.724253] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:27.623 [2024-04-25 03:08:01.724314] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:27.623 [2024-04-25 03:08:01.724409] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:27.623 [2024-04-25 03:08:01.724499] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:27.623 [2024-04-25 03:08:01.724500] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:28.191 03:08:02 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:28.191 03:08:02 -- common/autotest_common.sh@850 -- # return 0 00:07:28.191 03:08:02 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:07:28.191 03:08:02 -- common/autotest_common.sh@716 -- # xtrace_disable 00:07:28.191 03:08:02 -- common/autotest_common.sh@10 -- # set +x 00:07:28.191 03:08:02 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:28.191 03:08:02 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -c 0 00:07:28.191 03:08:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:28.191 03:08:02 -- common/autotest_common.sh@10 -- # set +x 00:07:28.191 [2024-04-25 03:08:02.457875] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:07:28.191 [2024-04-25 03:08:02.472367] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0xa21ea0/0xa214e0) succeed. 00:07:28.191 [2024-04-25 03:08:02.482268] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0xa23210/0xa21a60) succeed. 00:07:28.191 [2024-04-25 03:08:02.482290] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:07:28.191 03:08:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:28.191 03:08:02 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:07:28.191 03:08:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:28.191 03:08:02 -- common/autotest_common.sh@10 -- # set +x 00:07:28.191 03:08:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:28.191 03:08:02 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:07:28.191 03:08:02 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:28.191 03:08:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:28.191 03:08:02 -- common/autotest_common.sh@10 -- # set +x 00:07:28.191 03:08:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:28.191 03:08:02 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:28.191 03:08:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:28.191 03:08:02 -- common/autotest_common.sh@10 -- # set +x 00:07:28.191 03:08:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:28.191 03:08:02 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:07:28.191 03:08:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:28.191 03:08:02 -- common/autotest_common.sh@10 -- # set +x 00:07:28.191 [2024-04-25 03:08:02.537026] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:07:28.191 03:08:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:28.191 03:08:02 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:07:28.191 03:08:02 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:07:28.191 03:08:02 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:07:28.191 03:08:02 -- target/connect_disconnect.sh@34 -- # set +x 00:07:31.475 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:34.008 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:36.541 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:39.111 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:42.397 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:44.927 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:47.460 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:49.992 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:53.275 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:55.807 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:58.337 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:00.869 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:04.189 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:06.722 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:09.270 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:11.804 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:15.092 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:17.626 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:20.159 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:22.693 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:25.227 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:28.548 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:31.081 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:33.617 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:36.149 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:38.679 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:41.960 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:44.490 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:47.022 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:49.553 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:52.148 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:55.432 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:57.958 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:00.488 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:03.018 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:05.548 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:08.834 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:11.365 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:13.926 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:16.459 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:19.747 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:22.280 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:24.814 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:27.347 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:29.877 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:33.163 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:35.696 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:38.257 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:40.788 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:43.323 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:46.609 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:49.143 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:51.674 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:54.205 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:56.740 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:00.021 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:02.595 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:05.130 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:07.659 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:10.194 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:13.480 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:16.014 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:18.549 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:21.084 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:24.399 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:26.934 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:29.466 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:32.000 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:34.537 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:37.828 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:40.361 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:42.895 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:45.428 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:48.023 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:51.315 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:53.849 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:56.381 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:58.912 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:01.444 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:04.732 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:07.263 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:09.797 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:12.397 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:14.932 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:18.217 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:20.746 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:23.281 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:25.814 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:29.099 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:31.634 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:34.167 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:36.730 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:39.259 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:42.547 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:45.080 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:47.611 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:50.144 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:52.678 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:55.967 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:58.537 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:58.537 03:12:32 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:11:58.537 03:12:32 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:11:58.537 03:12:32 -- nvmf/common.sh@477 -- # nvmfcleanup 00:11:58.537 03:12:32 -- nvmf/common.sh@117 -- # sync 00:11:58.537 03:12:32 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:11:58.537 03:12:32 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:11:58.537 03:12:32 -- nvmf/common.sh@120 -- # set +e 00:11:58.537 03:12:32 -- nvmf/common.sh@121 -- # for i in {1..20} 00:11:58.537 03:12:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:11:58.537 rmmod nvme_rdma 00:11:58.537 rmmod nvme_fabrics 00:11:58.537 03:12:32 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:11:58.537 03:12:32 -- nvmf/common.sh@124 -- # set -e 00:11:58.537 03:12:32 -- nvmf/common.sh@125 -- # return 0 00:11:58.537 03:12:32 -- nvmf/common.sh@478 -- # '[' -n 3946561 ']' 00:11:58.537 03:12:32 -- nvmf/common.sh@479 -- # killprocess 3946561 00:11:58.537 03:12:32 -- common/autotest_common.sh@936 -- # '[' -z 3946561 ']' 00:11:58.537 03:12:32 -- common/autotest_common.sh@940 -- # kill -0 3946561 00:11:58.537 03:12:32 -- common/autotest_common.sh@941 -- # uname 00:11:58.537 03:12:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:58.537 03:12:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3946561 00:11:58.537 03:12:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:58.537 03:12:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:58.537 03:12:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3946561' 00:11:58.537 killing process with pid 3946561 00:11:58.537 03:12:32 -- common/autotest_common.sh@955 -- # kill 3946561 00:11:58.537 03:12:32 -- common/autotest_common.sh@960 -- # wait 3946561 00:11:58.537 [2024-04-25 03:12:32.655764] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:11:58.537 03:12:32 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:11:58.537 03:12:32 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:11:58.537 00:11:58.537 real 4m37.603s 00:11:58.537 user 18m3.264s 00:11:58.537 sys 0m16.428s 00:11:58.537 03:12:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:11:58.537 03:12:32 -- common/autotest_common.sh@10 -- # set +x 00:11:58.537 ************************************ 00:11:58.537 END TEST nvmf_connect_disconnect 00:11:58.537 ************************************ 00:11:58.537 03:12:32 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=rdma 00:11:58.537 03:12:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:58.537 03:12:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:58.537 03:12:32 -- common/autotest_common.sh@10 -- # set +x 00:11:58.796 ************************************ 00:11:58.796 START TEST nvmf_multitarget 00:11:58.796 ************************************ 00:11:58.796 03:12:33 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=rdma 00:11:58.796 * Looking for test storage... 00:11:58.796 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:11:58.796 03:12:33 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:11:58.796 03:12:33 -- nvmf/common.sh@7 -- # uname -s 00:11:58.796 03:12:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:58.796 03:12:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:58.796 03:12:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:58.796 03:12:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:58.796 03:12:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:58.796 03:12:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:58.796 03:12:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:58.796 03:12:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:58.796 03:12:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:58.796 03:12:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:58.796 03:12:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:11:58.796 03:12:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:11:58.796 03:12:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:58.796 03:12:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:58.796 03:12:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:58.796 03:12:33 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:58.796 03:12:33 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:11:58.796 03:12:33 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:58.796 03:12:33 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:58.796 03:12:33 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:58.796 03:12:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:58.796 03:12:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:58.796 03:12:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:58.796 03:12:33 -- paths/export.sh@5 -- # export PATH 00:11:58.796 03:12:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:58.796 03:12:33 -- nvmf/common.sh@47 -- # : 0 00:11:58.796 03:12:33 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:11:58.796 03:12:33 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:11:58.796 03:12:33 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:58.796 03:12:33 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:58.796 03:12:33 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:58.796 03:12:33 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:11:58.796 03:12:33 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:11:58.796 03:12:33 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:11:58.796 03:12:33 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:58.796 03:12:33 -- target/multitarget.sh@15 -- # nvmftestinit 00:11:58.796 03:12:33 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:11:58.796 03:12:33 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:58.796 03:12:33 -- nvmf/common.sh@437 -- # prepare_net_devs 00:11:58.796 03:12:33 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:11:58.796 03:12:33 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:11:58.796 03:12:33 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:58.796 03:12:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:58.797 03:12:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:58.797 03:12:33 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:11:58.797 03:12:33 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:11:58.797 03:12:33 -- nvmf/common.sh@285 -- # xtrace_disable 00:11:58.797 03:12:33 -- common/autotest_common.sh@10 -- # set +x 00:12:05.365 03:12:38 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:05.365 03:12:38 -- nvmf/common.sh@291 -- # pci_devs=() 00:12:05.365 03:12:38 -- nvmf/common.sh@291 -- # local -a pci_devs 00:12:05.365 03:12:38 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:12:05.365 03:12:38 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:12:05.365 03:12:38 -- nvmf/common.sh@293 -- # pci_drivers=() 00:12:05.365 03:12:38 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:12:05.365 03:12:38 -- nvmf/common.sh@295 -- # net_devs=() 00:12:05.365 03:12:38 -- nvmf/common.sh@295 -- # local -ga net_devs 00:12:05.365 03:12:38 -- nvmf/common.sh@296 -- # e810=() 00:12:05.365 03:12:38 -- nvmf/common.sh@296 -- # local -ga e810 00:12:05.365 03:12:38 -- nvmf/common.sh@297 -- # x722=() 00:12:05.365 03:12:38 -- nvmf/common.sh@297 -- # local -ga x722 00:12:05.365 03:12:38 -- nvmf/common.sh@298 -- # mlx=() 00:12:05.365 03:12:38 -- nvmf/common.sh@298 -- # local -ga mlx 00:12:05.365 03:12:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:05.365 03:12:38 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:05.365 03:12:38 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:05.365 03:12:38 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:05.365 03:12:38 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:05.365 03:12:38 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:05.365 03:12:38 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:05.365 03:12:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:05.365 03:12:38 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:05.365 03:12:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:05.365 03:12:38 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:05.365 03:12:38 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:12:05.365 03:12:38 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:12:05.365 03:12:38 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:12:05.365 03:12:38 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:12:05.365 03:12:38 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:12:05.365 03:12:38 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:12:05.365 03:12:38 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:12:05.365 03:12:38 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:12:05.365 03:12:38 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:05.365 03:12:38 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:12:05.365 Found 0000:af:00.0 (0x8086 - 0x159b) 00:12:05.365 03:12:38 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:12:05.365 03:12:38 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:12:05.365 03:12:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:05.365 03:12:38 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:05.365 03:12:38 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:05.365 03:12:38 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:05.365 03:12:38 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:05.365 03:12:38 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:12:05.365 Found 0000:af:00.1 (0x8086 - 0x159b) 00:12:05.365 03:12:38 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:12:05.365 03:12:38 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:12:05.365 03:12:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:05.366 03:12:38 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:05.366 03:12:38 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:05.366 03:12:38 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:05.366 03:12:38 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:12:05.366 03:12:38 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:12:05.366 03:12:38 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:12:05.366 03:12:38 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:12:05.366 03:12:38 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:12:05.366 03:12:38 -- nvmf/common.sh@377 -- # modinfo irdma 00:12:05.366 03:12:38 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:12:05.366 03:12:38 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:05.366 03:12:38 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:05.366 03:12:38 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:05.366 03:12:38 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:05.366 03:12:38 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:12:05.366 Found net devices under 0000:af:00.0: cvl_0_0 00:12:05.366 03:12:38 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:05.366 03:12:38 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:05.366 03:12:38 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:05.366 03:12:38 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:05.366 03:12:38 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:05.366 03:12:38 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:12:05.366 Found net devices under 0000:af:00.1: cvl_0_1 00:12:05.366 03:12:38 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:05.366 03:12:38 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:12:05.366 03:12:38 -- nvmf/common.sh@403 -- # is_hw=yes 00:12:05.366 03:12:38 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:12:05.366 03:12:38 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:12:05.366 03:12:38 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:12:05.366 03:12:38 -- nvmf/common.sh@409 -- # rdma_device_init 00:12:05.366 03:12:38 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:12:05.366 03:12:38 -- nvmf/common.sh@58 -- # uname 00:12:05.366 03:12:38 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:12:05.366 03:12:38 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:12:05.366 03:12:38 -- nvmf/common.sh@63 -- # modprobe ib_core 00:12:05.366 03:12:38 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:12:05.366 03:12:38 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:12:05.366 03:12:38 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:12:05.366 03:12:38 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:12:05.366 03:12:38 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:12:05.366 03:12:38 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:12:05.366 03:12:38 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:12:05.366 03:12:38 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:12:05.366 03:12:38 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:05.366 03:12:38 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:05.366 03:12:38 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:05.366 03:12:38 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:05.366 03:12:39 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:05.366 03:12:39 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:05.366 03:12:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:05.366 03:12:39 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:12:05.366 03:12:39 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:12:05.366 03:12:39 -- nvmf/common.sh@105 -- # continue 2 00:12:05.366 03:12:39 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:05.366 03:12:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:05.366 03:12:39 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:12:05.366 03:12:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:05.366 03:12:39 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:12:05.366 03:12:39 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:12:05.366 03:12:39 -- nvmf/common.sh@105 -- # continue 2 00:12:05.366 03:12:39 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:05.366 03:12:39 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:12:05.366 03:12:39 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:12:05.366 03:12:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:12:05.366 03:12:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:05.366 03:12:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:05.366 03:12:39 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:12:05.366 03:12:39 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:12:05.366 03:12:39 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:12:05.366 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:12:05.366 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:12:05.366 altname enp175s0f0np0 00:12:05.366 altname ens801f0np0 00:12:05.366 inet 192.168.100.8/24 scope global cvl_0_0 00:12:05.366 valid_lft forever preferred_lft forever 00:12:05.366 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:12:05.366 valid_lft forever preferred_lft forever 00:12:05.366 03:12:39 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:05.366 03:12:39 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:12:05.366 03:12:39 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:12:05.366 03:12:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:12:05.366 03:12:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:05.366 03:12:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:05.366 03:12:39 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:12:05.366 03:12:39 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:12:05.366 03:12:39 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:12:05.366 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:12:05.366 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:12:05.366 altname enp175s0f1np1 00:12:05.366 altname ens801f1np1 00:12:05.366 inet 192.168.100.9/24 scope global cvl_0_1 00:12:05.366 valid_lft forever preferred_lft forever 00:12:05.366 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:12:05.366 valid_lft forever preferred_lft forever 00:12:05.366 03:12:39 -- nvmf/common.sh@411 -- # return 0 00:12:05.366 03:12:39 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:12:05.366 03:12:39 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:12:05.366 03:12:39 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:12:05.366 03:12:39 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:12:05.366 03:12:39 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:12:05.366 03:12:39 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:05.366 03:12:39 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:05.366 03:12:39 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:05.366 03:12:39 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:05.366 03:12:39 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:05.366 03:12:39 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:05.366 03:12:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:05.366 03:12:39 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:12:05.366 03:12:39 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:12:05.366 03:12:39 -- nvmf/common.sh@105 -- # continue 2 00:12:05.366 03:12:39 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:05.366 03:12:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:05.366 03:12:39 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:12:05.366 03:12:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:05.366 03:12:39 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:12:05.366 03:12:39 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:12:05.366 03:12:39 -- nvmf/common.sh@105 -- # continue 2 00:12:05.366 03:12:39 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:05.366 03:12:39 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:12:05.366 03:12:39 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:12:05.366 03:12:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:12:05.366 03:12:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:05.366 03:12:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:05.366 03:12:39 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:05.366 03:12:39 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:12:05.367 03:12:39 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:12:05.367 03:12:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:12:05.367 03:12:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:05.367 03:12:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:05.367 03:12:39 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:12:05.367 192.168.100.9' 00:12:05.367 03:12:39 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:12:05.367 192.168.100.9' 00:12:05.367 03:12:39 -- nvmf/common.sh@446 -- # head -n 1 00:12:05.367 03:12:39 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:12:05.367 03:12:39 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:12:05.367 192.168.100.9' 00:12:05.367 03:12:39 -- nvmf/common.sh@447 -- # tail -n +2 00:12:05.367 03:12:39 -- nvmf/common.sh@447 -- # head -n 1 00:12:05.367 03:12:39 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:12:05.367 03:12:39 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:12:05.367 03:12:39 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:12:05.367 03:12:39 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:12:05.367 03:12:39 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:12:05.367 03:12:39 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:12:05.367 03:12:39 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:12:05.367 03:12:39 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:05.367 03:12:39 -- common/autotest_common.sh@710 -- # xtrace_disable 00:12:05.367 03:12:39 -- common/autotest_common.sh@10 -- # set +x 00:12:05.367 03:12:39 -- nvmf/common.sh@470 -- # nvmfpid=3996932 00:12:05.367 03:12:39 -- nvmf/common.sh@471 -- # waitforlisten 3996932 00:12:05.367 03:12:39 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:05.367 03:12:39 -- common/autotest_common.sh@817 -- # '[' -z 3996932 ']' 00:12:05.367 03:12:39 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:05.367 03:12:39 -- common/autotest_common.sh@822 -- # local max_retries=100 00:12:05.367 03:12:39 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:05.367 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:05.367 03:12:39 -- common/autotest_common.sh@826 -- # xtrace_disable 00:12:05.367 03:12:39 -- common/autotest_common.sh@10 -- # set +x 00:12:05.367 [2024-04-25 03:12:39.162146] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:12:05.367 [2024-04-25 03:12:39.162189] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:05.367 EAL: No free 2048 kB hugepages reported on node 1 00:12:05.367 [2024-04-25 03:12:39.221853] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:05.367 [2024-04-25 03:12:39.298211] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:05.367 [2024-04-25 03:12:39.298246] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:05.367 [2024-04-25 03:12:39.298253] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:05.367 [2024-04-25 03:12:39.298262] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:05.367 [2024-04-25 03:12:39.298267] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:05.367 [2024-04-25 03:12:39.298305] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:05.367 [2024-04-25 03:12:39.298403] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:05.367 [2024-04-25 03:12:39.298491] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:05.367 [2024-04-25 03:12:39.298493] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:05.625 03:12:39 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:12:05.625 03:12:39 -- common/autotest_common.sh@850 -- # return 0 00:12:05.625 03:12:39 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:05.625 03:12:39 -- common/autotest_common.sh@716 -- # xtrace_disable 00:12:05.625 03:12:39 -- common/autotest_common.sh@10 -- # set +x 00:12:05.626 03:12:40 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:05.626 03:12:40 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:05.626 03:12:40 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:05.626 03:12:40 -- target/multitarget.sh@21 -- # jq length 00:12:05.626 03:12:40 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:12:05.626 03:12:40 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:12:05.884 "nvmf_tgt_1" 00:12:05.884 03:12:40 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:12:05.884 "nvmf_tgt_2" 00:12:05.884 03:12:40 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:05.884 03:12:40 -- target/multitarget.sh@28 -- # jq length 00:12:06.143 03:12:40 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:12:06.143 03:12:40 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:12:06.143 true 00:12:06.143 03:12:40 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:12:06.143 true 00:12:06.143 03:12:40 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:06.143 03:12:40 -- target/multitarget.sh@35 -- # jq length 00:12:06.402 03:12:40 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:12:06.402 03:12:40 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:12:06.402 03:12:40 -- target/multitarget.sh@41 -- # nvmftestfini 00:12:06.402 03:12:40 -- nvmf/common.sh@477 -- # nvmfcleanup 00:12:06.402 03:12:40 -- nvmf/common.sh@117 -- # sync 00:12:06.402 03:12:40 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:12:06.402 03:12:40 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:12:06.402 03:12:40 -- nvmf/common.sh@120 -- # set +e 00:12:06.402 03:12:40 -- nvmf/common.sh@121 -- # for i in {1..20} 00:12:06.402 03:12:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:12:06.402 rmmod nvme_rdma 00:12:06.402 rmmod nvme_fabrics 00:12:06.402 03:12:40 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:12:06.402 03:12:40 -- nvmf/common.sh@124 -- # set -e 00:12:06.402 03:12:40 -- nvmf/common.sh@125 -- # return 0 00:12:06.402 03:12:40 -- nvmf/common.sh@478 -- # '[' -n 3996932 ']' 00:12:06.402 03:12:40 -- nvmf/common.sh@479 -- # killprocess 3996932 00:12:06.402 03:12:40 -- common/autotest_common.sh@936 -- # '[' -z 3996932 ']' 00:12:06.402 03:12:40 -- common/autotest_common.sh@940 -- # kill -0 3996932 00:12:06.402 03:12:40 -- common/autotest_common.sh@941 -- # uname 00:12:06.402 03:12:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:06.402 03:12:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3996932 00:12:06.402 03:12:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:06.402 03:12:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:06.402 03:12:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3996932' 00:12:06.402 killing process with pid 3996932 00:12:06.402 03:12:40 -- common/autotest_common.sh@955 -- # kill 3996932 00:12:06.402 03:12:40 -- common/autotest_common.sh@960 -- # wait 3996932 00:12:06.661 03:12:41 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:12:06.661 03:12:41 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:12:06.661 00:12:06.661 real 0m7.974s 00:12:06.661 user 0m9.293s 00:12:06.661 sys 0m4.926s 00:12:06.661 03:12:41 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:12:06.661 03:12:41 -- common/autotest_common.sh@10 -- # set +x 00:12:06.661 ************************************ 00:12:06.661 END TEST nvmf_multitarget 00:12:06.661 ************************************ 00:12:06.661 03:12:41 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=rdma 00:12:06.661 03:12:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:06.661 03:12:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:06.661 03:12:41 -- common/autotest_common.sh@10 -- # set +x 00:12:06.920 ************************************ 00:12:06.920 START TEST nvmf_rpc 00:12:06.920 ************************************ 00:12:06.920 03:12:41 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=rdma 00:12:06.920 * Looking for test storage... 00:12:06.920 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:12:06.920 03:12:41 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:12:06.920 03:12:41 -- nvmf/common.sh@7 -- # uname -s 00:12:06.920 03:12:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:06.920 03:12:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:06.920 03:12:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:06.920 03:12:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:06.920 03:12:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:06.920 03:12:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:06.920 03:12:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:06.920 03:12:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:06.920 03:12:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:06.920 03:12:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:06.920 03:12:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:12:06.920 03:12:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:12:06.920 03:12:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:06.920 03:12:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:06.920 03:12:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:06.920 03:12:41 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:06.920 03:12:41 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:12:06.920 03:12:41 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:06.920 03:12:41 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:06.920 03:12:41 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:06.920 03:12:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:06.920 03:12:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:06.920 03:12:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:06.920 03:12:41 -- paths/export.sh@5 -- # export PATH 00:12:06.920 03:12:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:06.920 03:12:41 -- nvmf/common.sh@47 -- # : 0 00:12:06.921 03:12:41 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:12:06.921 03:12:41 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:12:06.921 03:12:41 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:06.921 03:12:41 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:06.921 03:12:41 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:06.921 03:12:41 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:12:06.921 03:12:41 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:12:06.921 03:12:41 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:12:06.921 03:12:41 -- target/rpc.sh@11 -- # loops=5 00:12:06.921 03:12:41 -- target/rpc.sh@23 -- # nvmftestinit 00:12:06.921 03:12:41 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:12:06.921 03:12:41 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:06.921 03:12:41 -- nvmf/common.sh@437 -- # prepare_net_devs 00:12:06.921 03:12:41 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:12:06.921 03:12:41 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:12:06.921 03:12:41 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:06.921 03:12:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:06.921 03:12:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:06.921 03:12:41 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:12:06.921 03:12:41 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:12:06.921 03:12:41 -- nvmf/common.sh@285 -- # xtrace_disable 00:12:06.921 03:12:41 -- common/autotest_common.sh@10 -- # set +x 00:12:13.490 03:12:47 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:13.490 03:12:47 -- nvmf/common.sh@291 -- # pci_devs=() 00:12:13.490 03:12:47 -- nvmf/common.sh@291 -- # local -a pci_devs 00:12:13.490 03:12:47 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:12:13.490 03:12:47 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:12:13.490 03:12:47 -- nvmf/common.sh@293 -- # pci_drivers=() 00:12:13.490 03:12:47 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:12:13.490 03:12:47 -- nvmf/common.sh@295 -- # net_devs=() 00:12:13.490 03:12:47 -- nvmf/common.sh@295 -- # local -ga net_devs 00:12:13.490 03:12:47 -- nvmf/common.sh@296 -- # e810=() 00:12:13.490 03:12:47 -- nvmf/common.sh@296 -- # local -ga e810 00:12:13.490 03:12:47 -- nvmf/common.sh@297 -- # x722=() 00:12:13.490 03:12:47 -- nvmf/common.sh@297 -- # local -ga x722 00:12:13.490 03:12:47 -- nvmf/common.sh@298 -- # mlx=() 00:12:13.490 03:12:47 -- nvmf/common.sh@298 -- # local -ga mlx 00:12:13.490 03:12:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:13.490 03:12:47 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:13.490 03:12:47 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:13.490 03:12:47 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:13.490 03:12:47 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:13.490 03:12:47 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:13.490 03:12:47 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:13.490 03:12:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:13.490 03:12:47 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:13.490 03:12:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:13.490 03:12:47 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:13.490 03:12:47 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:12:13.490 03:12:47 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:12:13.490 03:12:47 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:12:13.490 03:12:47 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:12:13.490 03:12:47 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:12:13.490 03:12:47 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:12:13.490 03:12:47 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:12:13.490 03:12:47 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:12:13.490 03:12:47 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:13.490 03:12:47 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:12:13.490 Found 0000:af:00.0 (0x8086 - 0x159b) 00:12:13.490 03:12:47 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:12:13.490 03:12:47 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:12:13.490 03:12:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:13.490 03:12:47 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:13.490 03:12:47 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:13.490 03:12:47 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:13.490 03:12:47 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:13.490 03:12:47 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:12:13.490 Found 0000:af:00.1 (0x8086 - 0x159b) 00:12:13.490 03:12:47 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:12:13.490 03:12:47 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:12:13.490 03:12:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:13.490 03:12:47 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:13.490 03:12:47 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:13.490 03:12:47 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:13.490 03:12:47 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:12:13.490 03:12:47 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:12:13.490 03:12:47 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:12:13.490 03:12:47 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:12:13.490 03:12:47 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:12:13.490 03:12:47 -- nvmf/common.sh@377 -- # modinfo irdma 00:12:13.490 03:12:47 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:12:13.490 03:12:47 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:13.490 03:12:47 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:13.490 03:12:47 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:13.490 03:12:47 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:13.490 03:12:47 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:12:13.490 Found net devices under 0000:af:00.0: cvl_0_0 00:12:13.490 03:12:47 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:13.490 03:12:47 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:13.490 03:12:47 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:13.490 03:12:47 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:13.490 03:12:47 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:13.490 03:12:47 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:12:13.490 Found net devices under 0000:af:00.1: cvl_0_1 00:12:13.490 03:12:47 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:13.490 03:12:47 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:12:13.490 03:12:47 -- nvmf/common.sh@403 -- # is_hw=yes 00:12:13.490 03:12:47 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:12:13.490 03:12:47 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:12:13.490 03:12:47 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:12:13.490 03:12:47 -- nvmf/common.sh@409 -- # rdma_device_init 00:12:13.490 03:12:47 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:12:13.490 03:12:47 -- nvmf/common.sh@58 -- # uname 00:12:13.490 03:12:47 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:12:13.490 03:12:47 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:12:13.490 03:12:47 -- nvmf/common.sh@63 -- # modprobe ib_core 00:12:13.491 03:12:47 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:12:13.491 03:12:47 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:12:13.491 03:12:47 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:12:13.491 03:12:47 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:12:13.491 03:12:47 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:12:13.491 03:12:47 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:12:13.491 03:12:47 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:12:13.491 03:12:47 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:12:13.491 03:12:47 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:13.491 03:12:47 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:13.491 03:12:47 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:13.491 03:12:47 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:13.491 03:12:47 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:13.491 03:12:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:13.491 03:12:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:13.491 03:12:47 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:12:13.491 03:12:47 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:12:13.491 03:12:47 -- nvmf/common.sh@105 -- # continue 2 00:12:13.491 03:12:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:13.491 03:12:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:13.491 03:12:47 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:12:13.491 03:12:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:13.491 03:12:47 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:12:13.491 03:12:47 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:12:13.491 03:12:47 -- nvmf/common.sh@105 -- # continue 2 00:12:13.491 03:12:47 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:13.491 03:12:47 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:12:13.491 03:12:47 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:12:13.491 03:12:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:12:13.491 03:12:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:13.491 03:12:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:13.491 03:12:47 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:12:13.491 03:12:47 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:12:13.491 03:12:47 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:12:13.491 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:12:13.491 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:12:13.491 altname enp175s0f0np0 00:12:13.491 altname ens801f0np0 00:12:13.491 inet 192.168.100.8/24 scope global cvl_0_0 00:12:13.491 valid_lft forever preferred_lft forever 00:12:13.491 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:12:13.491 valid_lft forever preferred_lft forever 00:12:13.491 03:12:47 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:13.491 03:12:47 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:12:13.491 03:12:47 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:12:13.491 03:12:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:12:13.491 03:12:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:13.491 03:12:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:13.491 03:12:47 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:12:13.491 03:12:47 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:12:13.491 03:12:47 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:12:13.491 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:12:13.491 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:12:13.491 altname enp175s0f1np1 00:12:13.491 altname ens801f1np1 00:12:13.491 inet 192.168.100.9/24 scope global cvl_0_1 00:12:13.491 valid_lft forever preferred_lft forever 00:12:13.491 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:12:13.491 valid_lft forever preferred_lft forever 00:12:13.491 03:12:47 -- nvmf/common.sh@411 -- # return 0 00:12:13.491 03:12:47 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:12:13.491 03:12:47 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:12:13.491 03:12:47 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:12:13.491 03:12:47 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:12:13.491 03:12:47 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:12:13.491 03:12:47 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:13.491 03:12:47 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:13.491 03:12:47 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:13.491 03:12:47 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:13.491 03:12:47 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:13.491 03:12:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:13.491 03:12:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:13.491 03:12:47 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:12:13.491 03:12:47 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:12:13.491 03:12:47 -- nvmf/common.sh@105 -- # continue 2 00:12:13.491 03:12:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:13.491 03:12:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:13.491 03:12:47 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:12:13.491 03:12:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:13.491 03:12:47 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:12:13.491 03:12:47 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:12:13.491 03:12:47 -- nvmf/common.sh@105 -- # continue 2 00:12:13.491 03:12:47 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:13.491 03:12:47 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:12:13.491 03:12:47 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:12:13.491 03:12:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:12:13.491 03:12:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:13.491 03:12:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:13.491 03:12:47 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:13.491 03:12:47 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:12:13.491 03:12:47 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:12:13.491 03:12:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:12:13.491 03:12:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:13.491 03:12:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:13.491 03:12:47 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:12:13.491 192.168.100.9' 00:12:13.491 03:12:47 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:12:13.491 192.168.100.9' 00:12:13.491 03:12:47 -- nvmf/common.sh@446 -- # head -n 1 00:12:13.491 03:12:47 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:12:13.491 03:12:47 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:12:13.491 192.168.100.9' 00:12:13.491 03:12:47 -- nvmf/common.sh@447 -- # tail -n +2 00:12:13.491 03:12:47 -- nvmf/common.sh@447 -- # head -n 1 00:12:13.491 03:12:47 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:12:13.491 03:12:47 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:12:13.491 03:12:47 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:12:13.491 03:12:47 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:12:13.491 03:12:47 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:12:13.491 03:12:47 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:12:13.491 03:12:47 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:12:13.491 03:12:47 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:13.491 03:12:47 -- common/autotest_common.sh@710 -- # xtrace_disable 00:12:13.491 03:12:47 -- common/autotest_common.sh@10 -- # set +x 00:12:13.491 03:12:47 -- nvmf/common.sh@470 -- # nvmfpid=4000638 00:12:13.491 03:12:47 -- nvmf/common.sh@471 -- # waitforlisten 4000638 00:12:13.491 03:12:47 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:13.491 03:12:47 -- common/autotest_common.sh@817 -- # '[' -z 4000638 ']' 00:12:13.491 03:12:47 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:13.491 03:12:47 -- common/autotest_common.sh@822 -- # local max_retries=100 00:12:13.491 03:12:47 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:13.491 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:13.491 03:12:47 -- common/autotest_common.sh@826 -- # xtrace_disable 00:12:13.491 03:12:47 -- common/autotest_common.sh@10 -- # set +x 00:12:13.491 [2024-04-25 03:12:47.338077] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:12:13.491 [2024-04-25 03:12:47.338121] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:13.491 EAL: No free 2048 kB hugepages reported on node 1 00:12:13.491 [2024-04-25 03:12:47.402696] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:13.491 [2024-04-25 03:12:47.476792] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:13.491 [2024-04-25 03:12:47.476833] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:13.491 [2024-04-25 03:12:47.476840] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:13.491 [2024-04-25 03:12:47.476846] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:13.491 [2024-04-25 03:12:47.476851] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:13.491 [2024-04-25 03:12:47.476907] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:13.491 [2024-04-25 03:12:47.476977] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:13.491 [2024-04-25 03:12:47.476995] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:13.491 [2024-04-25 03:12:47.477000] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:13.751 03:12:48 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:12:13.751 03:12:48 -- common/autotest_common.sh@850 -- # return 0 00:12:13.751 03:12:48 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:13.751 03:12:48 -- common/autotest_common.sh@716 -- # xtrace_disable 00:12:13.751 03:12:48 -- common/autotest_common.sh@10 -- # set +x 00:12:13.751 03:12:48 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:13.751 03:12:48 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:12:13.751 03:12:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:13.751 03:12:48 -- common/autotest_common.sh@10 -- # set +x 00:12:13.751 03:12:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:13.751 03:12:48 -- target/rpc.sh@26 -- # stats='{ 00:12:13.751 "tick_rate": 2100000000, 00:12:13.751 "poll_groups": [ 00:12:13.751 { 00:12:13.751 "name": "nvmf_tgt_poll_group_0", 00:12:13.751 "admin_qpairs": 0, 00:12:13.751 "io_qpairs": 0, 00:12:13.751 "current_admin_qpairs": 0, 00:12:13.751 "current_io_qpairs": 0, 00:12:13.751 "pending_bdev_io": 0, 00:12:13.751 "completed_nvme_io": 0, 00:12:13.751 "transports": [] 00:12:13.751 }, 00:12:13.751 { 00:12:13.751 "name": "nvmf_tgt_poll_group_1", 00:12:13.751 "admin_qpairs": 0, 00:12:13.751 "io_qpairs": 0, 00:12:13.751 "current_admin_qpairs": 0, 00:12:13.751 "current_io_qpairs": 0, 00:12:13.751 "pending_bdev_io": 0, 00:12:13.751 "completed_nvme_io": 0, 00:12:13.751 "transports": [] 00:12:13.751 }, 00:12:13.751 { 00:12:13.751 "name": "nvmf_tgt_poll_group_2", 00:12:13.751 "admin_qpairs": 0, 00:12:13.751 "io_qpairs": 0, 00:12:13.751 "current_admin_qpairs": 0, 00:12:13.751 "current_io_qpairs": 0, 00:12:13.751 "pending_bdev_io": 0, 00:12:13.751 "completed_nvme_io": 0, 00:12:13.751 "transports": [] 00:12:13.751 }, 00:12:13.751 { 00:12:13.751 "name": "nvmf_tgt_poll_group_3", 00:12:13.751 "admin_qpairs": 0, 00:12:13.751 "io_qpairs": 0, 00:12:13.751 "current_admin_qpairs": 0, 00:12:13.751 "current_io_qpairs": 0, 00:12:13.751 "pending_bdev_io": 0, 00:12:13.751 "completed_nvme_io": 0, 00:12:13.751 "transports": [] 00:12:13.751 } 00:12:13.751 ] 00:12:13.751 }' 00:12:13.751 03:12:48 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:12:13.751 03:12:48 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:12:13.751 03:12:48 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:12:13.751 03:12:48 -- target/rpc.sh@15 -- # wc -l 00:12:13.751 03:12:48 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:12:13.751 03:12:48 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:12:14.010 03:12:48 -- target/rpc.sh@29 -- # [[ null == null ]] 00:12:14.010 03:12:48 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:12:14.010 03:12:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:14.010 03:12:48 -- common/autotest_common.sh@10 -- # set +x 00:12:14.010 [2024-04-25 03:12:48.300520] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x9f8f00/0x9f8540) succeed. 00:12:14.010 [2024-04-25 03:12:48.310511] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x9fa270/0x9f8ac0) succeed. 00:12:14.010 [2024-04-25 03:12:48.310533] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:12:14.010 03:12:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:14.010 03:12:48 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:12:14.010 03:12:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:14.010 03:12:48 -- common/autotest_common.sh@10 -- # set +x 00:12:14.010 03:12:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:14.010 03:12:48 -- target/rpc.sh@33 -- # stats='{ 00:12:14.010 "tick_rate": 2100000000, 00:12:14.010 "poll_groups": [ 00:12:14.010 { 00:12:14.010 "name": "nvmf_tgt_poll_group_0", 00:12:14.010 "admin_qpairs": 0, 00:12:14.010 "io_qpairs": 0, 00:12:14.010 "current_admin_qpairs": 0, 00:12:14.010 "current_io_qpairs": 0, 00:12:14.010 "pending_bdev_io": 0, 00:12:14.010 "completed_nvme_io": 0, 00:12:14.010 "transports": [ 00:12:14.010 { 00:12:14.010 "trtype": "RDMA", 00:12:14.010 "pending_data_buffer": 0, 00:12:14.010 "devices": [ 00:12:14.010 { 00:12:14.010 "name": "rocep175s0f0", 00:12:14.010 "polls": 1598, 00:12:14.010 "idle_polls": 1598, 00:12:14.010 "completions": 0, 00:12:14.010 "requests": 0, 00:12:14.010 "request_latency": 0, 00:12:14.010 "pending_free_request": 0, 00:12:14.010 "pending_rdma_read": 0, 00:12:14.010 "pending_rdma_write": 0, 00:12:14.010 "pending_rdma_send": 0, 00:12:14.010 "total_send_wrs": 0, 00:12:14.010 "send_doorbell_updates": 0, 00:12:14.010 "total_recv_wrs": 0, 00:12:14.010 "recv_doorbell_updates": 0 00:12:14.010 }, 00:12:14.010 { 00:12:14.010 "name": "rocep175s0f1", 00:12:14.010 "polls": 1598, 00:12:14.010 "idle_polls": 1598, 00:12:14.010 "completions": 0, 00:12:14.010 "requests": 0, 00:12:14.010 "request_latency": 0, 00:12:14.010 "pending_free_request": 0, 00:12:14.010 "pending_rdma_read": 0, 00:12:14.010 "pending_rdma_write": 0, 00:12:14.010 "pending_rdma_send": 0, 00:12:14.010 "total_send_wrs": 0, 00:12:14.010 "send_doorbell_updates": 0, 00:12:14.010 "total_recv_wrs": 0, 00:12:14.010 "recv_doorbell_updates": 0 00:12:14.010 } 00:12:14.010 ] 00:12:14.010 } 00:12:14.010 ] 00:12:14.010 }, 00:12:14.010 { 00:12:14.010 "name": "nvmf_tgt_poll_group_1", 00:12:14.010 "admin_qpairs": 0, 00:12:14.010 "io_qpairs": 0, 00:12:14.010 "current_admin_qpairs": 0, 00:12:14.010 "current_io_qpairs": 0, 00:12:14.010 "pending_bdev_io": 0, 00:12:14.010 "completed_nvme_io": 0, 00:12:14.010 "transports": [ 00:12:14.010 { 00:12:14.010 "trtype": "RDMA", 00:12:14.010 "pending_data_buffer": 0, 00:12:14.010 "devices": [ 00:12:14.010 { 00:12:14.010 "name": "rocep175s0f0", 00:12:14.010 "polls": 1512, 00:12:14.010 "idle_polls": 1512, 00:12:14.010 "completions": 0, 00:12:14.010 "requests": 0, 00:12:14.010 "request_latency": 0, 00:12:14.010 "pending_free_request": 0, 00:12:14.010 "pending_rdma_read": 0, 00:12:14.010 "pending_rdma_write": 0, 00:12:14.010 "pending_rdma_send": 0, 00:12:14.010 "total_send_wrs": 0, 00:12:14.010 "send_doorbell_updates": 0, 00:12:14.010 "total_recv_wrs": 0, 00:12:14.010 "recv_doorbell_updates": 0 00:12:14.010 }, 00:12:14.010 { 00:12:14.010 "name": "rocep175s0f1", 00:12:14.010 "polls": 1512, 00:12:14.010 "idle_polls": 1512, 00:12:14.010 "completions": 0, 00:12:14.010 "requests": 0, 00:12:14.010 "request_latency": 0, 00:12:14.010 "pending_free_request": 0, 00:12:14.010 "pending_rdma_read": 0, 00:12:14.010 "pending_rdma_write": 0, 00:12:14.010 "pending_rdma_send": 0, 00:12:14.010 "total_send_wrs": 0, 00:12:14.010 "send_doorbell_updates": 0, 00:12:14.010 "total_recv_wrs": 0, 00:12:14.010 "recv_doorbell_updates": 0 00:12:14.010 } 00:12:14.010 ] 00:12:14.010 } 00:12:14.010 ] 00:12:14.010 }, 00:12:14.010 { 00:12:14.010 "name": "nvmf_tgt_poll_group_2", 00:12:14.010 "admin_qpairs": 0, 00:12:14.010 "io_qpairs": 0, 00:12:14.010 "current_admin_qpairs": 0, 00:12:14.010 "current_io_qpairs": 0, 00:12:14.010 "pending_bdev_io": 0, 00:12:14.010 "completed_nvme_io": 0, 00:12:14.010 "transports": [ 00:12:14.010 { 00:12:14.010 "trtype": "RDMA", 00:12:14.010 "pending_data_buffer": 0, 00:12:14.010 "devices": [ 00:12:14.010 { 00:12:14.010 "name": "rocep175s0f0", 00:12:14.010 "polls": 1400, 00:12:14.010 "idle_polls": 1400, 00:12:14.010 "completions": 0, 00:12:14.010 "requests": 0, 00:12:14.010 "request_latency": 0, 00:12:14.010 "pending_free_request": 0, 00:12:14.010 "pending_rdma_read": 0, 00:12:14.010 "pending_rdma_write": 0, 00:12:14.010 "pending_rdma_send": 0, 00:12:14.010 "total_send_wrs": 0, 00:12:14.010 "send_doorbell_updates": 0, 00:12:14.010 "total_recv_wrs": 0, 00:12:14.010 "recv_doorbell_updates": 0 00:12:14.010 }, 00:12:14.010 { 00:12:14.010 "name": "rocep175s0f1", 00:12:14.010 "polls": 1400, 00:12:14.010 "idle_polls": 1400, 00:12:14.010 "completions": 0, 00:12:14.010 "requests": 0, 00:12:14.010 "request_latency": 0, 00:12:14.010 "pending_free_request": 0, 00:12:14.010 "pending_rdma_read": 0, 00:12:14.010 "pending_rdma_write": 0, 00:12:14.010 "pending_rdma_send": 0, 00:12:14.010 "total_send_wrs": 0, 00:12:14.010 "send_doorbell_updates": 0, 00:12:14.010 "total_recv_wrs": 0, 00:12:14.010 "recv_doorbell_updates": 0 00:12:14.010 } 00:12:14.010 ] 00:12:14.010 } 00:12:14.010 ] 00:12:14.010 }, 00:12:14.010 { 00:12:14.010 "name": "nvmf_tgt_poll_group_3", 00:12:14.010 "admin_qpairs": 0, 00:12:14.010 "io_qpairs": 0, 00:12:14.010 "current_admin_qpairs": 0, 00:12:14.010 "current_io_qpairs": 0, 00:12:14.010 "pending_bdev_io": 0, 00:12:14.010 "completed_nvme_io": 0, 00:12:14.010 "transports": [ 00:12:14.010 { 00:12:14.010 "trtype": "RDMA", 00:12:14.010 "pending_data_buffer": 0, 00:12:14.011 "devices": [ 00:12:14.011 { 00:12:14.011 "name": "rocep175s0f0", 00:12:14.011 "polls": 1032, 00:12:14.011 "idle_polls": 1032, 00:12:14.011 "completions": 0, 00:12:14.011 "requests": 0, 00:12:14.011 "request_latency": 0, 00:12:14.011 "pending_free_request": 0, 00:12:14.011 "pending_rdma_read": 0, 00:12:14.011 "pending_rdma_write": 0, 00:12:14.011 "pending_rdma_send": 0, 00:12:14.011 "total_send_wrs": 0, 00:12:14.011 "send_doorbell_updates": 0, 00:12:14.011 "total_recv_wrs": 0, 00:12:14.011 "recv_doorbell_updates": 0 00:12:14.011 }, 00:12:14.011 { 00:12:14.011 "name": "rocep175s0f1", 00:12:14.011 "polls": 1032, 00:12:14.011 "idle_polls": 1032, 00:12:14.011 "completions": 0, 00:12:14.011 "requests": 0, 00:12:14.011 "request_latency": 0, 00:12:14.011 "pending_free_request": 0, 00:12:14.011 "pending_rdma_read": 0, 00:12:14.011 "pending_rdma_write": 0, 00:12:14.011 "pending_rdma_send": 0, 00:12:14.011 "total_send_wrs": 0, 00:12:14.011 "send_doorbell_updates": 0, 00:12:14.011 "total_recv_wrs": 0, 00:12:14.011 "recv_doorbell_updates": 0 00:12:14.011 } 00:12:14.011 ] 00:12:14.011 } 00:12:14.011 ] 00:12:14.011 } 00:12:14.011 ] 00:12:14.011 }' 00:12:14.011 03:12:48 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:12:14.011 03:12:48 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:14.011 03:12:48 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:14.011 03:12:48 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:14.011 03:12:48 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:12:14.011 03:12:48 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:12:14.011 03:12:48 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:14.011 03:12:48 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:14.011 03:12:48 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:14.011 03:12:48 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:12:14.011 03:12:48 -- target/rpc.sh@38 -- # '[' rdma == rdma ']' 00:12:14.011 03:12:48 -- target/rpc.sh@40 -- # jcount '.poll_groups[0].transports[].trtype' 00:12:14.011 03:12:48 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[0].transports[].trtype' 00:12:14.011 03:12:48 -- target/rpc.sh@15 -- # jq '.poll_groups[0].transports[].trtype' 00:12:14.011 03:12:48 -- target/rpc.sh@15 -- # wc -l 00:12:14.011 03:12:48 -- target/rpc.sh@40 -- # (( 1 == 1 )) 00:12:14.011 03:12:48 -- target/rpc.sh@41 -- # jq -r '.poll_groups[0].transports[0].trtype' 00:12:14.270 03:12:48 -- target/rpc.sh@41 -- # transport_type=RDMA 00:12:14.270 03:12:48 -- target/rpc.sh@42 -- # [[ rdma == \r\d\m\a ]] 00:12:14.270 03:12:48 -- target/rpc.sh@43 -- # jcount '.poll_groups[0].transports[0].devices[].name' 00:12:14.270 03:12:48 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[0].transports[0].devices[].name' 00:12:14.270 03:12:48 -- target/rpc.sh@15 -- # wc -l 00:12:14.270 03:12:48 -- target/rpc.sh@15 -- # jq '.poll_groups[0].transports[0].devices[].name' 00:12:14.270 03:12:48 -- target/rpc.sh@43 -- # (( 2 > 0 )) 00:12:14.270 03:12:48 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:12:14.270 03:12:48 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:12:14.271 03:12:48 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:12:14.271 03:12:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:14.271 03:12:48 -- common/autotest_common.sh@10 -- # set +x 00:12:14.271 Malloc1 00:12:14.271 03:12:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:14.271 03:12:48 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:12:14.271 03:12:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:14.271 03:12:48 -- common/autotest_common.sh@10 -- # set +x 00:12:14.271 03:12:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:14.271 03:12:48 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:14.271 03:12:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:14.271 03:12:48 -- common/autotest_common.sh@10 -- # set +x 00:12:14.271 03:12:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:14.271 03:12:48 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:12:14.271 03:12:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:14.271 03:12:48 -- common/autotest_common.sh@10 -- # set +x 00:12:14.271 03:12:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:14.271 03:12:48 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:12:14.271 03:12:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:14.271 03:12:48 -- common/autotest_common.sh@10 -- # set +x 00:12:14.271 [2024-04-25 03:12:48.622457] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:14.271 03:12:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:14.271 03:12:48 -- target/rpc.sh@58 -- # NOT nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 -a 192.168.100.8 -s 4420 00:12:14.271 03:12:48 -- common/autotest_common.sh@638 -- # local es=0 00:12:14.271 03:12:48 -- common/autotest_common.sh@640 -- # valid_exec_arg nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 -a 192.168.100.8 -s 4420 00:12:14.271 03:12:48 -- common/autotest_common.sh@626 -- # local arg=nvme 00:12:14.271 03:12:48 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:12:14.271 03:12:48 -- common/autotest_common.sh@630 -- # type -t nvme 00:12:14.271 03:12:48 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:12:14.271 03:12:48 -- common/autotest_common.sh@632 -- # type -P nvme 00:12:14.271 03:12:48 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:12:14.271 03:12:48 -- common/autotest_common.sh@632 -- # arg=/usr/sbin/nvme 00:12:14.271 03:12:48 -- common/autotest_common.sh@632 -- # [[ -x /usr/sbin/nvme ]] 00:12:14.271 03:12:48 -- common/autotest_common.sh@641 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 -a 192.168.100.8 -s 4420 00:12:14.271 [2024-04-25 03:12:48.660336] ctrlr.c: 766:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562' 00:12:14.271 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:14.271 could not add new controller: failed to write to nvme-fabrics device 00:12:14.271 03:12:48 -- common/autotest_common.sh@641 -- # es=1 00:12:14.271 03:12:48 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:12:14.271 03:12:48 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:12:14.271 03:12:48 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:12:14.271 03:12:48 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:12:14.271 03:12:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:14.271 03:12:48 -- common/autotest_common.sh@10 -- # set +x 00:12:14.271 03:12:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:14.271 03:12:48 -- target/rpc.sh@62 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:12:14.530 03:12:48 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:12:14.530 03:12:48 -- common/autotest_common.sh@1184 -- # local i=0 00:12:14.530 03:12:48 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:12:14.530 03:12:48 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:12:14.530 03:12:48 -- common/autotest_common.sh@1191 -- # sleep 2 00:12:17.060 03:12:50 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:12:17.060 03:12:50 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:12:17.060 03:12:50 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:12:17.060 03:12:50 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:12:17.060 03:12:50 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:12:17.060 03:12:50 -- common/autotest_common.sh@1194 -- # return 0 00:12:17.060 03:12:50 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:17.627 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:17.627 03:12:51 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:17.627 03:12:51 -- common/autotest_common.sh@1205 -- # local i=0 00:12:17.627 03:12:51 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:12:17.627 03:12:51 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:17.627 03:12:51 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:12:17.627 03:12:51 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:17.627 03:12:51 -- common/autotest_common.sh@1217 -- # return 0 00:12:17.627 03:12:51 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:12:17.627 03:12:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:17.627 03:12:51 -- common/autotest_common.sh@10 -- # set +x 00:12:17.627 03:12:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:17.627 03:12:51 -- target/rpc.sh@69 -- # NOT nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:12:17.627 03:12:51 -- common/autotest_common.sh@638 -- # local es=0 00:12:17.627 03:12:51 -- common/autotest_common.sh@640 -- # valid_exec_arg nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:12:17.627 03:12:51 -- common/autotest_common.sh@626 -- # local arg=nvme 00:12:17.627 03:12:51 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:12:17.627 03:12:51 -- common/autotest_common.sh@630 -- # type -t nvme 00:12:17.627 03:12:51 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:12:17.627 03:12:51 -- common/autotest_common.sh@632 -- # type -P nvme 00:12:17.627 03:12:51 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:12:17.627 03:12:51 -- common/autotest_common.sh@632 -- # arg=/usr/sbin/nvme 00:12:17.627 03:12:51 -- common/autotest_common.sh@632 -- # [[ -x /usr/sbin/nvme ]] 00:12:17.627 03:12:51 -- common/autotest_common.sh@641 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:12:17.627 [2024-04-25 03:12:51.910035] ctrlr.c: 766:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562' 00:12:17.627 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:17.627 could not add new controller: failed to write to nvme-fabrics device 00:12:17.627 03:12:51 -- common/autotest_common.sh@641 -- # es=1 00:12:17.627 03:12:51 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:12:17.627 03:12:51 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:12:17.627 03:12:51 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:12:17.627 03:12:51 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:12:17.627 03:12:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:17.627 03:12:51 -- common/autotest_common.sh@10 -- # set +x 00:12:17.627 03:12:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:17.627 03:12:51 -- target/rpc.sh@73 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:12:17.885 03:12:52 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:12:17.885 03:12:52 -- common/autotest_common.sh@1184 -- # local i=0 00:12:17.885 03:12:52 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:12:17.885 03:12:52 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:12:17.885 03:12:52 -- common/autotest_common.sh@1191 -- # sleep 2 00:12:19.784 03:12:54 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:12:19.784 03:12:54 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:12:19.784 03:12:54 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:12:19.784 03:12:54 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:12:19.784 03:12:54 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:12:19.784 03:12:54 -- common/autotest_common.sh@1194 -- # return 0 00:12:19.784 03:12:54 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:20.717 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:20.717 03:12:55 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:20.717 03:12:55 -- common/autotest_common.sh@1205 -- # local i=0 00:12:20.717 03:12:55 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:12:20.717 03:12:55 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:20.717 03:12:55 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:12:20.717 03:12:55 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:20.717 03:12:55 -- common/autotest_common.sh@1217 -- # return 0 00:12:20.717 03:12:55 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:20.717 03:12:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:20.717 03:12:55 -- common/autotest_common.sh@10 -- # set +x 00:12:20.717 03:12:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:20.717 03:12:55 -- target/rpc.sh@81 -- # seq 1 5 00:12:20.717 03:12:55 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:20.717 03:12:55 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:20.717 03:12:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:20.717 03:12:55 -- common/autotest_common.sh@10 -- # set +x 00:12:20.717 03:12:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:20.717 03:12:55 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:12:20.717 03:12:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:20.717 03:12:55 -- common/autotest_common.sh@10 -- # set +x 00:12:20.717 [2024-04-25 03:12:55.153517] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:20.717 03:12:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:20.717 03:12:55 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:20.717 03:12:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:20.717 03:12:55 -- common/autotest_common.sh@10 -- # set +x 00:12:20.717 03:12:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:20.717 03:12:55 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:20.717 03:12:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:20.717 03:12:55 -- common/autotest_common.sh@10 -- # set +x 00:12:20.717 03:12:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:20.717 03:12:55 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:12:20.975 03:12:55 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:20.975 03:12:55 -- common/autotest_common.sh@1184 -- # local i=0 00:12:20.975 03:12:55 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:12:20.975 03:12:55 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:12:20.975 03:12:55 -- common/autotest_common.sh@1191 -- # sleep 2 00:12:22.908 03:12:57 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:12:22.908 03:12:57 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:12:22.908 03:12:57 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:12:22.908 03:12:57 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:12:22.908 03:12:57 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:12:22.908 03:12:57 -- common/autotest_common.sh@1194 -- # return 0 00:12:22.908 03:12:57 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:23.844 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:23.844 03:12:58 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:23.844 03:12:58 -- common/autotest_common.sh@1205 -- # local i=0 00:12:23.844 03:12:58 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:12:23.844 03:12:58 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:23.844 03:12:58 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:12:23.844 03:12:58 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:23.844 03:12:58 -- common/autotest_common.sh@1217 -- # return 0 00:12:23.844 03:12:58 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:23.844 03:12:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:23.844 03:12:58 -- common/autotest_common.sh@10 -- # set +x 00:12:23.844 03:12:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:23.844 03:12:58 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:23.844 03:12:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:23.844 03:12:58 -- common/autotest_common.sh@10 -- # set +x 00:12:23.844 03:12:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:23.844 03:12:58 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:23.844 03:12:58 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:23.844 03:12:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:23.844 03:12:58 -- common/autotest_common.sh@10 -- # set +x 00:12:23.844 03:12:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:23.845 03:12:58 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:12:23.845 03:12:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:23.845 03:12:58 -- common/autotest_common.sh@10 -- # set +x 00:12:23.845 [2024-04-25 03:12:58.310674] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:23.845 03:12:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:23.845 03:12:58 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:23.845 03:12:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:23.845 03:12:58 -- common/autotest_common.sh@10 -- # set +x 00:12:23.845 03:12:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:23.845 03:12:58 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:23.845 03:12:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:23.845 03:12:58 -- common/autotest_common.sh@10 -- # set +x 00:12:23.845 03:12:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:23.845 03:12:58 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:12:24.104 03:12:58 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:24.104 03:12:58 -- common/autotest_common.sh@1184 -- # local i=0 00:12:24.104 03:12:58 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:12:24.104 03:12:58 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:12:24.104 03:12:58 -- common/autotest_common.sh@1191 -- # sleep 2 00:12:26.639 03:13:00 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:12:26.639 03:13:00 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:12:26.639 03:13:00 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:12:26.639 03:13:00 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:12:26.639 03:13:00 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:12:26.639 03:13:00 -- common/autotest_common.sh@1194 -- # return 0 00:12:26.639 03:13:00 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:27.206 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:27.206 03:13:01 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:27.206 03:13:01 -- common/autotest_common.sh@1205 -- # local i=0 00:12:27.206 03:13:01 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:12:27.206 03:13:01 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:27.206 03:13:01 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:12:27.206 03:13:01 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:27.206 03:13:01 -- common/autotest_common.sh@1217 -- # return 0 00:12:27.206 03:13:01 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:27.206 03:13:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:27.206 03:13:01 -- common/autotest_common.sh@10 -- # set +x 00:12:27.206 03:13:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:27.206 03:13:01 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:27.206 03:13:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:27.206 03:13:01 -- common/autotest_common.sh@10 -- # set +x 00:12:27.206 03:13:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:27.206 03:13:01 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:27.206 03:13:01 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:27.206 03:13:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:27.206 03:13:01 -- common/autotest_common.sh@10 -- # set +x 00:12:27.206 03:13:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:27.206 03:13:01 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:12:27.206 03:13:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:27.206 03:13:01 -- common/autotest_common.sh@10 -- # set +x 00:12:27.206 [2024-04-25 03:13:01.491651] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:27.206 03:13:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:27.206 03:13:01 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:27.206 03:13:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:27.206 03:13:01 -- common/autotest_common.sh@10 -- # set +x 00:12:27.206 03:13:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:27.206 03:13:01 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:27.206 03:13:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:27.206 03:13:01 -- common/autotest_common.sh@10 -- # set +x 00:12:27.206 03:13:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:27.206 03:13:01 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:12:27.465 03:13:01 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:27.465 03:13:01 -- common/autotest_common.sh@1184 -- # local i=0 00:12:27.465 03:13:01 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:12:27.465 03:13:01 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:12:27.465 03:13:01 -- common/autotest_common.sh@1191 -- # sleep 2 00:12:29.365 03:13:03 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:12:29.365 03:13:03 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:12:29.365 03:13:03 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:12:29.365 03:13:03 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:12:29.365 03:13:03 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:12:29.365 03:13:03 -- common/autotest_common.sh@1194 -- # return 0 00:12:29.365 03:13:03 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:30.300 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:30.300 03:13:04 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:30.300 03:13:04 -- common/autotest_common.sh@1205 -- # local i=0 00:12:30.300 03:13:04 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:12:30.300 03:13:04 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:30.300 03:13:04 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:12:30.300 03:13:04 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:30.300 03:13:04 -- common/autotest_common.sh@1217 -- # return 0 00:12:30.300 03:13:04 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:30.300 03:13:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:30.300 03:13:04 -- common/autotest_common.sh@10 -- # set +x 00:12:30.300 03:13:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:30.300 03:13:04 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:30.300 03:13:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:30.300 03:13:04 -- common/autotest_common.sh@10 -- # set +x 00:12:30.300 03:13:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:30.300 03:13:04 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:30.300 03:13:04 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:30.300 03:13:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:30.300 03:13:04 -- common/autotest_common.sh@10 -- # set +x 00:12:30.300 03:13:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:30.300 03:13:04 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:12:30.300 03:13:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:30.300 03:13:04 -- common/autotest_common.sh@10 -- # set +x 00:12:30.300 [2024-04-25 03:13:04.661498] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:30.301 03:13:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:30.301 03:13:04 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:30.301 03:13:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:30.301 03:13:04 -- common/autotest_common.sh@10 -- # set +x 00:12:30.301 03:13:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:30.301 03:13:04 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:30.301 03:13:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:30.301 03:13:04 -- common/autotest_common.sh@10 -- # set +x 00:12:30.301 03:13:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:30.301 03:13:04 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:12:30.559 03:13:04 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:30.559 03:13:04 -- common/autotest_common.sh@1184 -- # local i=0 00:12:30.559 03:13:04 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:12:30.559 03:13:04 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:12:30.559 03:13:04 -- common/autotest_common.sh@1191 -- # sleep 2 00:12:32.465 03:13:06 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:12:32.465 03:13:06 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:12:32.465 03:13:06 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:12:32.465 03:13:06 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:12:32.465 03:13:06 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:12:32.465 03:13:06 -- common/autotest_common.sh@1194 -- # return 0 00:12:32.465 03:13:06 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:33.401 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:33.401 03:13:07 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:33.401 03:13:07 -- common/autotest_common.sh@1205 -- # local i=0 00:12:33.401 03:13:07 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:12:33.401 03:13:07 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:33.401 03:13:07 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:12:33.401 03:13:07 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:33.401 03:13:07 -- common/autotest_common.sh@1217 -- # return 0 00:12:33.401 03:13:07 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:33.401 03:13:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:33.401 03:13:07 -- common/autotest_common.sh@10 -- # set +x 00:12:33.401 03:13:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:33.401 03:13:07 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:33.401 03:13:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:33.401 03:13:07 -- common/autotest_common.sh@10 -- # set +x 00:12:33.401 03:13:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:33.401 03:13:07 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:33.401 03:13:07 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:33.401 03:13:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:33.401 03:13:07 -- common/autotest_common.sh@10 -- # set +x 00:12:33.401 03:13:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:33.401 03:13:07 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:12:33.401 03:13:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:33.401 03:13:07 -- common/autotest_common.sh@10 -- # set +x 00:12:33.401 [2024-04-25 03:13:07.838905] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:33.401 03:13:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:33.401 03:13:07 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:33.401 03:13:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:33.401 03:13:07 -- common/autotest_common.sh@10 -- # set +x 00:12:33.401 03:13:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:33.401 03:13:07 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:33.401 03:13:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:33.401 03:13:07 -- common/autotest_common.sh@10 -- # set +x 00:12:33.401 03:13:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:33.401 03:13:07 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:12:33.659 03:13:08 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:33.659 03:13:08 -- common/autotest_common.sh@1184 -- # local i=0 00:12:33.659 03:13:08 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:12:33.659 03:13:08 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:12:33.659 03:13:08 -- common/autotest_common.sh@1191 -- # sleep 2 00:12:36.190 03:13:10 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:12:36.190 03:13:10 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:12:36.190 03:13:10 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:12:36.190 03:13:10 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:12:36.190 03:13:10 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:12:36.190 03:13:10 -- common/autotest_common.sh@1194 -- # return 0 00:12:36.190 03:13:10 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:36.758 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:36.758 03:13:10 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:36.759 03:13:10 -- common/autotest_common.sh@1205 -- # local i=0 00:12:36.759 03:13:10 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:12:36.759 03:13:10 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:36.759 03:13:10 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:12:36.759 03:13:10 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:36.759 03:13:10 -- common/autotest_common.sh@1217 -- # return 0 00:12:36.759 03:13:10 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:36.759 03:13:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:10 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 03:13:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:10 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:36.759 03:13:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:10 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@99 -- # seq 1 5 00:12:36.759 03:13:11 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:36.759 03:13:11 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 [2024-04-25 03:13:11.028556] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:36.759 03:13:11 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 [2024-04-25 03:13:11.077080] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:36.759 03:13:11 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 [2024-04-25 03:13:11.125222] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:36.759 03:13:11 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 [2024-04-25 03:13:11.177426] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:36.759 03:13:11 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 [2024-04-25 03:13:11.225599] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:36.759 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.759 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:36.759 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:36.759 03:13:11 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:36.760 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:36.760 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:37.019 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:37.019 03:13:11 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:12:37.019 03:13:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:37.019 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:37.019 03:13:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:37.019 03:13:11 -- target/rpc.sh@110 -- # stats='{ 00:12:37.019 "tick_rate": 2100000000, 00:12:37.019 "poll_groups": [ 00:12:37.019 { 00:12:37.019 "name": "nvmf_tgt_poll_group_0", 00:12:37.019 "admin_qpairs": 2, 00:12:37.019 "io_qpairs": 27, 00:12:37.019 "current_admin_qpairs": 0, 00:12:37.019 "current_io_qpairs": 0, 00:12:37.019 "pending_bdev_io": 0, 00:12:37.019 "completed_nvme_io": 166, 00:12:37.019 "transports": [ 00:12:37.019 { 00:12:37.019 "trtype": "RDMA", 00:12:37.019 "pending_data_buffer": 0, 00:12:37.019 "devices": [ 00:12:37.019 { 00:12:37.019 "name": "rocep175s0f0", 00:12:37.019 "polls": 2746461, 00:12:37.019 "idle_polls": 2745962, 00:12:37.019 "completions": 3987, 00:12:37.019 "requests": 3768, 00:12:37.019 "request_latency": 408448072, 00:12:37.019 "pending_free_request": 0, 00:12:37.019 "pending_rdma_read": 0, 00:12:37.019 "pending_rdma_write": 0, 00:12:37.019 "pending_rdma_send": 0, 00:12:37.019 "total_send_wrs": 383, 00:12:37.019 "send_doorbell_updates": 180, 00:12:37.019 "total_recv_wrs": 3768, 00:12:37.019 "recv_doorbell_updates": 207 00:12:37.019 }, 00:12:37.019 { 00:12:37.019 "name": "rocep175s0f1", 00:12:37.019 "polls": 2746461, 00:12:37.019 "idle_polls": 2746461, 00:12:37.019 "completions": 0, 00:12:37.019 "requests": 0, 00:12:37.019 "request_latency": 0, 00:12:37.019 "pending_free_request": 0, 00:12:37.019 "pending_rdma_read": 0, 00:12:37.019 "pending_rdma_write": 0, 00:12:37.019 "pending_rdma_send": 0, 00:12:37.019 "total_send_wrs": 0, 00:12:37.019 "send_doorbell_updates": 0, 00:12:37.019 "total_recv_wrs": 0, 00:12:37.019 "recv_doorbell_updates": 0 00:12:37.020 } 00:12:37.020 ] 00:12:37.020 } 00:12:37.020 ] 00:12:37.020 }, 00:12:37.020 { 00:12:37.020 "name": "nvmf_tgt_poll_group_1", 00:12:37.020 "admin_qpairs": 2, 00:12:37.020 "io_qpairs": 26, 00:12:37.020 "current_admin_qpairs": 0, 00:12:37.020 "current_io_qpairs": 0, 00:12:37.020 "pending_bdev_io": 0, 00:12:37.020 "completed_nvme_io": 136, 00:12:37.020 "transports": [ 00:12:37.020 { 00:12:37.020 "trtype": "RDMA", 00:12:37.020 "pending_data_buffer": 0, 00:12:37.020 "devices": [ 00:12:37.020 { 00:12:37.020 "name": "rocep175s0f0", 00:12:37.020 "polls": 2784507, 00:12:37.020 "idle_polls": 2784062, 00:12:37.020 "completions": 3762, 00:12:37.020 "requests": 3576, 00:12:37.020 "request_latency": 378204148, 00:12:37.020 "pending_free_request": 0, 00:12:37.020 "pending_rdma_read": 0, 00:12:37.020 "pending_rdma_write": 0, 00:12:37.020 "pending_rdma_send": 0, 00:12:37.020 "total_send_wrs": 320, 00:12:37.020 "send_doorbell_updates": 162, 00:12:37.020 "total_recv_wrs": 3576, 00:12:37.020 "recv_doorbell_updates": 188 00:12:37.020 }, 00:12:37.020 { 00:12:37.020 "name": "rocep175s0f1", 00:12:37.020 "polls": 2784507, 00:12:37.020 "idle_polls": 2784507, 00:12:37.020 "completions": 0, 00:12:37.020 "requests": 0, 00:12:37.020 "request_latency": 0, 00:12:37.020 "pending_free_request": 0, 00:12:37.020 "pending_rdma_read": 0, 00:12:37.020 "pending_rdma_write": 0, 00:12:37.020 "pending_rdma_send": 0, 00:12:37.020 "total_send_wrs": 0, 00:12:37.020 "send_doorbell_updates": 0, 00:12:37.020 "total_recv_wrs": 0, 00:12:37.020 "recv_doorbell_updates": 0 00:12:37.020 } 00:12:37.020 ] 00:12:37.020 } 00:12:37.020 ] 00:12:37.020 }, 00:12:37.020 { 00:12:37.020 "name": "nvmf_tgt_poll_group_2", 00:12:37.020 "admin_qpairs": 1, 00:12:37.020 "io_qpairs": 26, 00:12:37.020 "current_admin_qpairs": 0, 00:12:37.020 "current_io_qpairs": 0, 00:12:37.020 "pending_bdev_io": 0, 00:12:37.020 "completed_nvme_io": 75, 00:12:37.020 "transports": [ 00:12:37.020 { 00:12:37.020 "trtype": "RDMA", 00:12:37.020 "pending_data_buffer": 0, 00:12:37.020 "devices": [ 00:12:37.020 { 00:12:37.020 "name": "rocep175s0f0", 00:12:37.020 "polls": 2833733, 00:12:37.020 "idle_polls": 2833440, 00:12:37.020 "completions": 3594, 00:12:37.020 "requests": 3492, 00:12:37.020 "request_latency": 363151380, 00:12:37.020 "pending_free_request": 0, 00:12:37.020 "pending_rdma_read": 0, 00:12:37.020 "pending_rdma_write": 0, 00:12:37.020 "pending_rdma_send": 0, 00:12:37.020 "total_send_wrs": 163, 00:12:37.020 "send_doorbell_updates": 89, 00:12:37.020 "total_recv_wrs": 3492, 00:12:37.020 "recv_doorbell_updates": 115 00:12:37.020 }, 00:12:37.020 { 00:12:37.020 "name": "rocep175s0f1", 00:12:37.020 "polls": 2833733, 00:12:37.020 "idle_polls": 2833733, 00:12:37.020 "completions": 0, 00:12:37.020 "requests": 0, 00:12:37.020 "request_latency": 0, 00:12:37.020 "pending_free_request": 0, 00:12:37.020 "pending_rdma_read": 0, 00:12:37.020 "pending_rdma_write": 0, 00:12:37.020 "pending_rdma_send": 0, 00:12:37.020 "total_send_wrs": 0, 00:12:37.020 "send_doorbell_updates": 0, 00:12:37.020 "total_recv_wrs": 0, 00:12:37.020 "recv_doorbell_updates": 0 00:12:37.020 } 00:12:37.020 ] 00:12:37.020 } 00:12:37.020 ] 00:12:37.020 }, 00:12:37.020 { 00:12:37.020 "name": "nvmf_tgt_poll_group_3", 00:12:37.020 "admin_qpairs": 2, 00:12:37.020 "io_qpairs": 26, 00:12:37.020 "current_admin_qpairs": 0, 00:12:37.020 "current_io_qpairs": 0, 00:12:37.020 "pending_bdev_io": 0, 00:12:37.020 "completed_nvme_io": 78, 00:12:37.020 "transports": [ 00:12:37.020 { 00:12:37.020 "trtype": "RDMA", 00:12:37.020 "pending_data_buffer": 0, 00:12:37.020 "devices": [ 00:12:37.020 { 00:12:37.020 "name": "rocep175s0f0", 00:12:37.020 "polls": 2226782, 00:12:37.020 "idle_polls": 2226438, 00:12:37.020 "completions": 3646, 00:12:37.020 "requests": 3518, 00:12:37.020 "request_latency": 364617216, 00:12:37.020 "pending_free_request": 0, 00:12:37.020 "pending_rdma_read": 0, 00:12:37.020 "pending_rdma_write": 0, 00:12:37.020 "pending_rdma_send": 0, 00:12:37.020 "total_send_wrs": 204, 00:12:37.020 "send_doorbell_updates": 115, 00:12:37.020 "total_recv_wrs": 3518, 00:12:37.020 "recv_doorbell_updates": 141 00:12:37.020 }, 00:12:37.020 { 00:12:37.020 "name": "rocep175s0f1", 00:12:37.020 "polls": 2226782, 00:12:37.020 "idle_polls": 2226782, 00:12:37.020 "completions": 0, 00:12:37.020 "requests": 0, 00:12:37.020 "request_latency": 0, 00:12:37.020 "pending_free_request": 0, 00:12:37.020 "pending_rdma_read": 0, 00:12:37.020 "pending_rdma_write": 0, 00:12:37.020 "pending_rdma_send": 0, 00:12:37.020 "total_send_wrs": 0, 00:12:37.020 "send_doorbell_updates": 0, 00:12:37.020 "total_recv_wrs": 0, 00:12:37.020 "recv_doorbell_updates": 0 00:12:37.020 } 00:12:37.020 ] 00:12:37.020 } 00:12:37.020 ] 00:12:37.020 } 00:12:37.020 ] 00:12:37.020 }' 00:12:37.020 03:13:11 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:12:37.020 03:13:11 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:37.020 03:13:11 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:37.020 03:13:11 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:37.020 03:13:11 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:12:37.020 03:13:11 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:12:37.020 03:13:11 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:37.020 03:13:11 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:37.020 03:13:11 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:37.020 03:13:11 -- target/rpc.sh@113 -- # (( 105 > 0 )) 00:12:37.020 03:13:11 -- target/rpc.sh@115 -- # '[' rdma == rdma ']' 00:12:37.020 03:13:11 -- target/rpc.sh@117 -- # jsum '.poll_groups[].transports[].devices[].completions' 00:12:37.020 03:13:11 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].transports[].devices[].completions' 00:12:37.020 03:13:11 -- target/rpc.sh@20 -- # jq '.poll_groups[].transports[].devices[].completions' 00:12:37.020 03:13:11 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:37.020 03:13:11 -- target/rpc.sh@117 -- # (( 14989 > 0 )) 00:12:37.020 03:13:11 -- target/rpc.sh@118 -- # jsum '.poll_groups[].transports[].devices[].request_latency' 00:12:37.020 03:13:11 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].transports[].devices[].request_latency' 00:12:37.020 03:13:11 -- target/rpc.sh@20 -- # jq '.poll_groups[].transports[].devices[].request_latency' 00:12:37.020 03:13:11 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:37.020 03:13:11 -- target/rpc.sh@118 -- # (( 1514420816 > 0 )) 00:12:37.020 03:13:11 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:12:37.020 03:13:11 -- target/rpc.sh@123 -- # nvmftestfini 00:12:37.020 03:13:11 -- nvmf/common.sh@477 -- # nvmfcleanup 00:12:37.020 03:13:11 -- nvmf/common.sh@117 -- # sync 00:12:37.020 03:13:11 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:12:37.020 03:13:11 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:12:37.020 03:13:11 -- nvmf/common.sh@120 -- # set +e 00:12:37.020 03:13:11 -- nvmf/common.sh@121 -- # for i in {1..20} 00:12:37.020 03:13:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:12:37.020 rmmod nvme_rdma 00:12:37.020 rmmod nvme_fabrics 00:12:37.020 03:13:11 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:12:37.280 03:13:11 -- nvmf/common.sh@124 -- # set -e 00:12:37.280 03:13:11 -- nvmf/common.sh@125 -- # return 0 00:12:37.280 03:13:11 -- nvmf/common.sh@478 -- # '[' -n 4000638 ']' 00:12:37.280 03:13:11 -- nvmf/common.sh@479 -- # killprocess 4000638 00:12:37.280 03:13:11 -- common/autotest_common.sh@936 -- # '[' -z 4000638 ']' 00:12:37.280 03:13:11 -- common/autotest_common.sh@940 -- # kill -0 4000638 00:12:37.280 03:13:11 -- common/autotest_common.sh@941 -- # uname 00:12:37.280 03:13:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:37.280 03:13:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4000638 00:12:37.280 03:13:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:37.280 03:13:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:37.280 03:13:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4000638' 00:12:37.280 killing process with pid 4000638 00:12:37.280 03:13:11 -- common/autotest_common.sh@955 -- # kill 4000638 00:12:37.280 03:13:11 -- common/autotest_common.sh@960 -- # wait 4000638 00:12:37.280 [2024-04-25 03:13:11.594479] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:12:37.539 03:13:11 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:12:37.539 03:13:11 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:12:37.539 00:12:37.539 real 0m30.637s 00:12:37.539 user 1m39.351s 00:12:37.539 sys 0m5.994s 00:12:37.539 03:13:11 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:12:37.539 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:37.539 ************************************ 00:12:37.539 END TEST nvmf_rpc 00:12:37.539 ************************************ 00:12:37.539 03:13:11 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=rdma 00:12:37.539 03:13:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:37.539 03:13:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:37.539 03:13:11 -- common/autotest_common.sh@10 -- # set +x 00:12:37.539 ************************************ 00:12:37.539 START TEST nvmf_invalid 00:12:37.539 ************************************ 00:12:37.540 03:13:11 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=rdma 00:12:37.540 * Looking for test storage... 00:12:37.799 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:12:37.799 03:13:12 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:12:37.799 03:13:12 -- nvmf/common.sh@7 -- # uname -s 00:12:37.799 03:13:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:37.799 03:13:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:37.799 03:13:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:37.799 03:13:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:37.799 03:13:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:37.799 03:13:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:37.799 03:13:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:37.799 03:13:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:37.799 03:13:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:37.799 03:13:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:37.799 03:13:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:12:37.799 03:13:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:12:37.799 03:13:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:37.799 03:13:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:37.799 03:13:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:37.799 03:13:12 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:37.799 03:13:12 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:12:37.799 03:13:12 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:37.799 03:13:12 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:37.799 03:13:12 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:37.799 03:13:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:37.799 03:13:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:37.799 03:13:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:37.799 03:13:12 -- paths/export.sh@5 -- # export PATH 00:12:37.799 03:13:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:37.799 03:13:12 -- nvmf/common.sh@47 -- # : 0 00:12:37.799 03:13:12 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:12:37.799 03:13:12 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:12:37.799 03:13:12 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:37.799 03:13:12 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:37.800 03:13:12 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:37.800 03:13:12 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:12:37.800 03:13:12 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:12:37.800 03:13:12 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:12:37.800 03:13:12 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:37.800 03:13:12 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:12:37.800 03:13:12 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:12:37.800 03:13:12 -- target/invalid.sh@14 -- # target=foobar 00:12:37.800 03:13:12 -- target/invalid.sh@16 -- # RANDOM=0 00:12:37.800 03:13:12 -- target/invalid.sh@34 -- # nvmftestinit 00:12:37.800 03:13:12 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:12:37.800 03:13:12 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:37.800 03:13:12 -- nvmf/common.sh@437 -- # prepare_net_devs 00:12:37.800 03:13:12 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:12:37.800 03:13:12 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:12:37.800 03:13:12 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:37.800 03:13:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:37.800 03:13:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:37.800 03:13:12 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:12:37.800 03:13:12 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:12:37.800 03:13:12 -- nvmf/common.sh@285 -- # xtrace_disable 00:12:37.800 03:13:12 -- common/autotest_common.sh@10 -- # set +x 00:12:44.421 03:13:17 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:44.421 03:13:17 -- nvmf/common.sh@291 -- # pci_devs=() 00:12:44.421 03:13:17 -- nvmf/common.sh@291 -- # local -a pci_devs 00:12:44.421 03:13:17 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:12:44.421 03:13:17 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:12:44.421 03:13:17 -- nvmf/common.sh@293 -- # pci_drivers=() 00:12:44.421 03:13:17 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:12:44.421 03:13:17 -- nvmf/common.sh@295 -- # net_devs=() 00:12:44.421 03:13:17 -- nvmf/common.sh@295 -- # local -ga net_devs 00:12:44.421 03:13:17 -- nvmf/common.sh@296 -- # e810=() 00:12:44.421 03:13:17 -- nvmf/common.sh@296 -- # local -ga e810 00:12:44.421 03:13:17 -- nvmf/common.sh@297 -- # x722=() 00:12:44.421 03:13:17 -- nvmf/common.sh@297 -- # local -ga x722 00:12:44.421 03:13:17 -- nvmf/common.sh@298 -- # mlx=() 00:12:44.421 03:13:17 -- nvmf/common.sh@298 -- # local -ga mlx 00:12:44.421 03:13:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:44.421 03:13:17 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:44.421 03:13:17 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:44.421 03:13:17 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:44.421 03:13:17 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:44.421 03:13:17 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:44.421 03:13:17 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:44.421 03:13:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:44.421 03:13:17 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:44.421 03:13:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:44.421 03:13:17 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:44.421 03:13:17 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:12:44.421 03:13:17 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:12:44.421 03:13:17 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:12:44.421 03:13:17 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:12:44.421 03:13:17 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:12:44.421 03:13:17 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:12:44.421 03:13:17 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:12:44.421 03:13:17 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:12:44.421 03:13:17 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:44.421 03:13:17 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:12:44.421 Found 0000:af:00.0 (0x8086 - 0x159b) 00:12:44.421 03:13:17 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:12:44.421 03:13:17 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:12:44.421 03:13:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:44.421 03:13:17 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:44.421 03:13:17 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:44.421 03:13:17 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:44.421 03:13:17 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:44.421 03:13:17 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:12:44.421 Found 0000:af:00.1 (0x8086 - 0x159b) 00:12:44.422 03:13:17 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:12:44.422 03:13:17 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:12:44.422 03:13:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:44.422 03:13:17 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:44.422 03:13:17 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:44.422 03:13:17 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:44.422 03:13:17 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:12:44.422 03:13:17 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:12:44.422 03:13:17 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:12:44.422 03:13:17 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:12:44.422 03:13:17 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:12:44.422 03:13:17 -- nvmf/common.sh@377 -- # modinfo irdma 00:12:44.422 03:13:17 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:12:44.422 03:13:17 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:44.422 03:13:17 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:44.422 03:13:17 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:44.422 03:13:17 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:44.422 03:13:17 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:12:44.422 Found net devices under 0000:af:00.0: cvl_0_0 00:12:44.422 03:13:17 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:44.422 03:13:17 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:44.422 03:13:17 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:44.422 03:13:17 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:44.422 03:13:17 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:44.422 03:13:17 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:12:44.422 Found net devices under 0000:af:00.1: cvl_0_1 00:12:44.422 03:13:17 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:44.422 03:13:17 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:12:44.422 03:13:17 -- nvmf/common.sh@403 -- # is_hw=yes 00:12:44.422 03:13:17 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:12:44.422 03:13:17 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:12:44.422 03:13:17 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:12:44.422 03:13:17 -- nvmf/common.sh@409 -- # rdma_device_init 00:12:44.422 03:13:17 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:12:44.422 03:13:17 -- nvmf/common.sh@58 -- # uname 00:12:44.422 03:13:17 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:12:44.422 03:13:17 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:12:44.422 03:13:17 -- nvmf/common.sh@63 -- # modprobe ib_core 00:12:44.422 03:13:17 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:12:44.422 03:13:17 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:12:44.422 03:13:17 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:12:44.422 03:13:17 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:12:44.422 03:13:17 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:12:44.422 03:13:17 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:12:44.422 03:13:17 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:12:44.422 03:13:17 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:12:44.422 03:13:17 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:44.422 03:13:17 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:44.422 03:13:17 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:44.422 03:13:17 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:44.422 03:13:17 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:44.422 03:13:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:44.422 03:13:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:44.422 03:13:17 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:12:44.422 03:13:17 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:12:44.422 03:13:17 -- nvmf/common.sh@105 -- # continue 2 00:12:44.422 03:13:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:44.422 03:13:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:44.422 03:13:17 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:12:44.422 03:13:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:44.422 03:13:17 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:12:44.422 03:13:17 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:12:44.422 03:13:17 -- nvmf/common.sh@105 -- # continue 2 00:12:44.422 03:13:17 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:44.422 03:13:17 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:12:44.422 03:13:17 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:12:44.422 03:13:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:12:44.422 03:13:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:44.422 03:13:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:44.422 03:13:17 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:12:44.422 03:13:17 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:12:44.422 03:13:17 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:12:44.422 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:12:44.422 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:12:44.422 altname enp175s0f0np0 00:12:44.422 altname ens801f0np0 00:12:44.422 inet 192.168.100.8/24 scope global cvl_0_0 00:12:44.422 valid_lft forever preferred_lft forever 00:12:44.422 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:12:44.422 valid_lft forever preferred_lft forever 00:12:44.422 03:13:17 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:44.422 03:13:17 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:12:44.422 03:13:17 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:12:44.422 03:13:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:12:44.422 03:13:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:44.422 03:13:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:44.422 03:13:17 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:12:44.422 03:13:17 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:12:44.422 03:13:17 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:12:44.422 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:12:44.422 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:12:44.422 altname enp175s0f1np1 00:12:44.422 altname ens801f1np1 00:12:44.422 inet 192.168.100.9/24 scope global cvl_0_1 00:12:44.422 valid_lft forever preferred_lft forever 00:12:44.422 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:12:44.422 valid_lft forever preferred_lft forever 00:12:44.422 03:13:17 -- nvmf/common.sh@411 -- # return 0 00:12:44.422 03:13:17 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:12:44.422 03:13:17 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:12:44.422 03:13:17 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:12:44.422 03:13:17 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:12:44.422 03:13:17 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:12:44.422 03:13:17 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:44.422 03:13:17 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:44.422 03:13:17 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:44.422 03:13:17 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:44.422 03:13:17 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:44.422 03:13:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:44.422 03:13:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:44.422 03:13:17 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:12:44.422 03:13:17 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:12:44.422 03:13:17 -- nvmf/common.sh@105 -- # continue 2 00:12:44.422 03:13:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:44.422 03:13:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:44.422 03:13:17 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:12:44.422 03:13:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:44.422 03:13:17 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:12:44.422 03:13:17 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:12:44.422 03:13:17 -- nvmf/common.sh@105 -- # continue 2 00:12:44.422 03:13:17 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:44.422 03:13:17 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:12:44.422 03:13:17 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:12:44.422 03:13:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:12:44.422 03:13:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:44.422 03:13:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:44.422 03:13:17 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:44.422 03:13:17 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:12:44.422 03:13:17 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:12:44.422 03:13:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:12:44.422 03:13:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:44.422 03:13:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:44.422 03:13:17 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:12:44.422 192.168.100.9' 00:12:44.422 03:13:17 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:12:44.422 192.168.100.9' 00:12:44.422 03:13:17 -- nvmf/common.sh@446 -- # head -n 1 00:12:44.422 03:13:17 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:12:44.422 03:13:17 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:12:44.422 192.168.100.9' 00:12:44.422 03:13:17 -- nvmf/common.sh@447 -- # tail -n +2 00:12:44.422 03:13:17 -- nvmf/common.sh@447 -- # head -n 1 00:12:44.422 03:13:17 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:12:44.422 03:13:17 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:12:44.422 03:13:17 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:12:44.422 03:13:17 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:12:44.422 03:13:17 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:12:44.422 03:13:17 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:12:44.422 03:13:17 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:12:44.422 03:13:17 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:44.422 03:13:17 -- common/autotest_common.sh@710 -- # xtrace_disable 00:12:44.422 03:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:44.422 03:13:17 -- nvmf/common.sh@470 -- # nvmfpid=4008309 00:12:44.422 03:13:17 -- nvmf/common.sh@471 -- # waitforlisten 4008309 00:12:44.422 03:13:17 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:44.422 03:13:17 -- common/autotest_common.sh@817 -- # '[' -z 4008309 ']' 00:12:44.422 03:13:17 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:44.422 03:13:17 -- common/autotest_common.sh@822 -- # local max_retries=100 00:12:44.422 03:13:17 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:44.422 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:44.422 03:13:17 -- common/autotest_common.sh@826 -- # xtrace_disable 00:12:44.422 03:13:17 -- common/autotest_common.sh@10 -- # set +x 00:12:44.423 [2024-04-25 03:13:18.017382] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:12:44.423 [2024-04-25 03:13:18.017425] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:44.423 EAL: No free 2048 kB hugepages reported on node 1 00:12:44.423 [2024-04-25 03:13:18.076523] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:44.423 [2024-04-25 03:13:18.152976] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:44.423 [2024-04-25 03:13:18.153011] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:44.423 [2024-04-25 03:13:18.153018] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:44.423 [2024-04-25 03:13:18.153023] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:44.423 [2024-04-25 03:13:18.153028] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:44.423 [2024-04-25 03:13:18.153073] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:44.423 [2024-04-25 03:13:18.153169] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:44.423 [2024-04-25 03:13:18.153257] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:44.423 [2024-04-25 03:13:18.153258] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:44.423 03:13:18 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:12:44.423 03:13:18 -- common/autotest_common.sh@850 -- # return 0 00:12:44.423 03:13:18 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:44.423 03:13:18 -- common/autotest_common.sh@716 -- # xtrace_disable 00:12:44.423 03:13:18 -- common/autotest_common.sh@10 -- # set +x 00:12:44.423 03:13:18 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:44.423 03:13:18 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:44.423 03:13:18 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode10226 00:12:44.682 [2024-04-25 03:13:19.007992] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:12:44.682 03:13:19 -- target/invalid.sh@40 -- # out='request: 00:12:44.682 { 00:12:44.682 "nqn": "nqn.2016-06.io.spdk:cnode10226", 00:12:44.682 "tgt_name": "foobar", 00:12:44.682 "method": "nvmf_create_subsystem", 00:12:44.682 "req_id": 1 00:12:44.682 } 00:12:44.682 Got JSON-RPC error response 00:12:44.682 response: 00:12:44.682 { 00:12:44.682 "code": -32603, 00:12:44.682 "message": "Unable to find target foobar" 00:12:44.682 }' 00:12:44.682 03:13:19 -- target/invalid.sh@41 -- # [[ request: 00:12:44.682 { 00:12:44.682 "nqn": "nqn.2016-06.io.spdk:cnode10226", 00:12:44.682 "tgt_name": "foobar", 00:12:44.682 "method": "nvmf_create_subsystem", 00:12:44.682 "req_id": 1 00:12:44.682 } 00:12:44.682 Got JSON-RPC error response 00:12:44.682 response: 00:12:44.682 { 00:12:44.682 "code": -32603, 00:12:44.682 "message": "Unable to find target foobar" 00:12:44.682 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:12:44.682 03:13:19 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:12:44.682 03:13:19 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode26143 00:12:44.940 [2024-04-25 03:13:19.196658] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode26143: invalid serial number 'SPDKISFASTANDAWESOME' 00:12:44.940 03:13:19 -- target/invalid.sh@45 -- # out='request: 00:12:44.940 { 00:12:44.940 "nqn": "nqn.2016-06.io.spdk:cnode26143", 00:12:44.940 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:44.940 "method": "nvmf_create_subsystem", 00:12:44.940 "req_id": 1 00:12:44.940 } 00:12:44.940 Got JSON-RPC error response 00:12:44.940 response: 00:12:44.940 { 00:12:44.940 "code": -32602, 00:12:44.940 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:44.941 }' 00:12:44.941 03:13:19 -- target/invalid.sh@46 -- # [[ request: 00:12:44.941 { 00:12:44.941 "nqn": "nqn.2016-06.io.spdk:cnode26143", 00:12:44.941 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:44.941 "method": "nvmf_create_subsystem", 00:12:44.941 "req_id": 1 00:12:44.941 } 00:12:44.941 Got JSON-RPC error response 00:12:44.941 response: 00:12:44.941 { 00:12:44.941 "code": -32602, 00:12:44.941 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:44.941 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:44.941 03:13:19 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:12:44.941 03:13:19 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode32739 00:12:44.941 [2024-04-25 03:13:19.393259] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode32739: invalid model number 'SPDK_Controller' 00:12:44.941 03:13:19 -- target/invalid.sh@50 -- # out='request: 00:12:44.941 { 00:12:44.941 "nqn": "nqn.2016-06.io.spdk:cnode32739", 00:12:44.941 "model_number": "SPDK_Controller\u001f", 00:12:44.941 "method": "nvmf_create_subsystem", 00:12:44.941 "req_id": 1 00:12:44.941 } 00:12:44.941 Got JSON-RPC error response 00:12:44.941 response: 00:12:44.941 { 00:12:44.941 "code": -32602, 00:12:44.941 "message": "Invalid MN SPDK_Controller\u001f" 00:12:44.941 }' 00:12:44.941 03:13:19 -- target/invalid.sh@51 -- # [[ request: 00:12:44.941 { 00:12:44.941 "nqn": "nqn.2016-06.io.spdk:cnode32739", 00:12:44.941 "model_number": "SPDK_Controller\u001f", 00:12:44.941 "method": "nvmf_create_subsystem", 00:12:44.941 "req_id": 1 00:12:44.941 } 00:12:44.941 Got JSON-RPC error response 00:12:44.941 response: 00:12:44.941 { 00:12:44.941 "code": -32602, 00:12:44.941 "message": "Invalid MN SPDK_Controller\u001f" 00:12:44.941 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:44.941 03:13:19 -- target/invalid.sh@54 -- # gen_random_s 21 00:12:44.941 03:13:19 -- target/invalid.sh@19 -- # local length=21 ll 00:12:44.941 03:13:19 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:44.941 03:13:19 -- target/invalid.sh@21 -- # local chars 00:12:44.941 03:13:19 -- target/invalid.sh@22 -- # local string 00:12:44.941 03:13:19 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:44.941 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:44.941 03:13:19 -- target/invalid.sh@25 -- # printf %x 40 00:12:44.941 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x28' 00:12:44.941 03:13:19 -- target/invalid.sh@25 -- # string+='(' 00:12:44.941 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:44.941 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:44.941 03:13:19 -- target/invalid.sh@25 -- # printf %x 73 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x49' 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # string+=I 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # printf %x 98 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x62' 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # string+=b 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # printf %x 114 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x72' 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # string+=r 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # printf %x 87 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x57' 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # string+=W 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # printf %x 43 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # string+=+ 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # printf %x 110 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # string+=n 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # printf %x 39 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x27' 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # string+=\' 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # printf %x 94 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x5e' 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # string+='^' 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # printf %x 105 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x69' 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # string+=i 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # printf %x 58 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # string+=: 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # printf %x 63 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # string+='?' 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # printf %x 84 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x54' 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # string+=T 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # printf %x 125 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # string+='}' 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # printf %x 54 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x36' 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # string+=6 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # printf %x 113 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x71' 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # string+=q 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # printf %x 75 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # string+=K 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # printf %x 110 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # string+=n 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # printf %x 48 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x30' 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # string+=0 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # printf %x 57 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x39' 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # string+=9 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # printf %x 106 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:12:45.200 03:13:19 -- target/invalid.sh@25 -- # string+=j 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.200 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.201 03:13:19 -- target/invalid.sh@28 -- # [[ ( == \- ]] 00:12:45.201 03:13:19 -- target/invalid.sh@31 -- # echo '(IbrW+n'\''^i:?T}6qKn09j' 00:12:45.201 03:13:19 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s '(IbrW+n'\''^i:?T}6qKn09j' nqn.2016-06.io.spdk:cnode28640 00:12:45.460 [2024-04-25 03:13:19.706308] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode28640: invalid serial number '(IbrW+n'^i:?T}6qKn09j' 00:12:45.460 03:13:19 -- target/invalid.sh@54 -- # out='request: 00:12:45.460 { 00:12:45.460 "nqn": "nqn.2016-06.io.spdk:cnode28640", 00:12:45.460 "serial_number": "(IbrW+n'\''^i:?T}6qKn09j", 00:12:45.460 "method": "nvmf_create_subsystem", 00:12:45.460 "req_id": 1 00:12:45.460 } 00:12:45.460 Got JSON-RPC error response 00:12:45.460 response: 00:12:45.460 { 00:12:45.460 "code": -32602, 00:12:45.460 "message": "Invalid SN (IbrW+n'\''^i:?T}6qKn09j" 00:12:45.460 }' 00:12:45.460 03:13:19 -- target/invalid.sh@55 -- # [[ request: 00:12:45.460 { 00:12:45.460 "nqn": "nqn.2016-06.io.spdk:cnode28640", 00:12:45.460 "serial_number": "(IbrW+n'^i:?T}6qKn09j", 00:12:45.460 "method": "nvmf_create_subsystem", 00:12:45.460 "req_id": 1 00:12:45.460 } 00:12:45.460 Got JSON-RPC error response 00:12:45.460 response: 00:12:45.460 { 00:12:45.460 "code": -32602, 00:12:45.460 "message": "Invalid SN (IbrW+n'^i:?T}6qKn09j" 00:12:45.460 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:45.460 03:13:19 -- target/invalid.sh@58 -- # gen_random_s 41 00:12:45.460 03:13:19 -- target/invalid.sh@19 -- # local length=41 ll 00:12:45.461 03:13:19 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:45.461 03:13:19 -- target/invalid.sh@21 -- # local chars 00:12:45.461 03:13:19 -- target/invalid.sh@22 -- # local string 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 82 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x52' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+=R 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 73 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x49' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+=I 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 118 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x76' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+=v 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 110 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+=n 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 65 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x41' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+=A 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 60 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+='<' 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 127 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+=$'\177' 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 47 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+=/ 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 53 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x35' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+=5 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 97 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x61' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+=a 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 46 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+=. 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 61 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+== 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 95 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+=_ 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 108 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+=l 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 118 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x76' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+=v 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 100 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x64' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+=d 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 110 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+=n 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 59 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+=';' 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 104 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x68' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+=h 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 114 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x72' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+=r 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 124 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+='|' 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 70 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x46' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+=F 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 49 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x31' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+=1 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 47 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+=/ 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 89 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x59' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+=Y 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 61 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+== 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 42 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+='*' 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 70 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x46' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+=F 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 54 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x36' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+=6 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 120 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x78' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+=x 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 47 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+=/ 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 95 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+=_ 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # printf %x 54 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x36' 00:12:45.461 03:13:19 -- target/invalid.sh@25 -- # string+=6 00:12:45.461 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.462 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.462 03:13:19 -- target/invalid.sh@25 -- # printf %x 63 00:12:45.462 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:12:45.462 03:13:19 -- target/invalid.sh@25 -- # string+='?' 00:12:45.462 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.462 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.462 03:13:19 -- target/invalid.sh@25 -- # printf %x 86 00:12:45.462 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x56' 00:12:45.462 03:13:19 -- target/invalid.sh@25 -- # string+=V 00:12:45.462 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.462 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.721 03:13:19 -- target/invalid.sh@25 -- # printf %x 48 00:12:45.721 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x30' 00:12:45.721 03:13:19 -- target/invalid.sh@25 -- # string+=0 00:12:45.721 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.721 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.721 03:13:19 -- target/invalid.sh@25 -- # printf %x 55 00:12:45.721 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x37' 00:12:45.721 03:13:19 -- target/invalid.sh@25 -- # string+=7 00:12:45.721 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.721 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.721 03:13:19 -- target/invalid.sh@25 -- # printf %x 37 00:12:45.721 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x25' 00:12:45.721 03:13:19 -- target/invalid.sh@25 -- # string+=% 00:12:45.721 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.721 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.721 03:13:19 -- target/invalid.sh@25 -- # printf %x 123 00:12:45.721 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:12:45.721 03:13:19 -- target/invalid.sh@25 -- # string+='{' 00:12:45.721 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.721 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.721 03:13:19 -- target/invalid.sh@25 -- # printf %x 108 00:12:45.721 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:12:45.721 03:13:19 -- target/invalid.sh@25 -- # string+=l 00:12:45.721 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.721 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.721 03:13:19 -- target/invalid.sh@25 -- # printf %x 94 00:12:45.721 03:13:19 -- target/invalid.sh@25 -- # echo -e '\x5e' 00:12:45.721 03:13:19 -- target/invalid.sh@25 -- # string+='^' 00:12:45.721 03:13:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:45.721 03:13:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:45.721 03:13:19 -- target/invalid.sh@28 -- # [[ R == \- ]] 00:12:45.721 03:13:19 -- target/invalid.sh@31 -- # echo 'RIvnA</5a.=_lvdn;hr|F1/Y=*F6x/_6?V07%{l^' 00:12:45.721 03:13:19 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d 'RIvnA</5a.=_lvdn;hr|F1/Y=*F6x/_6?V07%{l^' nqn.2016-06.io.spdk:cnode30233 00:12:45.721 [2024-04-25 03:13:20.143914] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode30233: invalid model number 'RIvnA</5a.=_lvdn;hr|F1/Y=*F6x/_6?V07%{l^' 00:12:45.721 03:13:20 -- target/invalid.sh@58 -- # out='request: 00:12:45.721 { 00:12:45.721 "nqn": "nqn.2016-06.io.spdk:cnode30233", 00:12:45.722 "model_number": "RIvnA<\u007f/5a.=_lvdn;hr|F1/Y=*F6x/_6?V07%{l^", 00:12:45.722 "method": "nvmf_create_subsystem", 00:12:45.722 "req_id": 1 00:12:45.722 } 00:12:45.722 Got JSON-RPC error response 00:12:45.722 response: 00:12:45.722 { 00:12:45.722 "code": -32602, 00:12:45.722 "message": "Invalid MN RIvnA<\u007f/5a.=_lvdn;hr|F1/Y=*F6x/_6?V07%{l^" 00:12:45.722 }' 00:12:45.722 03:13:20 -- target/invalid.sh@59 -- # [[ request: 00:12:45.722 { 00:12:45.722 "nqn": "nqn.2016-06.io.spdk:cnode30233", 00:12:45.722 "model_number": "RIvnA<\u007f/5a.=_lvdn;hr|F1/Y=*F6x/_6?V07%{l^", 00:12:45.722 "method": "nvmf_create_subsystem", 00:12:45.722 "req_id": 1 00:12:45.722 } 00:12:45.722 Got JSON-RPC error response 00:12:45.722 response: 00:12:45.722 { 00:12:45.722 "code": -32602, 00:12:45.722 "message": "Invalid MN RIvnA<\u007f/5a.=_lvdn;hr|F1/Y=*F6x/_6?V07%{l^" 00:12:45.722 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:45.722 03:13:20 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype rdma 00:12:45.981 [2024-04-25 03:13:20.339220] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x1d72560/0x1d71ba0) succeed. 00:12:45.981 [2024-04-25 03:13:20.349261] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x1d73910/0x1d72120) succeed. 00:12:45.981 [2024-04-25 03:13:20.349282] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:12:45.981 [2024-04-25 03:13:20.351913] iobuf.c: 323:spdk_iobuf_channel_init: *ERROR*: Failed to populate 'nvmf_RDMA' iobuf large buffer cache at 257/767 entries. You may need to increase spdk_iobuf_opts.large_pool_count (1024) 00:12:45.981 [2024-04-25 03:13:20.351936] iobuf.c: 326:spdk_iobuf_channel_init: *ERROR*: See scripts/calc-iobuf.py for guidance on how to calculate this value. 00:12:45.981 [2024-04-25 03:13:20.352410] transport.c: 629:nvmf_transport_poll_group_create: *ERROR*: Unable to reserve the full number of buffers for the pg buffer cache. 00:12:45.981 [2024-04-25 03:13:20.353539] iobuf.c: 323:spdk_iobuf_channel_init: *ERROR*: Failed to populate 'nvmf_RDMA' iobuf large buffer cache at 257/767 entries. You may need to increase spdk_iobuf_opts.large_pool_count (1024) 00:12:45.981 [2024-04-25 03:13:20.353560] iobuf.c: 326:spdk_iobuf_channel_init: *ERROR*: See scripts/calc-iobuf.py for guidance on how to calculate this value. 00:12:45.981 [2024-04-25 03:13:20.354049] transport.c: 629:nvmf_transport_poll_group_create: *ERROR*: Unable to reserve the full number of buffers for the pg buffer cache. 00:12:45.981 [2024-04-25 03:13:20.355139] iobuf.c: 323:spdk_iobuf_channel_init: *ERROR*: Failed to populate 'nvmf_RDMA' iobuf large buffer cache at 257/767 entries. You may need to increase spdk_iobuf_opts.large_pool_count (1024) 00:12:45.981 [2024-04-25 03:13:20.355153] iobuf.c: 326:spdk_iobuf_channel_init: *ERROR*: See scripts/calc-iobuf.py for guidance on how to calculate this value. 00:12:45.981 [2024-04-25 03:13:20.355629] transport.c: 629:nvmf_transport_poll_group_create: *ERROR*: Unable to reserve the full number of buffers for the pg buffer cache. 00:12:45.981 03:13:20 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:12:46.240 03:13:20 -- target/invalid.sh@64 -- # [[ rdma == \T\C\P ]] 00:12:46.240 03:13:20 -- target/invalid.sh@67 -- # echo '192.168.100.8 00:12:46.240 192.168.100.9' 00:12:46.240 03:13:20 -- target/invalid.sh@67 -- # head -n 1 00:12:46.240 03:13:20 -- target/invalid.sh@67 -- # IP=192.168.100.8 00:12:46.240 03:13:20 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t rdma -a 192.168.100.8 -s 4421 00:12:46.240 [2024-04-25 03:13:20.738809] nvmf_rpc.c: 792:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:12:46.499 03:13:20 -- target/invalid.sh@69 -- # out='request: 00:12:46.499 { 00:12:46.499 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:46.499 "listen_address": { 00:12:46.499 "trtype": "rdma", 00:12:46.499 "traddr": "192.168.100.8", 00:12:46.499 "trsvcid": "4421" 00:12:46.499 }, 00:12:46.499 "method": "nvmf_subsystem_remove_listener", 00:12:46.499 "req_id": 1 00:12:46.499 } 00:12:46.499 Got JSON-RPC error response 00:12:46.499 response: 00:12:46.499 { 00:12:46.499 "code": -32602, 00:12:46.499 "message": "Invalid parameters" 00:12:46.499 }' 00:12:46.499 03:13:20 -- target/invalid.sh@70 -- # [[ request: 00:12:46.499 { 00:12:46.499 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:46.499 "listen_address": { 00:12:46.499 "trtype": "rdma", 00:12:46.499 "traddr": "192.168.100.8", 00:12:46.499 "trsvcid": "4421" 00:12:46.499 }, 00:12:46.499 "method": "nvmf_subsystem_remove_listener", 00:12:46.499 "req_id": 1 00:12:46.499 } 00:12:46.499 Got JSON-RPC error response 00:12:46.499 response: 00:12:46.499 { 00:12:46.499 "code": -32602, 00:12:46.499 "message": "Invalid parameters" 00:12:46.499 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:12:46.499 03:13:20 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode65 -i 0 00:12:46.499 [2024-04-25 03:13:20.927476] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode65: invalid cntlid range [0-65519] 00:12:46.499 03:13:20 -- target/invalid.sh@73 -- # out='request: 00:12:46.499 { 00:12:46.499 "nqn": "nqn.2016-06.io.spdk:cnode65", 00:12:46.499 "min_cntlid": 0, 00:12:46.499 "method": "nvmf_create_subsystem", 00:12:46.499 "req_id": 1 00:12:46.499 } 00:12:46.499 Got JSON-RPC error response 00:12:46.499 response: 00:12:46.499 { 00:12:46.499 "code": -32602, 00:12:46.499 "message": "Invalid cntlid range [0-65519]" 00:12:46.499 }' 00:12:46.499 03:13:20 -- target/invalid.sh@74 -- # [[ request: 00:12:46.499 { 00:12:46.499 "nqn": "nqn.2016-06.io.spdk:cnode65", 00:12:46.499 "min_cntlid": 0, 00:12:46.499 "method": "nvmf_create_subsystem", 00:12:46.499 "req_id": 1 00:12:46.499 } 00:12:46.499 Got JSON-RPC error response 00:12:46.499 response: 00:12:46.499 { 00:12:46.499 "code": -32602, 00:12:46.499 "message": "Invalid cntlid range [0-65519]" 00:12:46.499 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:46.499 03:13:20 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5299 -i 65520 00:12:46.758 [2024-04-25 03:13:21.108138] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode5299: invalid cntlid range [65520-65519] 00:12:46.758 03:13:21 -- target/invalid.sh@75 -- # out='request: 00:12:46.758 { 00:12:46.758 "nqn": "nqn.2016-06.io.spdk:cnode5299", 00:12:46.758 "min_cntlid": 65520, 00:12:46.758 "method": "nvmf_create_subsystem", 00:12:46.758 "req_id": 1 00:12:46.758 } 00:12:46.758 Got JSON-RPC error response 00:12:46.758 response: 00:12:46.758 { 00:12:46.758 "code": -32602, 00:12:46.758 "message": "Invalid cntlid range [65520-65519]" 00:12:46.758 }' 00:12:46.758 03:13:21 -- target/invalid.sh@76 -- # [[ request: 00:12:46.758 { 00:12:46.758 "nqn": "nqn.2016-06.io.spdk:cnode5299", 00:12:46.758 "min_cntlid": 65520, 00:12:46.758 "method": "nvmf_create_subsystem", 00:12:46.758 "req_id": 1 00:12:46.758 } 00:12:46.758 Got JSON-RPC error response 00:12:46.758 response: 00:12:46.758 { 00:12:46.758 "code": -32602, 00:12:46.758 "message": "Invalid cntlid range [65520-65519]" 00:12:46.758 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:46.758 03:13:21 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode30532 -I 0 00:12:47.017 [2024-04-25 03:13:21.288819] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode30532: invalid cntlid range [1-0] 00:12:47.017 03:13:21 -- target/invalid.sh@77 -- # out='request: 00:12:47.017 { 00:12:47.017 "nqn": "nqn.2016-06.io.spdk:cnode30532", 00:12:47.017 "max_cntlid": 0, 00:12:47.017 "method": "nvmf_create_subsystem", 00:12:47.017 "req_id": 1 00:12:47.017 } 00:12:47.017 Got JSON-RPC error response 00:12:47.017 response: 00:12:47.017 { 00:12:47.017 "code": -32602, 00:12:47.017 "message": "Invalid cntlid range [1-0]" 00:12:47.017 }' 00:12:47.017 03:13:21 -- target/invalid.sh@78 -- # [[ request: 00:12:47.017 { 00:12:47.017 "nqn": "nqn.2016-06.io.spdk:cnode30532", 00:12:47.017 "max_cntlid": 0, 00:12:47.017 "method": "nvmf_create_subsystem", 00:12:47.017 "req_id": 1 00:12:47.017 } 00:12:47.017 Got JSON-RPC error response 00:12:47.017 response: 00:12:47.017 { 00:12:47.017 "code": -32602, 00:12:47.017 "message": "Invalid cntlid range [1-0]" 00:12:47.017 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:47.017 03:13:21 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode14740 -I 65520 00:12:47.017 [2024-04-25 03:13:21.465451] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode14740: invalid cntlid range [1-65520] 00:12:47.017 03:13:21 -- target/invalid.sh@79 -- # out='request: 00:12:47.017 { 00:12:47.017 "nqn": "nqn.2016-06.io.spdk:cnode14740", 00:12:47.017 "max_cntlid": 65520, 00:12:47.017 "method": "nvmf_create_subsystem", 00:12:47.017 "req_id": 1 00:12:47.017 } 00:12:47.017 Got JSON-RPC error response 00:12:47.017 response: 00:12:47.017 { 00:12:47.017 "code": -32602, 00:12:47.017 "message": "Invalid cntlid range [1-65520]" 00:12:47.017 }' 00:12:47.017 03:13:21 -- target/invalid.sh@80 -- # [[ request: 00:12:47.017 { 00:12:47.017 "nqn": "nqn.2016-06.io.spdk:cnode14740", 00:12:47.017 "max_cntlid": 65520, 00:12:47.017 "method": "nvmf_create_subsystem", 00:12:47.017 "req_id": 1 00:12:47.017 } 00:12:47.017 Got JSON-RPC error response 00:12:47.017 response: 00:12:47.017 { 00:12:47.017 "code": -32602, 00:12:47.017 "message": "Invalid cntlid range [1-65520]" 00:12:47.018 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:47.018 03:13:21 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode23216 -i 6 -I 5 00:12:47.277 [2024-04-25 03:13:21.646128] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode23216: invalid cntlid range [6-5] 00:12:47.277 03:13:21 -- target/invalid.sh@83 -- # out='request: 00:12:47.277 { 00:12:47.277 "nqn": "nqn.2016-06.io.spdk:cnode23216", 00:12:47.277 "min_cntlid": 6, 00:12:47.277 "max_cntlid": 5, 00:12:47.277 "method": "nvmf_create_subsystem", 00:12:47.277 "req_id": 1 00:12:47.277 } 00:12:47.277 Got JSON-RPC error response 00:12:47.277 response: 00:12:47.277 { 00:12:47.277 "code": -32602, 00:12:47.277 "message": "Invalid cntlid range [6-5]" 00:12:47.277 }' 00:12:47.277 03:13:21 -- target/invalid.sh@84 -- # [[ request: 00:12:47.277 { 00:12:47.277 "nqn": "nqn.2016-06.io.spdk:cnode23216", 00:12:47.277 "min_cntlid": 6, 00:12:47.277 "max_cntlid": 5, 00:12:47.277 "method": "nvmf_create_subsystem", 00:12:47.277 "req_id": 1 00:12:47.277 } 00:12:47.277 Got JSON-RPC error response 00:12:47.277 response: 00:12:47.277 { 00:12:47.277 "code": -32602, 00:12:47.277 "message": "Invalid cntlid range [6-5]" 00:12:47.277 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:47.277 03:13:21 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:12:47.277 03:13:21 -- target/invalid.sh@87 -- # out='request: 00:12:47.277 { 00:12:47.277 "name": "foobar", 00:12:47.277 "method": "nvmf_delete_target", 00:12:47.277 "req_id": 1 00:12:47.277 } 00:12:47.277 Got JSON-RPC error response 00:12:47.277 response: 00:12:47.277 { 00:12:47.277 "code": -32602, 00:12:47.277 "message": "The specified target doesn'\''t exist, cannot delete it." 00:12:47.277 }' 00:12:47.277 03:13:21 -- target/invalid.sh@88 -- # [[ request: 00:12:47.277 { 00:12:47.277 "name": "foobar", 00:12:47.277 "method": "nvmf_delete_target", 00:12:47.277 "req_id": 1 00:12:47.277 } 00:12:47.277 Got JSON-RPC error response 00:12:47.277 response: 00:12:47.277 { 00:12:47.277 "code": -32602, 00:12:47.277 "message": "The specified target doesn't exist, cannot delete it." 00:12:47.277 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:12:47.277 03:13:21 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:12:47.277 03:13:21 -- target/invalid.sh@91 -- # nvmftestfini 00:12:47.277 03:13:21 -- nvmf/common.sh@477 -- # nvmfcleanup 00:12:47.277 03:13:21 -- nvmf/common.sh@117 -- # sync 00:12:47.277 03:13:21 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:12:47.277 03:13:21 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:12:47.277 03:13:21 -- nvmf/common.sh@120 -- # set +e 00:12:47.537 03:13:21 -- nvmf/common.sh@121 -- # for i in {1..20} 00:12:47.537 03:13:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:12:47.537 rmmod nvme_rdma 00:12:47.537 rmmod nvme_fabrics 00:12:47.537 03:13:21 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:12:47.537 03:13:21 -- nvmf/common.sh@124 -- # set -e 00:12:47.537 03:13:21 -- nvmf/common.sh@125 -- # return 0 00:12:47.537 03:13:21 -- nvmf/common.sh@478 -- # '[' -n 4008309 ']' 00:12:47.537 03:13:21 -- nvmf/common.sh@479 -- # killprocess 4008309 00:12:47.537 03:13:21 -- common/autotest_common.sh@936 -- # '[' -z 4008309 ']' 00:12:47.537 03:13:21 -- common/autotest_common.sh@940 -- # kill -0 4008309 00:12:47.537 03:13:21 -- common/autotest_common.sh@941 -- # uname 00:12:47.537 03:13:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:47.537 03:13:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4008309 00:12:47.537 03:13:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:47.537 03:13:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:47.537 03:13:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4008309' 00:12:47.537 killing process with pid 4008309 00:12:47.537 03:13:21 -- common/autotest_common.sh@955 -- # kill 4008309 00:12:47.537 03:13:21 -- common/autotest_common.sh@960 -- # wait 4008309 00:12:47.537 [2024-04-25 03:13:21.913080] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:12:47.796 03:13:22 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:12:47.796 03:13:22 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:12:47.796 00:12:47.796 real 0m10.155s 00:12:47.796 user 0m19.723s 00:12:47.796 sys 0m5.322s 00:12:47.796 03:13:22 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:12:47.796 03:13:22 -- common/autotest_common.sh@10 -- # set +x 00:12:47.796 ************************************ 00:12:47.796 END TEST nvmf_invalid 00:12:47.796 ************************************ 00:12:47.796 03:13:22 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=rdma 00:12:47.796 03:13:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:47.796 03:13:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:47.796 03:13:22 -- common/autotest_common.sh@10 -- # set +x 00:12:47.796 ************************************ 00:12:47.796 START TEST nvmf_abort 00:12:47.796 ************************************ 00:12:47.796 03:13:22 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=rdma 00:12:48.056 * Looking for test storage... 00:12:48.056 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:12:48.056 03:13:22 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:12:48.056 03:13:22 -- nvmf/common.sh@7 -- # uname -s 00:12:48.056 03:13:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:48.056 03:13:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:48.056 03:13:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:48.056 03:13:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:48.056 03:13:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:48.056 03:13:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:48.056 03:13:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:48.056 03:13:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:48.056 03:13:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:48.056 03:13:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:48.056 03:13:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:12:48.056 03:13:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:12:48.056 03:13:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:48.056 03:13:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:48.056 03:13:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:48.056 03:13:22 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:48.056 03:13:22 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:12:48.056 03:13:22 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:48.056 03:13:22 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:48.056 03:13:22 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:48.056 03:13:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:48.056 03:13:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:48.056 03:13:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:48.056 03:13:22 -- paths/export.sh@5 -- # export PATH 00:12:48.056 03:13:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:48.056 03:13:22 -- nvmf/common.sh@47 -- # : 0 00:12:48.056 03:13:22 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:12:48.056 03:13:22 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:12:48.056 03:13:22 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:48.056 03:13:22 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:48.056 03:13:22 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:48.056 03:13:22 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:12:48.056 03:13:22 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:12:48.056 03:13:22 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:12:48.056 03:13:22 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:48.056 03:13:22 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:12:48.056 03:13:22 -- target/abort.sh@14 -- # nvmftestinit 00:12:48.056 03:13:22 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:12:48.056 03:13:22 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:48.056 03:13:22 -- nvmf/common.sh@437 -- # prepare_net_devs 00:12:48.056 03:13:22 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:12:48.056 03:13:22 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:12:48.056 03:13:22 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:48.056 03:13:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:48.056 03:13:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:48.056 03:13:22 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:12:48.056 03:13:22 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:12:48.056 03:13:22 -- nvmf/common.sh@285 -- # xtrace_disable 00:12:48.056 03:13:22 -- common/autotest_common.sh@10 -- # set +x 00:12:54.626 03:13:28 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:54.626 03:13:28 -- nvmf/common.sh@291 -- # pci_devs=() 00:12:54.626 03:13:28 -- nvmf/common.sh@291 -- # local -a pci_devs 00:12:54.626 03:13:28 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:12:54.626 03:13:28 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:12:54.626 03:13:28 -- nvmf/common.sh@293 -- # pci_drivers=() 00:12:54.626 03:13:28 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:12:54.626 03:13:28 -- nvmf/common.sh@295 -- # net_devs=() 00:12:54.626 03:13:28 -- nvmf/common.sh@295 -- # local -ga net_devs 00:12:54.626 03:13:28 -- nvmf/common.sh@296 -- # e810=() 00:12:54.626 03:13:28 -- nvmf/common.sh@296 -- # local -ga e810 00:12:54.626 03:13:28 -- nvmf/common.sh@297 -- # x722=() 00:12:54.626 03:13:28 -- nvmf/common.sh@297 -- # local -ga x722 00:12:54.626 03:13:28 -- nvmf/common.sh@298 -- # mlx=() 00:12:54.626 03:13:28 -- nvmf/common.sh@298 -- # local -ga mlx 00:12:54.626 03:13:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:54.626 03:13:28 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:54.626 03:13:28 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:54.626 03:13:28 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:54.626 03:13:28 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:54.626 03:13:28 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:54.626 03:13:28 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:54.626 03:13:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:54.626 03:13:28 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:54.626 03:13:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:54.626 03:13:28 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:54.626 03:13:28 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:12:54.626 03:13:28 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:12:54.626 03:13:28 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:12:54.626 03:13:28 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:12:54.626 03:13:28 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:12:54.626 03:13:28 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:12:54.626 03:13:28 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:12:54.626 03:13:28 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:12:54.626 03:13:28 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:54.626 03:13:28 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:12:54.626 Found 0000:af:00.0 (0x8086 - 0x159b) 00:12:54.626 03:13:28 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:12:54.626 03:13:28 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:12:54.626 03:13:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:54.626 03:13:28 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:54.626 03:13:28 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:54.626 03:13:28 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:54.626 03:13:28 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:54.626 03:13:28 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:12:54.626 Found 0000:af:00.1 (0x8086 - 0x159b) 00:12:54.626 03:13:28 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:12:54.626 03:13:28 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:12:54.626 03:13:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:54.626 03:13:28 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:54.626 03:13:28 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:54.626 03:13:28 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:54.626 03:13:28 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:12:54.626 03:13:28 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:12:54.626 03:13:28 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:12:54.626 03:13:28 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:12:54.626 03:13:28 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:12:54.626 03:13:28 -- nvmf/common.sh@377 -- # modinfo irdma 00:12:54.626 03:13:28 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:12:54.626 03:13:28 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:54.626 03:13:28 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:54.626 03:13:28 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:54.626 03:13:28 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:54.626 03:13:28 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:12:54.626 Found net devices under 0000:af:00.0: cvl_0_0 00:12:54.626 03:13:28 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:54.626 03:13:28 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:54.626 03:13:28 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:54.626 03:13:28 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:54.627 03:13:28 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:54.627 03:13:28 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:12:54.627 Found net devices under 0000:af:00.1: cvl_0_1 00:12:54.627 03:13:28 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:54.627 03:13:28 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:12:54.627 03:13:28 -- nvmf/common.sh@403 -- # is_hw=yes 00:12:54.627 03:13:28 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:12:54.627 03:13:28 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:12:54.627 03:13:28 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:12:54.627 03:13:28 -- nvmf/common.sh@409 -- # rdma_device_init 00:12:54.627 03:13:28 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:12:54.627 03:13:28 -- nvmf/common.sh@58 -- # uname 00:12:54.627 03:13:28 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:12:54.627 03:13:28 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:12:54.627 03:13:28 -- nvmf/common.sh@63 -- # modprobe ib_core 00:12:54.627 03:13:28 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:12:54.627 03:13:28 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:12:54.627 03:13:28 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:12:54.627 03:13:28 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:12:54.627 03:13:28 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:12:54.627 03:13:28 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:12:54.627 03:13:28 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:12:54.627 03:13:28 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:12:54.627 03:13:28 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:54.627 03:13:28 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:54.627 03:13:28 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:54.627 03:13:28 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:54.627 03:13:28 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:54.627 03:13:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:54.627 03:13:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:54.627 03:13:28 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:12:54.627 03:13:28 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:12:54.627 03:13:28 -- nvmf/common.sh@105 -- # continue 2 00:12:54.627 03:13:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:54.627 03:13:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:54.627 03:13:28 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:12:54.627 03:13:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:54.627 03:13:28 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:12:54.627 03:13:28 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:12:54.627 03:13:28 -- nvmf/common.sh@105 -- # continue 2 00:12:54.627 03:13:28 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:54.627 03:13:28 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:12:54.627 03:13:28 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:12:54.627 03:13:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:12:54.627 03:13:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:54.627 03:13:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:54.627 03:13:28 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:12:54.627 03:13:28 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:12:54.627 03:13:28 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:12:54.627 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:12:54.627 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:12:54.627 altname enp175s0f0np0 00:12:54.627 altname ens801f0np0 00:12:54.627 inet 192.168.100.8/24 scope global cvl_0_0 00:12:54.627 valid_lft forever preferred_lft forever 00:12:54.627 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:12:54.627 valid_lft forever preferred_lft forever 00:12:54.627 03:13:28 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:54.627 03:13:28 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:12:54.627 03:13:28 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:12:54.627 03:13:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:12:54.627 03:13:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:54.627 03:13:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:54.627 03:13:28 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:12:54.627 03:13:28 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:12:54.627 03:13:28 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:12:54.627 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:12:54.627 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:12:54.627 altname enp175s0f1np1 00:12:54.627 altname ens801f1np1 00:12:54.627 inet 192.168.100.9/24 scope global cvl_0_1 00:12:54.627 valid_lft forever preferred_lft forever 00:12:54.627 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:12:54.627 valid_lft forever preferred_lft forever 00:12:54.627 03:13:28 -- nvmf/common.sh@411 -- # return 0 00:12:54.627 03:13:28 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:12:54.627 03:13:28 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:12:54.627 03:13:28 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:12:54.627 03:13:28 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:12:54.627 03:13:28 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:12:54.627 03:13:28 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:54.627 03:13:28 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:54.627 03:13:28 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:54.627 03:13:28 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:54.627 03:13:28 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:54.627 03:13:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:54.627 03:13:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:54.627 03:13:28 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:12:54.627 03:13:28 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:12:54.627 03:13:28 -- nvmf/common.sh@105 -- # continue 2 00:12:54.627 03:13:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:54.627 03:13:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:54.627 03:13:28 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:12:54.627 03:13:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:54.627 03:13:28 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:12:54.627 03:13:28 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:12:54.627 03:13:28 -- nvmf/common.sh@105 -- # continue 2 00:12:54.627 03:13:28 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:54.627 03:13:28 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:12:54.627 03:13:28 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:12:54.627 03:13:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:12:54.627 03:13:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:54.627 03:13:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:54.627 03:13:28 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:54.627 03:13:28 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:12:54.627 03:13:28 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:12:54.627 03:13:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:12:54.627 03:13:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:54.627 03:13:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:54.627 03:13:28 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:12:54.627 192.168.100.9' 00:12:54.627 03:13:28 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:12:54.627 192.168.100.9' 00:12:54.627 03:13:28 -- nvmf/common.sh@446 -- # head -n 1 00:12:54.627 03:13:28 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:12:54.627 03:13:28 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:12:54.627 192.168.100.9' 00:12:54.627 03:13:28 -- nvmf/common.sh@447 -- # head -n 1 00:12:54.627 03:13:28 -- nvmf/common.sh@447 -- # tail -n +2 00:12:54.627 03:13:28 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:12:54.627 03:13:28 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:12:54.627 03:13:28 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:12:54.627 03:13:28 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:12:54.627 03:13:28 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:12:54.627 03:13:28 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:12:54.627 03:13:28 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:12:54.627 03:13:28 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:54.627 03:13:28 -- common/autotest_common.sh@710 -- # xtrace_disable 00:12:54.627 03:13:28 -- common/autotest_common.sh@10 -- # set +x 00:12:54.627 03:13:28 -- nvmf/common.sh@470 -- # nvmfpid=4012583 00:12:54.627 03:13:28 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:54.627 03:13:28 -- nvmf/common.sh@471 -- # waitforlisten 4012583 00:12:54.627 03:13:28 -- common/autotest_common.sh@817 -- # '[' -z 4012583 ']' 00:12:54.627 03:13:28 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:54.627 03:13:28 -- common/autotest_common.sh@822 -- # local max_retries=100 00:12:54.627 03:13:28 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:54.627 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:54.627 03:13:28 -- common/autotest_common.sh@826 -- # xtrace_disable 00:12:54.627 03:13:28 -- common/autotest_common.sh@10 -- # set +x 00:12:54.627 [2024-04-25 03:13:28.324192] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:12:54.627 [2024-04-25 03:13:28.324239] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:54.627 EAL: No free 2048 kB hugepages reported on node 1 00:12:54.627 [2024-04-25 03:13:28.387819] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:54.627 [2024-04-25 03:13:28.462952] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:54.627 [2024-04-25 03:13:28.462990] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:54.627 [2024-04-25 03:13:28.462996] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:54.627 [2024-04-25 03:13:28.463002] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:54.628 [2024-04-25 03:13:28.463007] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:54.628 [2024-04-25 03:13:28.463142] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:54.628 [2024-04-25 03:13:28.464870] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:54.628 [2024-04-25 03:13:28.464872] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:54.886 03:13:29 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:12:54.886 03:13:29 -- common/autotest_common.sh@850 -- # return 0 00:12:54.886 03:13:29 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:54.886 03:13:29 -- common/autotest_common.sh@716 -- # xtrace_disable 00:12:54.886 03:13:29 -- common/autotest_common.sh@10 -- # set +x 00:12:54.886 03:13:29 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:54.886 03:13:29 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -a 256 00:12:54.886 03:13:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:54.886 03:13:29 -- common/autotest_common.sh@10 -- # set +x 00:12:54.886 [2024-04-25 03:13:29.186828] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x234c5c0/0x234bc00) succeed. 00:12:54.886 [2024-04-25 03:13:29.196595] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x234d8f0/0x234c180) succeed. 00:12:54.886 [2024-04-25 03:13:29.196620] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:12:54.886 03:13:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:54.886 03:13:29 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:12:54.886 03:13:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:54.886 03:13:29 -- common/autotest_common.sh@10 -- # set +x 00:12:54.886 Malloc0 00:12:54.886 03:13:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:54.887 03:13:29 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:54.887 03:13:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:54.887 03:13:29 -- common/autotest_common.sh@10 -- # set +x 00:12:54.887 Delay0 00:12:54.887 03:13:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:54.887 03:13:29 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:54.887 03:13:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:54.887 03:13:29 -- common/autotest_common.sh@10 -- # set +x 00:12:54.887 03:13:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:54.887 03:13:29 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:12:54.887 03:13:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:54.887 03:13:29 -- common/autotest_common.sh@10 -- # set +x 00:12:54.887 03:13:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:54.887 03:13:29 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:12:54.887 03:13:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:54.887 03:13:29 -- common/autotest_common.sh@10 -- # set +x 00:12:54.887 [2024-04-25 03:13:29.277299] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:54.887 03:13:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:54.887 03:13:29 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:12:54.887 03:13:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:54.887 03:13:29 -- common/autotest_common.sh@10 -- # set +x 00:12:54.887 03:13:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:54.887 03:13:29 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/abort -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:12:54.887 EAL: No free 2048 kB hugepages reported on node 1 00:12:54.887 [2024-04-25 03:13:29.361929] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:12:57.419 Initializing NVMe Controllers 00:12:57.419 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode0 00:12:57.419 controller IO queue size 128 less than required 00:12:57.419 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:12:57.419 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:12:57.419 Initialization complete. Launching workers. 00:12:57.419 NS: RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 52204 00:12:57.419 CTRLR: RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 52265, failed to submit 62 00:12:57.419 success 52205, unsuccess 60, failed 0 00:12:57.419 03:13:31 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:57.419 03:13:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:57.419 03:13:31 -- common/autotest_common.sh@10 -- # set +x 00:12:57.419 03:13:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:57.419 03:13:31 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:12:57.419 03:13:31 -- target/abort.sh@38 -- # nvmftestfini 00:12:57.419 03:13:31 -- nvmf/common.sh@477 -- # nvmfcleanup 00:12:57.419 03:13:31 -- nvmf/common.sh@117 -- # sync 00:12:57.419 03:13:31 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:12:57.419 03:13:31 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:12:57.419 03:13:31 -- nvmf/common.sh@120 -- # set +e 00:12:57.419 03:13:31 -- nvmf/common.sh@121 -- # for i in {1..20} 00:12:57.419 03:13:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:12:57.419 rmmod nvme_rdma 00:12:57.419 rmmod nvme_fabrics 00:12:57.419 03:13:31 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:12:57.419 03:13:31 -- nvmf/common.sh@124 -- # set -e 00:12:57.419 03:13:31 -- nvmf/common.sh@125 -- # return 0 00:12:57.419 03:13:31 -- nvmf/common.sh@478 -- # '[' -n 4012583 ']' 00:12:57.419 03:13:31 -- nvmf/common.sh@479 -- # killprocess 4012583 00:12:57.419 03:13:31 -- common/autotest_common.sh@936 -- # '[' -z 4012583 ']' 00:12:57.419 03:13:31 -- common/autotest_common.sh@940 -- # kill -0 4012583 00:12:57.419 03:13:31 -- common/autotest_common.sh@941 -- # uname 00:12:57.419 03:13:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:57.419 03:13:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4012583 00:12:57.419 03:13:31 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:57.419 03:13:31 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:57.419 03:13:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4012583' 00:12:57.419 killing process with pid 4012583 00:12:57.419 03:13:31 -- common/autotest_common.sh@955 -- # kill 4012583 00:12:57.419 03:13:31 -- common/autotest_common.sh@960 -- # wait 4012583 00:12:57.420 [2024-04-25 03:13:31.603022] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:12:57.420 03:13:31 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:12:57.420 03:13:31 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:12:57.420 00:12:57.420 real 0m9.555s 00:12:57.420 user 0m13.922s 00:12:57.420 sys 0m4.830s 00:12:57.420 03:13:31 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:12:57.420 03:13:31 -- common/autotest_common.sh@10 -- # set +x 00:12:57.420 ************************************ 00:12:57.420 END TEST nvmf_abort 00:12:57.420 ************************************ 00:12:57.420 03:13:31 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=rdma 00:12:57.420 03:13:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:57.420 03:13:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:57.420 03:13:31 -- common/autotest_common.sh@10 -- # set +x 00:12:57.679 ************************************ 00:12:57.679 START TEST nvmf_ns_hotplug_stress 00:12:57.679 ************************************ 00:12:57.679 03:13:31 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=rdma 00:12:57.679 * Looking for test storage... 00:12:57.679 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:12:57.679 03:13:32 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:12:57.679 03:13:32 -- nvmf/common.sh@7 -- # uname -s 00:12:57.679 03:13:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:57.679 03:13:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:57.679 03:13:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:57.679 03:13:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:57.679 03:13:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:57.679 03:13:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:57.679 03:13:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:57.679 03:13:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:57.679 03:13:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:57.679 03:13:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:57.679 03:13:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:12:57.679 03:13:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:12:57.679 03:13:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:57.679 03:13:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:57.679 03:13:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:57.679 03:13:32 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:57.679 03:13:32 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:12:57.679 03:13:32 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:57.679 03:13:32 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:57.679 03:13:32 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:57.679 03:13:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:57.679 03:13:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:57.679 03:13:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:57.679 03:13:32 -- paths/export.sh@5 -- # export PATH 00:12:57.679 03:13:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:57.679 03:13:32 -- nvmf/common.sh@47 -- # : 0 00:12:57.679 03:13:32 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:12:57.679 03:13:32 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:12:57.679 03:13:32 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:57.679 03:13:32 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:57.679 03:13:32 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:57.679 03:13:32 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:12:57.679 03:13:32 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:12:57.679 03:13:32 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:12:57.679 03:13:32 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:12:57.679 03:13:32 -- target/ns_hotplug_stress.sh@13 -- # nvmftestinit 00:12:57.679 03:13:32 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:12:57.679 03:13:32 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:57.679 03:13:32 -- nvmf/common.sh@437 -- # prepare_net_devs 00:12:57.679 03:13:32 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:12:57.679 03:13:32 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:12:57.679 03:13:32 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:57.679 03:13:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:57.679 03:13:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:57.679 03:13:32 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:12:57.679 03:13:32 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:12:57.679 03:13:32 -- nvmf/common.sh@285 -- # xtrace_disable 00:12:57.679 03:13:32 -- common/autotest_common.sh@10 -- # set +x 00:13:04.255 03:13:37 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:04.255 03:13:37 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:04.255 03:13:37 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:04.255 03:13:37 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:04.255 03:13:37 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:04.255 03:13:37 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:04.255 03:13:37 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:04.255 03:13:37 -- nvmf/common.sh@295 -- # net_devs=() 00:13:04.255 03:13:37 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:04.255 03:13:37 -- nvmf/common.sh@296 -- # e810=() 00:13:04.255 03:13:37 -- nvmf/common.sh@296 -- # local -ga e810 00:13:04.255 03:13:37 -- nvmf/common.sh@297 -- # x722=() 00:13:04.255 03:13:37 -- nvmf/common.sh@297 -- # local -ga x722 00:13:04.255 03:13:37 -- nvmf/common.sh@298 -- # mlx=() 00:13:04.255 03:13:37 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:04.255 03:13:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:04.255 03:13:37 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:04.255 03:13:37 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:04.255 03:13:37 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:04.255 03:13:37 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:04.255 03:13:37 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:04.255 03:13:37 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:04.255 03:13:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:04.255 03:13:37 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:04.255 03:13:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:04.255 03:13:37 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:04.255 03:13:37 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:04.255 03:13:37 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:13:04.255 03:13:37 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:13:04.255 03:13:37 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:13:04.255 03:13:37 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:13:04.255 03:13:37 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:13:04.255 03:13:37 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:13:04.255 03:13:37 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:04.255 03:13:37 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:04.255 03:13:37 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:13:04.255 Found 0000:af:00.0 (0x8086 - 0x159b) 00:13:04.255 03:13:37 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:13:04.255 03:13:37 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:13:04.255 03:13:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:04.255 03:13:37 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:04.255 03:13:37 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:04.255 03:13:37 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:04.255 03:13:37 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:04.255 03:13:37 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:13:04.255 Found 0000:af:00.1 (0x8086 - 0x159b) 00:13:04.255 03:13:37 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:13:04.255 03:13:37 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:13:04.255 03:13:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:04.255 03:13:37 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:04.255 03:13:37 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:04.255 03:13:37 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:04.255 03:13:37 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:04.255 03:13:37 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:13:04.255 03:13:37 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:13:04.255 03:13:37 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:13:04.255 03:13:37 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:13:04.255 03:13:37 -- nvmf/common.sh@377 -- # modinfo irdma 00:13:04.255 03:13:37 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:13:04.255 03:13:37 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:04.255 03:13:37 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:04.255 03:13:37 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:04.255 03:13:37 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:04.255 03:13:37 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:13:04.255 Found net devices under 0000:af:00.0: cvl_0_0 00:13:04.255 03:13:37 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:04.255 03:13:37 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:04.255 03:13:37 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:04.255 03:13:37 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:04.255 03:13:37 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:04.255 03:13:37 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:13:04.255 Found net devices under 0000:af:00.1: cvl_0_1 00:13:04.255 03:13:37 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:04.255 03:13:37 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:04.255 03:13:37 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:04.255 03:13:37 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:04.255 03:13:37 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:13:04.255 03:13:37 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:13:04.255 03:13:37 -- nvmf/common.sh@409 -- # rdma_device_init 00:13:04.255 03:13:37 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:13:04.255 03:13:37 -- nvmf/common.sh@58 -- # uname 00:13:04.255 03:13:37 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:13:04.255 03:13:37 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:13:04.255 03:13:37 -- nvmf/common.sh@63 -- # modprobe ib_core 00:13:04.255 03:13:37 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:13:04.255 03:13:37 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:13:04.255 03:13:37 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:13:04.255 03:13:37 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:13:04.255 03:13:37 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:13:04.255 03:13:37 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:13:04.255 03:13:37 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:13:04.255 03:13:37 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:13:04.255 03:13:37 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:04.255 03:13:37 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:04.255 03:13:37 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:04.255 03:13:37 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:04.255 03:13:37 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:04.255 03:13:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:04.255 03:13:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:04.255 03:13:37 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:13:04.255 03:13:37 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:13:04.255 03:13:37 -- nvmf/common.sh@105 -- # continue 2 00:13:04.255 03:13:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:04.255 03:13:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:04.255 03:13:37 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:13:04.255 03:13:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:04.255 03:13:37 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:13:04.255 03:13:37 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:13:04.255 03:13:37 -- nvmf/common.sh@105 -- # continue 2 00:13:04.255 03:13:37 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:04.255 03:13:37 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:13:04.255 03:13:37 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:13:04.255 03:13:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:13:04.255 03:13:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:04.255 03:13:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:04.255 03:13:37 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:13:04.255 03:13:37 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:13:04.255 03:13:37 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:13:04.255 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:13:04.255 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:13:04.255 altname enp175s0f0np0 00:13:04.255 altname ens801f0np0 00:13:04.255 inet 192.168.100.8/24 scope global cvl_0_0 00:13:04.255 valid_lft forever preferred_lft forever 00:13:04.255 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:13:04.255 valid_lft forever preferred_lft forever 00:13:04.255 03:13:37 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:04.255 03:13:37 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:13:04.255 03:13:37 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:13:04.255 03:13:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:13:04.255 03:13:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:04.255 03:13:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:04.255 03:13:37 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:13:04.255 03:13:37 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:13:04.255 03:13:37 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:13:04.255 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:13:04.255 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:13:04.255 altname enp175s0f1np1 00:13:04.255 altname ens801f1np1 00:13:04.255 inet 192.168.100.9/24 scope global cvl_0_1 00:13:04.255 valid_lft forever preferred_lft forever 00:13:04.255 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:13:04.255 valid_lft forever preferred_lft forever 00:13:04.255 03:13:37 -- nvmf/common.sh@411 -- # return 0 00:13:04.255 03:13:37 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:04.255 03:13:37 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:13:04.255 03:13:37 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:13:04.255 03:13:37 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:13:04.255 03:13:37 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:13:04.255 03:13:38 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:04.255 03:13:38 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:04.255 03:13:38 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:04.256 03:13:38 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:04.256 03:13:38 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:04.256 03:13:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:04.256 03:13:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:04.256 03:13:38 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:13:04.256 03:13:38 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:13:04.256 03:13:38 -- nvmf/common.sh@105 -- # continue 2 00:13:04.256 03:13:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:04.256 03:13:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:04.256 03:13:38 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:13:04.256 03:13:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:04.256 03:13:38 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:13:04.256 03:13:38 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:13:04.256 03:13:38 -- nvmf/common.sh@105 -- # continue 2 00:13:04.256 03:13:38 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:04.256 03:13:38 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:13:04.256 03:13:38 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:13:04.256 03:13:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:13:04.256 03:13:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:04.256 03:13:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:04.256 03:13:38 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:04.256 03:13:38 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:13:04.256 03:13:38 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:13:04.256 03:13:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:13:04.256 03:13:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:04.256 03:13:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:04.256 03:13:38 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:13:04.256 192.168.100.9' 00:13:04.256 03:13:38 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:13:04.256 192.168.100.9' 00:13:04.256 03:13:38 -- nvmf/common.sh@446 -- # head -n 1 00:13:04.256 03:13:38 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:13:04.256 03:13:38 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:13:04.256 192.168.100.9' 00:13:04.256 03:13:38 -- nvmf/common.sh@447 -- # tail -n +2 00:13:04.256 03:13:38 -- nvmf/common.sh@447 -- # head -n 1 00:13:04.256 03:13:38 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:13:04.256 03:13:38 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:13:04.256 03:13:38 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:13:04.256 03:13:38 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:13:04.256 03:13:38 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:13:04.256 03:13:38 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:13:04.256 03:13:38 -- target/ns_hotplug_stress.sh@14 -- # nvmfappstart -m 0xE 00:13:04.256 03:13:38 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:13:04.256 03:13:38 -- common/autotest_common.sh@710 -- # xtrace_disable 00:13:04.256 03:13:38 -- common/autotest_common.sh@10 -- # set +x 00:13:04.256 03:13:38 -- nvmf/common.sh@470 -- # nvmfpid=4016613 00:13:04.256 03:13:38 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:04.256 03:13:38 -- nvmf/common.sh@471 -- # waitforlisten 4016613 00:13:04.256 03:13:38 -- common/autotest_common.sh@817 -- # '[' -z 4016613 ']' 00:13:04.256 03:13:38 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:04.256 03:13:38 -- common/autotest_common.sh@822 -- # local max_retries=100 00:13:04.256 03:13:38 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:04.256 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:04.256 03:13:38 -- common/autotest_common.sh@826 -- # xtrace_disable 00:13:04.256 03:13:38 -- common/autotest_common.sh@10 -- # set +x 00:13:04.256 [2024-04-25 03:13:38.137560] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:13:04.256 [2024-04-25 03:13:38.137600] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:04.256 EAL: No free 2048 kB hugepages reported on node 1 00:13:04.256 [2024-04-25 03:13:38.197486] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:04.256 [2024-04-25 03:13:38.269908] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:04.256 [2024-04-25 03:13:38.269947] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:04.256 [2024-04-25 03:13:38.269953] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:04.256 [2024-04-25 03:13:38.269959] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:04.256 [2024-04-25 03:13:38.269964] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:04.256 [2024-04-25 03:13:38.270065] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:04.256 [2024-04-25 03:13:38.270173] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:04.256 [2024-04-25 03:13:38.270174] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:04.515 03:13:38 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:13:04.515 03:13:38 -- common/autotest_common.sh@850 -- # return 0 00:13:04.515 03:13:38 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:13:04.515 03:13:38 -- common/autotest_common.sh@716 -- # xtrace_disable 00:13:04.515 03:13:38 -- common/autotest_common.sh@10 -- # set +x 00:13:04.515 03:13:38 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:04.515 03:13:38 -- target/ns_hotplug_stress.sh@16 -- # null_size=1000 00:13:04.515 03:13:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:13:04.774 [2024-04-25 03:13:39.136549] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x1a135c0/0x1a12c00) succeed. 00:13:04.774 [2024-04-25 03:13:39.146409] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x1a148f0/0x1a13180) succeed. 00:13:04.774 [2024-04-25 03:13:39.146431] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:13:04.774 03:13:39 -- target/ns_hotplug_stress.sh@20 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:05.032 03:13:39 -- target/ns_hotplug_stress.sh@21 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:13:05.032 [2024-04-25 03:13:39.487827] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:13:05.032 03:13:39 -- target/ns_hotplug_stress.sh@22 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:13:05.291 03:13:39 -- target/ns_hotplug_stress.sh@23 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:13:05.550 Malloc0 00:13:05.550 03:13:39 -- target/ns_hotplug_stress.sh@24 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:05.809 Delay0 00:13:05.809 03:13:40 -- target/ns_hotplug_stress.sh@25 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:05.809 03:13:40 -- target/ns_hotplug_stress.sh@26 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:13:06.103 NULL1 00:13:06.103 03:13:40 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:06.384 03:13:40 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:13:06.384 03:13:40 -- target/ns_hotplug_stress.sh@33 -- # PERF_PID=4017095 00:13:06.384 03:13:40 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:06.384 03:13:40 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:06.384 EAL: No free 2048 kB hugepages reported on node 1 00:13:07.321 Read completed with error (sct=0, sc=11) 00:13:07.321 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:07.321 03:13:41 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:07.321 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:07.580 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:07.580 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:07.580 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:07.580 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:07.580 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:07.580 03:13:41 -- target/ns_hotplug_stress.sh@40 -- # null_size=1001 00:13:07.580 03:13:41 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:13:07.838 true 00:13:07.838 03:13:42 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:07.838 03:13:42 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:08.774 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:08.774 03:13:42 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:08.774 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:08.774 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:08.774 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:08.774 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:08.774 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:08.774 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:08.774 03:13:43 -- target/ns_hotplug_stress.sh@40 -- # null_size=1002 00:13:08.774 03:13:43 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:13:09.031 true 00:13:09.031 03:13:43 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:09.031 03:13:43 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:09.966 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:09.966 03:13:44 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:09.966 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:09.966 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:09.966 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:09.966 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:09.966 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:09.966 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:09.967 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:09.967 03:13:44 -- target/ns_hotplug_stress.sh@40 -- # null_size=1003 00:13:09.967 03:13:44 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:13:10.225 true 00:13:10.225 03:13:44 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:10.225 03:13:44 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:11.161 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:11.161 03:13:45 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:11.161 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:11.161 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:11.161 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:11.161 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:11.161 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:11.161 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:11.161 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:11.161 03:13:45 -- target/ns_hotplug_stress.sh@40 -- # null_size=1004 00:13:11.161 03:13:45 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:13:11.419 true 00:13:11.419 03:13:45 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:11.419 03:13:45 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:12.354 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:12.354 03:13:46 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:12.354 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:12.354 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:12.354 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:12.354 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:12.354 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:12.354 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:12.354 03:13:46 -- target/ns_hotplug_stress.sh@40 -- # null_size=1005 00:13:12.354 03:13:46 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:13:12.612 true 00:13:12.612 03:13:46 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:12.612 03:13:46 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:13.547 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:13.547 03:13:47 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:13.547 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:13.547 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:13.547 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:13.547 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:13.547 03:13:47 -- target/ns_hotplug_stress.sh@40 -- # null_size=1006 00:13:13.547 03:13:47 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:13:13.805 true 00:13:13.805 03:13:48 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:13.805 03:13:48 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:14.740 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:14.740 03:13:49 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:14.740 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:14.740 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:14.740 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:14.740 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:14.740 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:14.740 03:13:49 -- target/ns_hotplug_stress.sh@40 -- # null_size=1007 00:13:14.740 03:13:49 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:13:14.998 true 00:13:14.998 03:13:49 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:14.998 03:13:49 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:15.933 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:15.933 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:15.933 03:13:50 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:15.933 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:15.933 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:15.933 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:15.933 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:15.933 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:15.933 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:15.933 03:13:50 -- target/ns_hotplug_stress.sh@40 -- # null_size=1008 00:13:15.933 03:13:50 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:13:16.191 true 00:13:16.191 03:13:50 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:16.191 03:13:50 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:17.127 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:17.127 03:13:51 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:17.127 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:17.127 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:17.127 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:17.127 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:17.127 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:17.127 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:17.127 03:13:51 -- target/ns_hotplug_stress.sh@40 -- # null_size=1009 00:13:17.127 03:13:51 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:13:17.385 true 00:13:17.385 03:13:51 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:17.386 03:13:51 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:18.319 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:18.319 03:13:52 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:18.319 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:18.319 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:18.319 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:18.319 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:18.319 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:18.319 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:18.319 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:18.319 03:13:52 -- target/ns_hotplug_stress.sh@40 -- # null_size=1010 00:13:18.319 03:13:52 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:13:18.577 true 00:13:18.577 03:13:52 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:18.578 03:13:52 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:19.515 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:19.515 03:13:53 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:19.515 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:19.515 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:19.515 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:19.515 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:19.515 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:19.515 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:19.515 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:19.515 03:13:53 -- target/ns_hotplug_stress.sh@40 -- # null_size=1011 00:13:19.515 03:13:53 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:13:19.774 true 00:13:19.774 03:13:54 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:19.774 03:13:54 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:20.711 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:20.711 03:13:55 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:20.711 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:20.711 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:20.711 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:20.711 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:20.711 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:20.711 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:20.970 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:20.970 03:13:55 -- target/ns_hotplug_stress.sh@40 -- # null_size=1012 00:13:20.970 03:13:55 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:13:20.970 true 00:13:20.970 03:13:55 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:20.970 03:13:55 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:21.906 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:21.906 03:13:56 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:21.906 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:21.906 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:21.906 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:21.906 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:21.906 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:22.180 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:22.180 03:13:56 -- target/ns_hotplug_stress.sh@40 -- # null_size=1013 00:13:22.181 03:13:56 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:13:22.181 true 00:13:22.181 03:13:56 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:22.181 03:13:56 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:23.144 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:23.144 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:23.144 03:13:57 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:23.144 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:23.144 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:23.144 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:23.144 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:23.144 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:23.144 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:23.144 03:13:57 -- target/ns_hotplug_stress.sh@40 -- # null_size=1014 00:13:23.144 03:13:57 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:13:23.403 true 00:13:23.403 03:13:57 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:23.403 03:13:57 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:24.338 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:24.338 03:13:58 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:24.338 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:24.338 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:24.338 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:24.338 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:24.338 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:24.338 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:24.338 03:13:58 -- target/ns_hotplug_stress.sh@40 -- # null_size=1015 00:13:24.338 03:13:58 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:13:24.595 true 00:13:24.595 03:13:58 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:24.595 03:13:58 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:25.531 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:25.531 03:13:59 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:25.531 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:25.531 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:25.531 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:25.531 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:25.531 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:25.531 03:13:59 -- target/ns_hotplug_stress.sh@40 -- # null_size=1016 00:13:25.531 03:13:59 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:13:25.789 true 00:13:25.789 03:14:00 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:25.789 03:14:00 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:26.726 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:26.727 03:14:00 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:26.727 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:26.727 03:14:01 -- target/ns_hotplug_stress.sh@40 -- # null_size=1017 00:13:26.727 03:14:01 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:13:26.985 true 00:13:26.985 03:14:01 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:26.985 03:14:01 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:27.244 03:14:01 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:27.244 03:14:01 -- target/ns_hotplug_stress.sh@40 -- # null_size=1018 00:13:27.244 03:14:01 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:13:27.502 true 00:13:27.502 03:14:01 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:27.502 03:14:01 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:27.760 03:14:02 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:27.760 03:14:02 -- target/ns_hotplug_stress.sh@40 -- # null_size=1019 00:13:27.760 03:14:02 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:13:28.018 true 00:13:28.018 03:14:02 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:28.018 03:14:02 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:28.277 03:14:02 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:28.277 03:14:02 -- target/ns_hotplug_stress.sh@40 -- # null_size=1020 00:13:28.277 03:14:02 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:13:28.536 true 00:13:28.536 03:14:02 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:28.536 03:14:02 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:29.914 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:29.914 03:14:04 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:29.914 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:29.914 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:29.914 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:29.914 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:29.914 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:29.914 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:29.914 03:14:04 -- target/ns_hotplug_stress.sh@40 -- # null_size=1021 00:13:29.914 03:14:04 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:13:29.914 true 00:13:29.914 03:14:04 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:29.914 03:14:04 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:30.851 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:30.851 03:14:05 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:30.851 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:30.851 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:30.851 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:30.851 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:30.851 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:31.110 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:31.110 03:14:05 -- target/ns_hotplug_stress.sh@40 -- # null_size=1022 00:13:31.110 03:14:05 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:13:31.110 true 00:13:31.110 03:14:05 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:31.110 03:14:05 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:32.046 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:32.046 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:32.046 03:14:06 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:32.046 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:32.046 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:32.046 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:32.046 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:32.046 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:32.304 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:32.304 03:14:06 -- target/ns_hotplug_stress.sh@40 -- # null_size=1023 00:13:32.304 03:14:06 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:13:32.304 true 00:13:32.304 03:14:06 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:32.304 03:14:06 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:33.239 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:33.239 03:14:07 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:33.239 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:33.239 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:33.239 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:33.239 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:33.239 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:33.239 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:33.497 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:33.497 03:14:07 -- target/ns_hotplug_stress.sh@40 -- # null_size=1024 00:13:33.497 03:14:07 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:13:33.497 true 00:13:33.497 03:14:07 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:33.497 03:14:07 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:34.433 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:34.433 03:14:08 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:34.433 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:34.433 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:34.433 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:34.433 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:34.433 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:34.692 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:34.692 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:34.692 03:14:08 -- target/ns_hotplug_stress.sh@40 -- # null_size=1025 00:13:34.692 03:14:08 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:13:34.692 true 00:13:34.951 03:14:09 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:34.951 03:14:09 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:35.519 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:35.519 03:14:10 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:35.778 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:35.778 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:35.778 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:35.778 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:35.778 03:14:10 -- target/ns_hotplug_stress.sh@40 -- # null_size=1026 00:13:35.778 03:14:10 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:13:36.037 true 00:13:36.037 03:14:10 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:36.037 03:14:10 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:36.974 03:14:11 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:36.974 03:14:11 -- target/ns_hotplug_stress.sh@40 -- # null_size=1027 00:13:36.974 03:14:11 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:13:37.232 true 00:13:37.233 03:14:11 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:37.233 03:14:11 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:37.491 03:14:11 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:37.788 03:14:12 -- target/ns_hotplug_stress.sh@40 -- # null_size=1028 00:13:37.788 03:14:12 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:13:37.788 true 00:13:37.788 03:14:12 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:37.788 03:14:12 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:38.061 03:14:12 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:38.061 03:14:12 -- target/ns_hotplug_stress.sh@40 -- # null_size=1029 00:13:38.061 03:14:12 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:13:38.319 true 00:13:38.319 03:14:12 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:38.319 03:14:12 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:38.577 03:14:12 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:38.578 03:14:13 -- target/ns_hotplug_stress.sh@40 -- # null_size=1030 00:13:38.578 03:14:13 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1030 00:13:38.836 true 00:13:38.836 03:14:13 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:38.836 03:14:13 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:38.836 Initializing NVMe Controllers 00:13:38.836 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:13:38.836 Controller IO queue size 128, less than required. 00:13:38.836 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:38.836 Controller IO queue size 128, less than required. 00:13:38.836 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:38.836 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:13:38.836 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:13:38.836 Initialization complete. Launching workers. 00:13:38.836 ======================================================== 00:13:38.836 Latency(us) 00:13:38.836 Device Information : IOPS MiB/s Average min max 00:13:38.836 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 5420.23 2.65 20256.25 1380.45 1138486.95 00:13:38.836 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 33432.71 16.32 3828.54 1641.46 294705.50 00:13:38.836 ======================================================== 00:13:38.836 Total : 38852.94 18.97 6120.31 1380.45 1138486.95 00:13:38.836 00:13:39.095 03:14:13 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:39.352 03:14:13 -- target/ns_hotplug_stress.sh@40 -- # null_size=1031 00:13:39.352 03:14:13 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1031 00:13:39.352 true 00:13:39.352 03:14:13 -- target/ns_hotplug_stress.sh@35 -- # kill -0 4017095 00:13:39.353 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 35: kill: (4017095) - No such process 00:13:39.353 03:14:13 -- target/ns_hotplug_stress.sh@44 -- # wait 4017095 00:13:39.353 03:14:13 -- target/ns_hotplug_stress.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:13:39.353 03:14:13 -- target/ns_hotplug_stress.sh@48 -- # nvmftestfini 00:13:39.353 03:14:13 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:39.353 03:14:13 -- nvmf/common.sh@117 -- # sync 00:13:39.353 03:14:13 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:13:39.353 03:14:13 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:13:39.353 03:14:13 -- nvmf/common.sh@120 -- # set +e 00:13:39.353 03:14:13 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:39.353 03:14:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:13:39.353 rmmod nvme_rdma 00:13:39.353 rmmod nvme_fabrics 00:13:39.353 03:14:13 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:39.353 03:14:13 -- nvmf/common.sh@124 -- # set -e 00:13:39.353 03:14:13 -- nvmf/common.sh@125 -- # return 0 00:13:39.353 03:14:13 -- nvmf/common.sh@478 -- # '[' -n 4016613 ']' 00:13:39.353 03:14:13 -- nvmf/common.sh@479 -- # killprocess 4016613 00:13:39.353 03:14:13 -- common/autotest_common.sh@936 -- # '[' -z 4016613 ']' 00:13:39.353 03:14:13 -- common/autotest_common.sh@940 -- # kill -0 4016613 00:13:39.353 03:14:13 -- common/autotest_common.sh@941 -- # uname 00:13:39.353 03:14:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:39.353 03:14:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4016613 00:13:39.610 03:14:13 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:39.610 03:14:13 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:39.610 03:14:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4016613' 00:13:39.610 killing process with pid 4016613 00:13:39.610 03:14:13 -- common/autotest_common.sh@955 -- # kill 4016613 00:13:39.610 03:14:13 -- common/autotest_common.sh@960 -- # wait 4016613 00:13:39.610 [2024-04-25 03:14:13.908320] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:13:39.868 03:14:14 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:39.868 03:14:14 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:13:39.868 00:13:39.868 real 0m42.125s 00:13:39.868 user 2m36.608s 00:13:39.868 sys 0m7.553s 00:13:39.868 03:14:14 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:13:39.868 03:14:14 -- common/autotest_common.sh@10 -- # set +x 00:13:39.868 ************************************ 00:13:39.868 END TEST nvmf_ns_hotplug_stress 00:13:39.868 ************************************ 00:13:39.868 03:14:14 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=rdma 00:13:39.868 03:14:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:39.868 03:14:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:39.868 03:14:14 -- common/autotest_common.sh@10 -- # set +x 00:13:39.868 ************************************ 00:13:39.869 START TEST nvmf_connect_stress 00:13:39.869 ************************************ 00:13:39.869 03:14:14 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=rdma 00:13:39.869 * Looking for test storage... 00:13:39.869 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:13:39.869 03:14:14 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:13:39.869 03:14:14 -- nvmf/common.sh@7 -- # uname -s 00:13:39.869 03:14:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:39.869 03:14:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:39.869 03:14:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:39.869 03:14:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:39.869 03:14:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:39.869 03:14:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:39.869 03:14:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:39.869 03:14:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:39.869 03:14:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:39.869 03:14:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:39.869 03:14:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:13:39.869 03:14:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:13:39.869 03:14:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:39.869 03:14:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:39.869 03:14:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:39.869 03:14:14 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:39.869 03:14:14 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:13:39.869 03:14:14 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:39.869 03:14:14 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:39.869 03:14:14 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:39.869 03:14:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:39.869 03:14:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:39.869 03:14:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:39.869 03:14:14 -- paths/export.sh@5 -- # export PATH 00:13:39.869 03:14:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:39.869 03:14:14 -- nvmf/common.sh@47 -- # : 0 00:13:39.869 03:14:14 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:39.869 03:14:14 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:39.869 03:14:14 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:39.869 03:14:14 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:39.869 03:14:14 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:39.869 03:14:14 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:39.869 03:14:14 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:39.869 03:14:14 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:40.126 03:14:14 -- target/connect_stress.sh@12 -- # nvmftestinit 00:13:40.126 03:14:14 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:13:40.126 03:14:14 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:40.126 03:14:14 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:40.126 03:14:14 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:40.126 03:14:14 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:40.126 03:14:14 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:40.126 03:14:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:40.126 03:14:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:40.126 03:14:14 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:40.126 03:14:14 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:40.126 03:14:14 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:40.126 03:14:14 -- common/autotest_common.sh@10 -- # set +x 00:13:46.691 03:14:20 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:46.691 03:14:20 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:46.691 03:14:20 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:46.691 03:14:20 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:46.691 03:14:20 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:46.691 03:14:20 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:46.691 03:14:20 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:46.691 03:14:20 -- nvmf/common.sh@295 -- # net_devs=() 00:13:46.691 03:14:20 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:46.691 03:14:20 -- nvmf/common.sh@296 -- # e810=() 00:13:46.691 03:14:20 -- nvmf/common.sh@296 -- # local -ga e810 00:13:46.691 03:14:20 -- nvmf/common.sh@297 -- # x722=() 00:13:46.691 03:14:20 -- nvmf/common.sh@297 -- # local -ga x722 00:13:46.691 03:14:20 -- nvmf/common.sh@298 -- # mlx=() 00:13:46.691 03:14:20 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:46.691 03:14:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:46.691 03:14:20 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:46.691 03:14:20 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:46.691 03:14:20 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:46.691 03:14:20 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:46.691 03:14:20 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:46.691 03:14:20 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:46.691 03:14:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:46.691 03:14:20 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:46.691 03:14:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:46.691 03:14:20 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:46.691 03:14:20 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:46.691 03:14:20 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:13:46.691 03:14:20 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:13:46.691 03:14:20 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:13:46.691 03:14:20 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:13:46.691 03:14:20 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:13:46.691 03:14:20 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:13:46.691 03:14:20 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:46.691 03:14:20 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:46.691 03:14:20 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:13:46.691 Found 0000:af:00.0 (0x8086 - 0x159b) 00:13:46.691 03:14:20 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:13:46.691 03:14:20 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:13:46.691 03:14:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:46.691 03:14:20 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:46.691 03:14:20 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:46.691 03:14:20 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:46.691 03:14:20 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:46.691 03:14:20 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:13:46.691 Found 0000:af:00.1 (0x8086 - 0x159b) 00:13:46.691 03:14:20 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:13:46.691 03:14:20 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:13:46.691 03:14:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:46.691 03:14:20 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:46.691 03:14:20 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:46.691 03:14:20 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:46.691 03:14:20 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:46.691 03:14:20 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:13:46.691 03:14:20 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:13:46.691 03:14:20 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:13:46.691 03:14:20 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:13:46.691 03:14:20 -- nvmf/common.sh@377 -- # modinfo irdma 00:13:46.691 03:14:20 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:13:46.691 03:14:20 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:46.691 03:14:20 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:46.691 03:14:20 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:46.691 03:14:20 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:46.691 03:14:20 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:13:46.691 Found net devices under 0000:af:00.0: cvl_0_0 00:13:46.691 03:14:20 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:46.691 03:14:20 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:46.691 03:14:20 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:46.691 03:14:20 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:46.691 03:14:20 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:46.691 03:14:20 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:13:46.691 Found net devices under 0000:af:00.1: cvl_0_1 00:13:46.691 03:14:20 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:46.691 03:14:20 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:46.691 03:14:20 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:46.691 03:14:20 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:46.691 03:14:20 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:13:46.692 03:14:20 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:13:46.692 03:14:20 -- nvmf/common.sh@409 -- # rdma_device_init 00:13:46.692 03:14:20 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:13:46.692 03:14:20 -- nvmf/common.sh@58 -- # uname 00:13:46.692 03:14:20 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:13:46.692 03:14:20 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:13:46.692 03:14:20 -- nvmf/common.sh@63 -- # modprobe ib_core 00:13:46.692 03:14:20 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:13:46.692 03:14:20 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:13:46.692 03:14:20 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:13:46.692 03:14:20 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:13:46.692 03:14:20 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:13:46.692 03:14:20 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:13:46.692 03:14:20 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:13:46.692 03:14:20 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:13:46.692 03:14:20 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:46.692 03:14:20 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:46.692 03:14:20 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:46.692 03:14:20 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:46.692 03:14:20 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:46.692 03:14:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:46.692 03:14:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:46.692 03:14:20 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:13:46.692 03:14:20 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:13:46.692 03:14:20 -- nvmf/common.sh@105 -- # continue 2 00:13:46.692 03:14:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:46.692 03:14:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:46.692 03:14:20 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:13:46.692 03:14:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:46.692 03:14:20 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:13:46.692 03:14:20 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:13:46.692 03:14:20 -- nvmf/common.sh@105 -- # continue 2 00:13:46.692 03:14:20 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:46.692 03:14:20 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:13:46.692 03:14:20 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:13:46.692 03:14:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:13:46.692 03:14:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:46.692 03:14:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:46.692 03:14:20 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:13:46.692 03:14:20 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:13:46.692 03:14:20 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:13:46.692 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:13:46.692 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:13:46.692 altname enp175s0f0np0 00:13:46.692 altname ens801f0np0 00:13:46.692 inet 192.168.100.8/24 scope global cvl_0_0 00:13:46.692 valid_lft forever preferred_lft forever 00:13:46.692 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:13:46.692 valid_lft forever preferred_lft forever 00:13:46.692 03:14:20 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:46.692 03:14:20 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:13:46.692 03:14:20 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:13:46.692 03:14:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:13:46.692 03:14:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:46.692 03:14:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:46.692 03:14:20 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:13:46.692 03:14:20 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:13:46.692 03:14:20 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:13:46.692 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:13:46.692 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:13:46.692 altname enp175s0f1np1 00:13:46.692 altname ens801f1np1 00:13:46.692 inet 192.168.100.9/24 scope global cvl_0_1 00:13:46.692 valid_lft forever preferred_lft forever 00:13:46.692 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:13:46.692 valid_lft forever preferred_lft forever 00:13:46.692 03:14:20 -- nvmf/common.sh@411 -- # return 0 00:13:46.692 03:14:20 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:46.692 03:14:20 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:13:46.692 03:14:20 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:13:46.692 03:14:20 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:13:46.692 03:14:20 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:13:46.692 03:14:20 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:46.692 03:14:20 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:46.692 03:14:20 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:46.692 03:14:20 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:46.692 03:14:20 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:46.692 03:14:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:46.692 03:14:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:46.692 03:14:20 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:13:46.692 03:14:20 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:13:46.692 03:14:20 -- nvmf/common.sh@105 -- # continue 2 00:13:46.692 03:14:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:46.692 03:14:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:46.692 03:14:20 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:13:46.692 03:14:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:46.692 03:14:20 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:13:46.692 03:14:20 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:13:46.692 03:14:20 -- nvmf/common.sh@105 -- # continue 2 00:13:46.692 03:14:20 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:46.692 03:14:20 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:13:46.692 03:14:20 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:13:46.692 03:14:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:13:46.692 03:14:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:46.692 03:14:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:46.692 03:14:20 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:46.692 03:14:20 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:13:46.692 03:14:20 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:13:46.692 03:14:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:13:46.692 03:14:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:46.692 03:14:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:46.692 03:14:20 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:13:46.692 192.168.100.9' 00:13:46.692 03:14:20 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:13:46.692 192.168.100.9' 00:13:46.692 03:14:20 -- nvmf/common.sh@446 -- # head -n 1 00:13:46.692 03:14:20 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:13:46.692 03:14:20 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:13:46.692 192.168.100.9' 00:13:46.692 03:14:20 -- nvmf/common.sh@447 -- # tail -n +2 00:13:46.692 03:14:20 -- nvmf/common.sh@447 -- # head -n 1 00:13:46.692 03:14:20 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:13:46.692 03:14:20 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:13:46.692 03:14:20 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:13:46.692 03:14:20 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:13:46.692 03:14:20 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:13:46.692 03:14:20 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:13:46.692 03:14:20 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:13:46.692 03:14:20 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:13:46.692 03:14:20 -- common/autotest_common.sh@710 -- # xtrace_disable 00:13:46.692 03:14:20 -- common/autotest_common.sh@10 -- # set +x 00:13:46.692 03:14:20 -- nvmf/common.sh@470 -- # nvmfpid=4026148 00:13:46.692 03:14:20 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:46.692 03:14:20 -- nvmf/common.sh@471 -- # waitforlisten 4026148 00:13:46.692 03:14:20 -- common/autotest_common.sh@817 -- # '[' -z 4026148 ']' 00:13:46.692 03:14:20 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:46.692 03:14:20 -- common/autotest_common.sh@822 -- # local max_retries=100 00:13:46.692 03:14:20 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:46.692 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:46.692 03:14:20 -- common/autotest_common.sh@826 -- # xtrace_disable 00:13:46.692 03:14:20 -- common/autotest_common.sh@10 -- # set +x 00:13:46.692 [2024-04-25 03:14:20.628961] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:13:46.692 [2024-04-25 03:14:20.629004] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:46.692 EAL: No free 2048 kB hugepages reported on node 1 00:13:46.692 [2024-04-25 03:14:20.687183] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:46.692 [2024-04-25 03:14:20.760869] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:46.692 [2024-04-25 03:14:20.760907] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:46.692 [2024-04-25 03:14:20.760914] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:46.692 [2024-04-25 03:14:20.760920] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:46.692 [2024-04-25 03:14:20.760925] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:46.692 [2024-04-25 03:14:20.760962] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:46.692 [2024-04-25 03:14:20.761069] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:46.692 [2024-04-25 03:14:20.761071] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:46.951 03:14:21 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:13:46.951 03:14:21 -- common/autotest_common.sh@850 -- # return 0 00:13:46.951 03:14:21 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:13:46.951 03:14:21 -- common/autotest_common.sh@716 -- # xtrace_disable 00:13:46.951 03:14:21 -- common/autotest_common.sh@10 -- # set +x 00:13:47.211 03:14:21 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:47.211 03:14:21 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:13:47.211 03:14:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:47.211 03:14:21 -- common/autotest_common.sh@10 -- # set +x 00:13:47.211 [2024-04-25 03:14:21.491094] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x11c05c0/0x11bfc00) succeed. 00:13:47.211 [2024-04-25 03:14:21.501082] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x11c18f0/0x11c0180) succeed. 00:13:47.211 [2024-04-25 03:14:21.501104] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:13:47.211 03:14:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:47.211 03:14:21 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:47.211 03:14:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:47.211 03:14:21 -- common/autotest_common.sh@10 -- # set +x 00:13:47.211 03:14:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:47.211 03:14:21 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:13:47.211 03:14:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:47.211 03:14:21 -- common/autotest_common.sh@10 -- # set +x 00:13:47.211 [2024-04-25 03:14:21.521330] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:13:47.211 03:14:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:47.211 03:14:21 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:47.211 03:14:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:47.211 03:14:21 -- common/autotest_common.sh@10 -- # set +x 00:13:47.211 NULL1 00:13:47.211 03:14:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:47.211 03:14:21 -- target/connect_stress.sh@21 -- # PERF_PID=4026354 00:13:47.211 03:14:21 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:47.211 03:14:21 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:13:47.211 03:14:21 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:47.211 03:14:21 -- target/connect_stress.sh@27 -- # seq 1 20 00:13:47.211 03:14:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:47.211 03:14:21 -- target/connect_stress.sh@28 -- # cat 00:13:47.211 03:14:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:47.211 03:14:21 -- target/connect_stress.sh@28 -- # cat 00:13:47.211 03:14:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:47.211 03:14:21 -- target/connect_stress.sh@28 -- # cat 00:13:47.211 03:14:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:47.211 03:14:21 -- target/connect_stress.sh@28 -- # cat 00:13:47.211 03:14:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:47.211 03:14:21 -- target/connect_stress.sh@28 -- # cat 00:13:47.211 03:14:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:47.211 EAL: No free 2048 kB hugepages reported on node 1 00:13:47.211 03:14:21 -- target/connect_stress.sh@28 -- # cat 00:13:47.211 03:14:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:47.211 03:14:21 -- target/connect_stress.sh@28 -- # cat 00:13:47.211 03:14:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:47.211 03:14:21 -- target/connect_stress.sh@28 -- # cat 00:13:47.211 03:14:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:47.211 03:14:21 -- target/connect_stress.sh@28 -- # cat 00:13:47.211 03:14:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:47.211 03:14:21 -- target/connect_stress.sh@28 -- # cat 00:13:47.211 03:14:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:47.211 03:14:21 -- target/connect_stress.sh@28 -- # cat 00:13:47.211 03:14:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:47.211 03:14:21 -- target/connect_stress.sh@28 -- # cat 00:13:47.211 03:14:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:47.211 03:14:21 -- target/connect_stress.sh@28 -- # cat 00:13:47.211 03:14:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:47.211 03:14:21 -- target/connect_stress.sh@28 -- # cat 00:13:47.211 03:14:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:47.211 03:14:21 -- target/connect_stress.sh@28 -- # cat 00:13:47.211 03:14:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:47.211 03:14:21 -- target/connect_stress.sh@28 -- # cat 00:13:47.211 03:14:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:47.211 03:14:21 -- target/connect_stress.sh@28 -- # cat 00:13:47.211 03:14:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:47.211 03:14:21 -- target/connect_stress.sh@28 -- # cat 00:13:47.211 03:14:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:47.211 03:14:21 -- target/connect_stress.sh@28 -- # cat 00:13:47.211 03:14:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:47.211 03:14:21 -- target/connect_stress.sh@28 -- # cat 00:13:47.211 03:14:21 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:47.211 03:14:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:47.211 03:14:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:47.211 03:14:21 -- common/autotest_common.sh@10 -- # set +x 00:13:47.470 03:14:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:47.470 03:14:21 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:47.470 03:14:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:47.470 03:14:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:47.470 03:14:21 -- common/autotest_common.sh@10 -- # set +x 00:13:48.038 03:14:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:48.038 03:14:22 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:48.038 03:14:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:48.038 03:14:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:48.038 03:14:22 -- common/autotest_common.sh@10 -- # set +x 00:13:48.297 03:14:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:48.297 03:14:22 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:48.297 03:14:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:48.297 03:14:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:48.297 03:14:22 -- common/autotest_common.sh@10 -- # set +x 00:13:48.555 03:14:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:48.555 03:14:22 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:48.556 03:14:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:48.556 03:14:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:48.556 03:14:22 -- common/autotest_common.sh@10 -- # set +x 00:13:48.813 03:14:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:48.813 03:14:23 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:48.813 03:14:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:48.813 03:14:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:48.813 03:14:23 -- common/autotest_common.sh@10 -- # set +x 00:13:49.378 03:14:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:49.378 03:14:23 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:49.378 03:14:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:49.378 03:14:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:49.378 03:14:23 -- common/autotest_common.sh@10 -- # set +x 00:13:49.637 03:14:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:49.637 03:14:23 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:49.637 03:14:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:49.637 03:14:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:49.637 03:14:23 -- common/autotest_common.sh@10 -- # set +x 00:13:49.895 03:14:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:49.895 03:14:24 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:49.895 03:14:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:49.895 03:14:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:49.895 03:14:24 -- common/autotest_common.sh@10 -- # set +x 00:13:50.154 03:14:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:50.154 03:14:24 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:50.154 03:14:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:50.154 03:14:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:50.154 03:14:24 -- common/autotest_common.sh@10 -- # set +x 00:13:50.413 03:14:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:50.413 03:14:24 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:50.413 03:14:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:50.413 03:14:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:50.413 03:14:24 -- common/autotest_common.sh@10 -- # set +x 00:13:50.981 03:14:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:50.981 03:14:25 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:50.981 03:14:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:50.981 03:14:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:50.981 03:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:51.240 03:14:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:51.240 03:14:25 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:51.240 03:14:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:51.240 03:14:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:51.240 03:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:51.499 03:14:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:51.499 03:14:25 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:51.499 03:14:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:51.499 03:14:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:51.499 03:14:25 -- common/autotest_common.sh@10 -- # set +x 00:13:51.758 03:14:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:51.758 03:14:26 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:51.758 03:14:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:51.758 03:14:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:51.758 03:14:26 -- common/autotest_common.sh@10 -- # set +x 00:13:52.016 03:14:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:52.016 03:14:26 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:52.016 03:14:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:52.017 03:14:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:52.017 03:14:26 -- common/autotest_common.sh@10 -- # set +x 00:13:52.584 03:14:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:52.584 03:14:26 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:52.584 03:14:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:52.584 03:14:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:52.584 03:14:26 -- common/autotest_common.sh@10 -- # set +x 00:13:52.843 03:14:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:52.843 03:14:27 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:52.843 03:14:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:52.843 03:14:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:52.843 03:14:27 -- common/autotest_common.sh@10 -- # set +x 00:13:53.102 03:14:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:53.102 03:14:27 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:53.102 03:14:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:53.102 03:14:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:53.102 03:14:27 -- common/autotest_common.sh@10 -- # set +x 00:13:53.361 03:14:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:53.361 03:14:27 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:53.361 03:14:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:53.361 03:14:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:53.361 03:14:27 -- common/autotest_common.sh@10 -- # set +x 00:13:53.620 03:14:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:53.620 03:14:28 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:53.620 03:14:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:53.620 03:14:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:53.620 03:14:28 -- common/autotest_common.sh@10 -- # set +x 00:13:54.188 03:14:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:54.188 03:14:28 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:54.188 03:14:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:54.188 03:14:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:54.188 03:14:28 -- common/autotest_common.sh@10 -- # set +x 00:13:54.447 03:14:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:54.447 03:14:28 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:54.447 03:14:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:54.447 03:14:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:54.447 03:14:28 -- common/autotest_common.sh@10 -- # set +x 00:13:54.706 03:14:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:54.706 03:14:29 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:54.706 03:14:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:54.706 03:14:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:54.706 03:14:29 -- common/autotest_common.sh@10 -- # set +x 00:13:54.965 03:14:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:54.965 03:14:29 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:54.965 03:14:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:54.965 03:14:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:54.965 03:14:29 -- common/autotest_common.sh@10 -- # set +x 00:13:55.534 03:14:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:55.534 03:14:29 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:55.534 03:14:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:55.534 03:14:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:55.534 03:14:29 -- common/autotest_common.sh@10 -- # set +x 00:13:55.822 03:14:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:55.823 03:14:30 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:55.823 03:14:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:55.823 03:14:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:55.823 03:14:30 -- common/autotest_common.sh@10 -- # set +x 00:13:56.081 03:14:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:56.081 03:14:30 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:56.081 03:14:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:56.082 03:14:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:56.082 03:14:30 -- common/autotest_common.sh@10 -- # set +x 00:13:56.340 03:14:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:56.340 03:14:30 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:56.340 03:14:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:56.340 03:14:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:56.340 03:14:30 -- common/autotest_common.sh@10 -- # set +x 00:13:56.619 03:14:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:56.619 03:14:31 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:56.619 03:14:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:56.619 03:14:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:56.619 03:14:31 -- common/autotest_common.sh@10 -- # set +x 00:13:57.186 03:14:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:57.186 03:14:31 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:57.186 03:14:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:57.186 03:14:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:57.186 03:14:31 -- common/autotest_common.sh@10 -- # set +x 00:13:57.186 Testing NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:13:57.445 03:14:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:57.445 03:14:31 -- target/connect_stress.sh@34 -- # kill -0 4026354 00:13:57.445 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (4026354) - No such process 00:13:57.445 03:14:31 -- target/connect_stress.sh@38 -- # wait 4026354 00:13:57.445 03:14:31 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:57.445 03:14:31 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:13:57.445 03:14:31 -- target/connect_stress.sh@43 -- # nvmftestfini 00:13:57.445 03:14:31 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:57.445 03:14:31 -- nvmf/common.sh@117 -- # sync 00:13:57.445 03:14:31 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:13:57.445 03:14:31 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:13:57.445 03:14:31 -- nvmf/common.sh@120 -- # set +e 00:13:57.445 03:14:31 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:57.445 03:14:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:13:57.445 rmmod nvme_rdma 00:13:57.445 rmmod nvme_fabrics 00:13:57.445 03:14:31 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:57.445 03:14:31 -- nvmf/common.sh@124 -- # set -e 00:13:57.445 03:14:31 -- nvmf/common.sh@125 -- # return 0 00:13:57.445 03:14:31 -- nvmf/common.sh@478 -- # '[' -n 4026148 ']' 00:13:57.445 03:14:31 -- nvmf/common.sh@479 -- # killprocess 4026148 00:13:57.445 03:14:31 -- common/autotest_common.sh@936 -- # '[' -z 4026148 ']' 00:13:57.445 03:14:31 -- common/autotest_common.sh@940 -- # kill -0 4026148 00:13:57.445 03:14:31 -- common/autotest_common.sh@941 -- # uname 00:13:57.445 03:14:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:57.445 03:14:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4026148 00:13:57.445 03:14:31 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:57.445 03:14:31 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:57.445 03:14:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4026148' 00:13:57.445 killing process with pid 4026148 00:13:57.445 03:14:31 -- common/autotest_common.sh@955 -- # kill 4026148 00:13:57.445 03:14:31 -- common/autotest_common.sh@960 -- # wait 4026148 00:13:57.445 [2024-04-25 03:14:31.843930] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:13:57.704 03:14:32 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:57.704 03:14:32 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:13:57.704 00:13:57.704 real 0m17.778s 00:13:57.704 user 0m41.675s 00:13:57.704 sys 0m8.606s 00:13:57.704 03:14:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:13:57.704 03:14:32 -- common/autotest_common.sh@10 -- # set +x 00:13:57.704 ************************************ 00:13:57.704 END TEST nvmf_connect_stress 00:13:57.704 ************************************ 00:13:57.705 03:14:32 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=rdma 00:13:57.705 03:14:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:57.705 03:14:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:57.705 03:14:32 -- common/autotest_common.sh@10 -- # set +x 00:13:57.705 ************************************ 00:13:57.705 START TEST nvmf_fused_ordering 00:13:57.705 ************************************ 00:13:57.705 03:14:32 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=rdma 00:13:57.964 * Looking for test storage... 00:13:57.964 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:13:57.964 03:14:32 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:13:57.964 03:14:32 -- nvmf/common.sh@7 -- # uname -s 00:13:57.964 03:14:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:57.964 03:14:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:57.964 03:14:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:57.964 03:14:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:57.964 03:14:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:57.964 03:14:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:57.964 03:14:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:57.964 03:14:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:57.964 03:14:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:57.964 03:14:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:57.964 03:14:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:13:57.964 03:14:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:13:57.964 03:14:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:57.964 03:14:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:57.964 03:14:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:57.964 03:14:32 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:57.964 03:14:32 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:13:57.964 03:14:32 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:57.964 03:14:32 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:57.964 03:14:32 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:57.964 03:14:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:57.964 03:14:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:57.964 03:14:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:57.964 03:14:32 -- paths/export.sh@5 -- # export PATH 00:13:57.964 03:14:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:57.964 03:14:32 -- nvmf/common.sh@47 -- # : 0 00:13:57.964 03:14:32 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:57.964 03:14:32 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:57.964 03:14:32 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:57.964 03:14:32 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:57.964 03:14:32 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:57.964 03:14:32 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:57.964 03:14:32 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:57.964 03:14:32 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:57.964 03:14:32 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:13:57.964 03:14:32 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:13:57.964 03:14:32 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:57.964 03:14:32 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:57.964 03:14:32 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:57.964 03:14:32 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:57.964 03:14:32 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:57.964 03:14:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:57.964 03:14:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:57.964 03:14:32 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:57.964 03:14:32 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:57.964 03:14:32 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:57.964 03:14:32 -- common/autotest_common.sh@10 -- # set +x 00:14:04.533 03:14:37 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:04.533 03:14:37 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:04.533 03:14:37 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:04.533 03:14:37 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:04.533 03:14:37 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:04.533 03:14:37 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:04.533 03:14:37 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:04.533 03:14:37 -- nvmf/common.sh@295 -- # net_devs=() 00:14:04.533 03:14:37 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:04.533 03:14:37 -- nvmf/common.sh@296 -- # e810=() 00:14:04.533 03:14:37 -- nvmf/common.sh@296 -- # local -ga e810 00:14:04.533 03:14:37 -- nvmf/common.sh@297 -- # x722=() 00:14:04.533 03:14:37 -- nvmf/common.sh@297 -- # local -ga x722 00:14:04.533 03:14:37 -- nvmf/common.sh@298 -- # mlx=() 00:14:04.533 03:14:38 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:04.533 03:14:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:04.533 03:14:38 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:04.533 03:14:38 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:04.533 03:14:38 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:04.533 03:14:38 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:04.533 03:14:38 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:04.534 03:14:38 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:04.534 03:14:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:04.534 03:14:38 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:04.534 03:14:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:04.534 03:14:38 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:04.534 03:14:38 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:04.534 03:14:38 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:14:04.534 03:14:38 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:14:04.534 03:14:38 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:14:04.534 03:14:38 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:14:04.534 03:14:38 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:14:04.534 03:14:38 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:14:04.534 03:14:38 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:04.534 03:14:38 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:04.534 03:14:38 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:14:04.534 Found 0000:af:00.0 (0x8086 - 0x159b) 00:14:04.534 03:14:38 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:04.534 03:14:38 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:04.534 03:14:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:04.534 03:14:38 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:04.534 03:14:38 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:04.534 03:14:38 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:04.534 03:14:38 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:04.534 03:14:38 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:14:04.534 Found 0000:af:00.1 (0x8086 - 0x159b) 00:14:04.534 03:14:38 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:04.534 03:14:38 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:04.534 03:14:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:04.534 03:14:38 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:04.534 03:14:38 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:04.534 03:14:38 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:04.534 03:14:38 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:04.534 03:14:38 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:14:04.534 03:14:38 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:14:04.534 03:14:38 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:14:04.534 03:14:38 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:14:04.534 03:14:38 -- nvmf/common.sh@377 -- # modinfo irdma 00:14:04.534 03:14:38 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:14:04.534 03:14:38 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:04.534 03:14:38 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:04.534 03:14:38 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:04.534 03:14:38 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:04.534 03:14:38 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:14:04.534 Found net devices under 0000:af:00.0: cvl_0_0 00:14:04.534 03:14:38 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:04.534 03:14:38 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:04.534 03:14:38 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:04.534 03:14:38 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:04.534 03:14:38 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:04.534 03:14:38 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:14:04.534 Found net devices under 0000:af:00.1: cvl_0_1 00:14:04.534 03:14:38 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:04.534 03:14:38 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:04.534 03:14:38 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:04.534 03:14:38 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:04.534 03:14:38 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:14:04.534 03:14:38 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:14:04.534 03:14:38 -- nvmf/common.sh@409 -- # rdma_device_init 00:14:04.534 03:14:38 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:14:04.534 03:14:38 -- nvmf/common.sh@58 -- # uname 00:14:04.534 03:14:38 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:14:04.534 03:14:38 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:14:04.534 03:14:38 -- nvmf/common.sh@63 -- # modprobe ib_core 00:14:04.534 03:14:38 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:14:04.534 03:14:38 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:14:04.534 03:14:38 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:14:04.534 03:14:38 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:14:04.534 03:14:38 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:14:04.534 03:14:38 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:14:04.534 03:14:38 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:14:04.534 03:14:38 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:14:04.534 03:14:38 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:04.534 03:14:38 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:04.534 03:14:38 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:04.534 03:14:38 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:04.534 03:14:38 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:04.534 03:14:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:04.534 03:14:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:04.534 03:14:38 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:14:04.534 03:14:38 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:14:04.534 03:14:38 -- nvmf/common.sh@105 -- # continue 2 00:14:04.534 03:14:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:04.534 03:14:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:04.534 03:14:38 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:14:04.534 03:14:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:04.534 03:14:38 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:14:04.534 03:14:38 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:14:04.534 03:14:38 -- nvmf/common.sh@105 -- # continue 2 00:14:04.534 03:14:38 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:04.534 03:14:38 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:14:04.534 03:14:38 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:14:04.534 03:14:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:14:04.534 03:14:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:04.534 03:14:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:04.534 03:14:38 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:14:04.534 03:14:38 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:14:04.534 03:14:38 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:14:04.534 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:14:04.534 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:14:04.534 altname enp175s0f0np0 00:14:04.534 altname ens801f0np0 00:14:04.534 inet 192.168.100.8/24 scope global cvl_0_0 00:14:04.534 valid_lft forever preferred_lft forever 00:14:04.534 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:14:04.534 valid_lft forever preferred_lft forever 00:14:04.534 03:14:38 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:04.534 03:14:38 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:14:04.534 03:14:38 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:14:04.534 03:14:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:14:04.534 03:14:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:04.534 03:14:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:04.534 03:14:38 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:14:04.534 03:14:38 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:14:04.534 03:14:38 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:14:04.534 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:14:04.534 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:14:04.534 altname enp175s0f1np1 00:14:04.534 altname ens801f1np1 00:14:04.534 inet 192.168.100.9/24 scope global cvl_0_1 00:14:04.534 valid_lft forever preferred_lft forever 00:14:04.534 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:14:04.534 valid_lft forever preferred_lft forever 00:14:04.534 03:14:38 -- nvmf/common.sh@411 -- # return 0 00:14:04.534 03:14:38 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:04.534 03:14:38 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:14:04.534 03:14:38 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:14:04.534 03:14:38 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:14:04.534 03:14:38 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:14:04.534 03:14:38 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:04.534 03:14:38 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:04.534 03:14:38 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:04.534 03:14:38 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:04.534 03:14:38 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:04.534 03:14:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:04.534 03:14:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:04.534 03:14:38 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:14:04.534 03:14:38 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:14:04.534 03:14:38 -- nvmf/common.sh@105 -- # continue 2 00:14:04.534 03:14:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:04.534 03:14:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:04.534 03:14:38 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:14:04.534 03:14:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:04.534 03:14:38 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:14:04.534 03:14:38 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:14:04.534 03:14:38 -- nvmf/common.sh@105 -- # continue 2 00:14:04.534 03:14:38 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:04.534 03:14:38 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:14:04.534 03:14:38 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:14:04.534 03:14:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:14:04.534 03:14:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:04.534 03:14:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:04.534 03:14:38 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:04.534 03:14:38 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:14:04.534 03:14:38 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:14:04.534 03:14:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:14:04.534 03:14:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:04.534 03:14:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:04.534 03:14:38 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:14:04.534 192.168.100.9' 00:14:04.534 03:14:38 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:14:04.534 192.168.100.9' 00:14:04.534 03:14:38 -- nvmf/common.sh@446 -- # head -n 1 00:14:04.535 03:14:38 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:14:04.535 03:14:38 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:14:04.535 192.168.100.9' 00:14:04.535 03:14:38 -- nvmf/common.sh@447 -- # tail -n +2 00:14:04.535 03:14:38 -- nvmf/common.sh@447 -- # head -n 1 00:14:04.535 03:14:38 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:14:04.535 03:14:38 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:14:04.535 03:14:38 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:14:04.535 03:14:38 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:14:04.535 03:14:38 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:14:04.535 03:14:38 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:14:04.535 03:14:38 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:14:04.535 03:14:38 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:04.535 03:14:38 -- common/autotest_common.sh@710 -- # xtrace_disable 00:14:04.535 03:14:38 -- common/autotest_common.sh@10 -- # set +x 00:14:04.535 03:14:38 -- nvmf/common.sh@470 -- # nvmfpid=4031522 00:14:04.535 03:14:38 -- nvmf/common.sh@471 -- # waitforlisten 4031522 00:14:04.535 03:14:38 -- common/autotest_common.sh@817 -- # '[' -z 4031522 ']' 00:14:04.535 03:14:38 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:04.535 03:14:38 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:04.535 03:14:38 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:04.535 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:04.535 03:14:38 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:14:04.535 03:14:38 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:04.535 03:14:38 -- common/autotest_common.sh@10 -- # set +x 00:14:04.535 [2024-04-25 03:14:38.249649] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:14:04.535 [2024-04-25 03:14:38.249693] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:04.535 EAL: No free 2048 kB hugepages reported on node 1 00:14:04.535 [2024-04-25 03:14:38.309938] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:04.535 [2024-04-25 03:14:38.384799] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:04.535 [2024-04-25 03:14:38.384832] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:04.535 [2024-04-25 03:14:38.384839] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:04.535 [2024-04-25 03:14:38.384845] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:04.535 [2024-04-25 03:14:38.384850] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:04.535 [2024-04-25 03:14:38.384875] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:04.535 03:14:39 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:04.535 03:14:39 -- common/autotest_common.sh@850 -- # return 0 00:14:04.535 03:14:39 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:04.535 03:14:39 -- common/autotest_common.sh@716 -- # xtrace_disable 00:14:04.535 03:14:39 -- common/autotest_common.sh@10 -- # set +x 00:14:04.794 03:14:39 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:04.794 03:14:39 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:14:04.794 03:14:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:04.794 03:14:39 -- common/autotest_common.sh@10 -- # set +x 00:14:04.794 [2024-04-25 03:14:39.086205] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0xe7ffe0/0xe7f620) succeed. 00:14:04.794 [2024-04-25 03:14:39.094507] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0xe81250/0xe7fba0) succeed. 00:14:04.794 [2024-04-25 03:14:39.094526] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:14:04.794 03:14:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:04.794 03:14:39 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:04.794 03:14:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:04.794 03:14:39 -- common/autotest_common.sh@10 -- # set +x 00:14:04.794 03:14:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:04.794 03:14:39 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:04.794 03:14:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:04.794 03:14:39 -- common/autotest_common.sh@10 -- # set +x 00:14:04.794 [2024-04-25 03:14:39.107921] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:04.794 03:14:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:04.794 03:14:39 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:04.794 03:14:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:04.794 03:14:39 -- common/autotest_common.sh@10 -- # set +x 00:14:04.794 NULL1 00:14:04.794 03:14:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:04.794 03:14:39 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:14:04.794 03:14:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:04.794 03:14:39 -- common/autotest_common.sh@10 -- # set +x 00:14:04.794 03:14:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:04.794 03:14:39 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:14:04.794 03:14:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:04.794 03:14:39 -- common/autotest_common.sh@10 -- # set +x 00:14:04.794 03:14:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:04.794 03:14:39 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:14:04.794 [2024-04-25 03:14:39.151188] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:14:04.794 [2024-04-25 03:14:39.151211] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4031577 ] 00:14:04.794 EAL: No free 2048 kB hugepages reported on node 1 00:14:05.054 Attached to nqn.2016-06.io.spdk:cnode1 00:14:05.054 Namespace ID: 1 size: 1GB 00:14:05.054 fused_ordering(0) 00:14:05.054 fused_ordering(1) 00:14:05.054 fused_ordering(2) 00:14:05.054 fused_ordering(3) 00:14:05.054 fused_ordering(4) 00:14:05.054 fused_ordering(5) 00:14:05.054 fused_ordering(6) 00:14:05.054 fused_ordering(7) 00:14:05.054 fused_ordering(8) 00:14:05.054 fused_ordering(9) 00:14:05.054 fused_ordering(10) 00:14:05.054 fused_ordering(11) 00:14:05.054 fused_ordering(12) 00:14:05.054 fused_ordering(13) 00:14:05.054 fused_ordering(14) 00:14:05.054 fused_ordering(15) 00:14:05.054 fused_ordering(16) 00:14:05.054 fused_ordering(17) 00:14:05.054 fused_ordering(18) 00:14:05.054 fused_ordering(19) 00:14:05.054 fused_ordering(20) 00:14:05.054 fused_ordering(21) 00:14:05.054 fused_ordering(22) 00:14:05.054 fused_ordering(23) 00:14:05.054 fused_ordering(24) 00:14:05.054 fused_ordering(25) 00:14:05.054 fused_ordering(26) 00:14:05.054 fused_ordering(27) 00:14:05.054 fused_ordering(28) 00:14:05.054 fused_ordering(29) 00:14:05.054 fused_ordering(30) 00:14:05.054 fused_ordering(31) 00:14:05.054 fused_ordering(32) 00:14:05.054 fused_ordering(33) 00:14:05.054 fused_ordering(34) 00:14:05.054 fused_ordering(35) 00:14:05.054 fused_ordering(36) 00:14:05.054 fused_ordering(37) 00:14:05.054 fused_ordering(38) 00:14:05.054 fused_ordering(39) 00:14:05.054 fused_ordering(40) 00:14:05.054 fused_ordering(41) 00:14:05.054 fused_ordering(42) 00:14:05.054 fused_ordering(43) 00:14:05.054 fused_ordering(44) 00:14:05.054 fused_ordering(45) 00:14:05.054 fused_ordering(46) 00:14:05.054 fused_ordering(47) 00:14:05.054 fused_ordering(48) 00:14:05.054 fused_ordering(49) 00:14:05.054 fused_ordering(50) 00:14:05.054 fused_ordering(51) 00:14:05.054 fused_ordering(52) 00:14:05.054 fused_ordering(53) 00:14:05.054 fused_ordering(54) 00:14:05.054 fused_ordering(55) 00:14:05.054 fused_ordering(56) 00:14:05.054 fused_ordering(57) 00:14:05.054 fused_ordering(58) 00:14:05.054 fused_ordering(59) 00:14:05.054 fused_ordering(60) 00:14:05.054 fused_ordering(61) 00:14:05.054 fused_ordering(62) 00:14:05.054 fused_ordering(63) 00:14:05.054 fused_ordering(64) 00:14:05.054 fused_ordering(65) 00:14:05.054 fused_ordering(66) 00:14:05.054 fused_ordering(67) 00:14:05.054 fused_ordering(68) 00:14:05.054 fused_ordering(69) 00:14:05.054 fused_ordering(70) 00:14:05.054 fused_ordering(71) 00:14:05.054 fused_ordering(72) 00:14:05.054 fused_ordering(73) 00:14:05.054 fused_ordering(74) 00:14:05.054 fused_ordering(75) 00:14:05.054 fused_ordering(76) 00:14:05.054 fused_ordering(77) 00:14:05.054 fused_ordering(78) 00:14:05.054 fused_ordering(79) 00:14:05.054 fused_ordering(80) 00:14:05.054 fused_ordering(81) 00:14:05.054 fused_ordering(82) 00:14:05.054 fused_ordering(83) 00:14:05.054 fused_ordering(84) 00:14:05.054 fused_ordering(85) 00:14:05.054 fused_ordering(86) 00:14:05.054 fused_ordering(87) 00:14:05.054 fused_ordering(88) 00:14:05.054 fused_ordering(89) 00:14:05.054 fused_ordering(90) 00:14:05.054 fused_ordering(91) 00:14:05.054 fused_ordering(92) 00:14:05.054 fused_ordering(93) 00:14:05.054 fused_ordering(94) 00:14:05.054 fused_ordering(95) 00:14:05.054 fused_ordering(96) 00:14:05.054 fused_ordering(97) 00:14:05.054 fused_ordering(98) 00:14:05.054 fused_ordering(99) 00:14:05.054 fused_ordering(100) 00:14:05.054 fused_ordering(101) 00:14:05.055 fused_ordering(102) 00:14:05.055 fused_ordering(103) 00:14:05.055 fused_ordering(104) 00:14:05.055 fused_ordering(105) 00:14:05.055 fused_ordering(106) 00:14:05.055 fused_ordering(107) 00:14:05.055 fused_ordering(108) 00:14:05.055 fused_ordering(109) 00:14:05.055 fused_ordering(110) 00:14:05.055 fused_ordering(111) 00:14:05.055 fused_ordering(112) 00:14:05.055 fused_ordering(113) 00:14:05.055 fused_ordering(114) 00:14:05.055 fused_ordering(115) 00:14:05.055 fused_ordering(116) 00:14:05.055 fused_ordering(117) 00:14:05.055 fused_ordering(118) 00:14:05.055 fused_ordering(119) 00:14:05.055 fused_ordering(120) 00:14:05.055 fused_ordering(121) 00:14:05.055 fused_ordering(122) 00:14:05.055 fused_ordering(123) 00:14:05.055 fused_ordering(124) 00:14:05.055 fused_ordering(125) 00:14:05.055 fused_ordering(126) 00:14:05.055 fused_ordering(127) 00:14:05.055 fused_ordering(128) 00:14:05.055 fused_ordering(129) 00:14:05.055 fused_ordering(130) 00:14:05.055 fused_ordering(131) 00:14:05.055 fused_ordering(132) 00:14:05.055 fused_ordering(133) 00:14:05.055 fused_ordering(134) 00:14:05.055 fused_ordering(135) 00:14:05.055 fused_ordering(136) 00:14:05.055 fused_ordering(137) 00:14:05.055 fused_ordering(138) 00:14:05.055 fused_ordering(139) 00:14:05.055 fused_ordering(140) 00:14:05.055 fused_ordering(141) 00:14:05.055 fused_ordering(142) 00:14:05.055 fused_ordering(143) 00:14:05.055 fused_ordering(144) 00:14:05.055 fused_ordering(145) 00:14:05.055 fused_ordering(146) 00:14:05.055 fused_ordering(147) 00:14:05.055 fused_ordering(148) 00:14:05.055 fused_ordering(149) 00:14:05.055 fused_ordering(150) 00:14:05.055 fused_ordering(151) 00:14:05.055 fused_ordering(152) 00:14:05.055 fused_ordering(153) 00:14:05.055 fused_ordering(154) 00:14:05.055 fused_ordering(155) 00:14:05.055 fused_ordering(156) 00:14:05.055 fused_ordering(157) 00:14:05.055 fused_ordering(158) 00:14:05.055 fused_ordering(159) 00:14:05.055 fused_ordering(160) 00:14:05.055 fused_ordering(161) 00:14:05.055 fused_ordering(162) 00:14:05.055 fused_ordering(163) 00:14:05.055 fused_ordering(164) 00:14:05.055 fused_ordering(165) 00:14:05.055 fused_ordering(166) 00:14:05.055 fused_ordering(167) 00:14:05.055 fused_ordering(168) 00:14:05.055 fused_ordering(169) 00:14:05.055 fused_ordering(170) 00:14:05.055 fused_ordering(171) 00:14:05.055 fused_ordering(172) 00:14:05.055 fused_ordering(173) 00:14:05.055 fused_ordering(174) 00:14:05.055 fused_ordering(175) 00:14:05.055 fused_ordering(176) 00:14:05.055 fused_ordering(177) 00:14:05.055 fused_ordering(178) 00:14:05.055 fused_ordering(179) 00:14:05.055 fused_ordering(180) 00:14:05.055 fused_ordering(181) 00:14:05.055 fused_ordering(182) 00:14:05.055 fused_ordering(183) 00:14:05.055 fused_ordering(184) 00:14:05.055 fused_ordering(185) 00:14:05.055 fused_ordering(186) 00:14:05.055 fused_ordering(187) 00:14:05.055 fused_ordering(188) 00:14:05.055 fused_ordering(189) 00:14:05.055 fused_ordering(190) 00:14:05.055 fused_ordering(191) 00:14:05.055 fused_ordering(192) 00:14:05.055 fused_ordering(193) 00:14:05.055 fused_ordering(194) 00:14:05.055 fused_ordering(195) 00:14:05.055 fused_ordering(196) 00:14:05.055 fused_ordering(197) 00:14:05.055 fused_ordering(198) 00:14:05.055 fused_ordering(199) 00:14:05.055 fused_ordering(200) 00:14:05.055 fused_ordering(201) 00:14:05.055 fused_ordering(202) 00:14:05.055 fused_ordering(203) 00:14:05.055 fused_ordering(204) 00:14:05.055 fused_ordering(205) 00:14:05.055 fused_ordering(206) 00:14:05.055 fused_ordering(207) 00:14:05.055 fused_ordering(208) 00:14:05.055 fused_ordering(209) 00:14:05.055 fused_ordering(210) 00:14:05.055 fused_ordering(211) 00:14:05.055 fused_ordering(212) 00:14:05.055 fused_ordering(213) 00:14:05.055 fused_ordering(214) 00:14:05.055 fused_ordering(215) 00:14:05.055 fused_ordering(216) 00:14:05.055 fused_ordering(217) 00:14:05.055 fused_ordering(218) 00:14:05.055 fused_ordering(219) 00:14:05.055 fused_ordering(220) 00:14:05.055 fused_ordering(221) 00:14:05.055 fused_ordering(222) 00:14:05.055 fused_ordering(223) 00:14:05.055 fused_ordering(224) 00:14:05.055 fused_ordering(225) 00:14:05.055 fused_ordering(226) 00:14:05.055 fused_ordering(227) 00:14:05.055 fused_ordering(228) 00:14:05.055 fused_ordering(229) 00:14:05.055 fused_ordering(230) 00:14:05.055 fused_ordering(231) 00:14:05.055 fused_ordering(232) 00:14:05.055 fused_ordering(233) 00:14:05.055 fused_ordering(234) 00:14:05.055 fused_ordering(235) 00:14:05.055 fused_ordering(236) 00:14:05.055 fused_ordering(237) 00:14:05.055 fused_ordering(238) 00:14:05.055 fused_ordering(239) 00:14:05.055 fused_ordering(240) 00:14:05.055 fused_ordering(241) 00:14:05.055 fused_ordering(242) 00:14:05.055 fused_ordering(243) 00:14:05.055 fused_ordering(244) 00:14:05.055 fused_ordering(245) 00:14:05.055 fused_ordering(246) 00:14:05.055 fused_ordering(247) 00:14:05.055 fused_ordering(248) 00:14:05.055 fused_ordering(249) 00:14:05.055 fused_ordering(250) 00:14:05.055 fused_ordering(251) 00:14:05.055 fused_ordering(252) 00:14:05.055 fused_ordering(253) 00:14:05.055 fused_ordering(254) 00:14:05.055 fused_ordering(255) 00:14:05.055 fused_ordering(256) 00:14:05.055 fused_ordering(257) 00:14:05.055 fused_ordering(258) 00:14:05.055 fused_ordering(259) 00:14:05.055 fused_ordering(260) 00:14:05.055 fused_ordering(261) 00:14:05.055 fused_ordering(262) 00:14:05.055 fused_ordering(263) 00:14:05.055 fused_ordering(264) 00:14:05.055 fused_ordering(265) 00:14:05.055 fused_ordering(266) 00:14:05.055 fused_ordering(267) 00:14:05.055 fused_ordering(268) 00:14:05.055 fused_ordering(269) 00:14:05.055 fused_ordering(270) 00:14:05.055 fused_ordering(271) 00:14:05.055 fused_ordering(272) 00:14:05.055 fused_ordering(273) 00:14:05.055 fused_ordering(274) 00:14:05.055 fused_ordering(275) 00:14:05.055 fused_ordering(276) 00:14:05.055 fused_ordering(277) 00:14:05.055 fused_ordering(278) 00:14:05.055 fused_ordering(279) 00:14:05.055 fused_ordering(280) 00:14:05.055 fused_ordering(281) 00:14:05.055 fused_ordering(282) 00:14:05.055 fused_ordering(283) 00:14:05.055 fused_ordering(284) 00:14:05.055 fused_ordering(285) 00:14:05.055 fused_ordering(286) 00:14:05.055 fused_ordering(287) 00:14:05.055 fused_ordering(288) 00:14:05.055 fused_ordering(289) 00:14:05.055 fused_ordering(290) 00:14:05.055 fused_ordering(291) 00:14:05.055 fused_ordering(292) 00:14:05.055 fused_ordering(293) 00:14:05.055 fused_ordering(294) 00:14:05.055 fused_ordering(295) 00:14:05.055 fused_ordering(296) 00:14:05.055 fused_ordering(297) 00:14:05.055 fused_ordering(298) 00:14:05.055 fused_ordering(299) 00:14:05.055 fused_ordering(300) 00:14:05.055 fused_ordering(301) 00:14:05.055 fused_ordering(302) 00:14:05.055 fused_ordering(303) 00:14:05.055 fused_ordering(304) 00:14:05.055 fused_ordering(305) 00:14:05.055 fused_ordering(306) 00:14:05.055 fused_ordering(307) 00:14:05.055 fused_ordering(308) 00:14:05.055 fused_ordering(309) 00:14:05.055 fused_ordering(310) 00:14:05.055 fused_ordering(311) 00:14:05.055 fused_ordering(312) 00:14:05.055 fused_ordering(313) 00:14:05.055 fused_ordering(314) 00:14:05.055 fused_ordering(315) 00:14:05.055 fused_ordering(316) 00:14:05.055 fused_ordering(317) 00:14:05.055 fused_ordering(318) 00:14:05.055 fused_ordering(319) 00:14:05.055 fused_ordering(320) 00:14:05.055 fused_ordering(321) 00:14:05.055 fused_ordering(322) 00:14:05.055 fused_ordering(323) 00:14:05.055 fused_ordering(324) 00:14:05.055 fused_ordering(325) 00:14:05.055 fused_ordering(326) 00:14:05.055 fused_ordering(327) 00:14:05.055 fused_ordering(328) 00:14:05.055 fused_ordering(329) 00:14:05.055 fused_ordering(330) 00:14:05.055 fused_ordering(331) 00:14:05.055 fused_ordering(332) 00:14:05.055 fused_ordering(333) 00:14:05.055 fused_ordering(334) 00:14:05.055 fused_ordering(335) 00:14:05.055 fused_ordering(336) 00:14:05.055 fused_ordering(337) 00:14:05.055 fused_ordering(338) 00:14:05.055 fused_ordering(339) 00:14:05.055 fused_ordering(340) 00:14:05.055 fused_ordering(341) 00:14:05.055 fused_ordering(342) 00:14:05.055 fused_ordering(343) 00:14:05.055 fused_ordering(344) 00:14:05.055 fused_ordering(345) 00:14:05.055 fused_ordering(346) 00:14:05.055 fused_ordering(347) 00:14:05.055 fused_ordering(348) 00:14:05.055 fused_ordering(349) 00:14:05.055 fused_ordering(350) 00:14:05.055 fused_ordering(351) 00:14:05.055 fused_ordering(352) 00:14:05.055 fused_ordering(353) 00:14:05.055 fused_ordering(354) 00:14:05.055 fused_ordering(355) 00:14:05.055 fused_ordering(356) 00:14:05.055 fused_ordering(357) 00:14:05.055 fused_ordering(358) 00:14:05.055 fused_ordering(359) 00:14:05.055 fused_ordering(360) 00:14:05.055 fused_ordering(361) 00:14:05.055 fused_ordering(362) 00:14:05.055 fused_ordering(363) 00:14:05.055 fused_ordering(364) 00:14:05.055 fused_ordering(365) 00:14:05.055 fused_ordering(366) 00:14:05.055 fused_ordering(367) 00:14:05.055 fused_ordering(368) 00:14:05.055 fused_ordering(369) 00:14:05.055 fused_ordering(370) 00:14:05.055 fused_ordering(371) 00:14:05.056 fused_ordering(372) 00:14:05.056 fused_ordering(373) 00:14:05.056 fused_ordering(374) 00:14:05.056 fused_ordering(375) 00:14:05.056 fused_ordering(376) 00:14:05.056 fused_ordering(377) 00:14:05.056 fused_ordering(378) 00:14:05.056 fused_ordering(379) 00:14:05.056 fused_ordering(380) 00:14:05.056 fused_ordering(381) 00:14:05.056 fused_ordering(382) 00:14:05.056 fused_ordering(383) 00:14:05.056 fused_ordering(384) 00:14:05.056 fused_ordering(385) 00:14:05.056 fused_ordering(386) 00:14:05.056 fused_ordering(387) 00:14:05.056 fused_ordering(388) 00:14:05.056 fused_ordering(389) 00:14:05.056 fused_ordering(390) 00:14:05.056 fused_ordering(391) 00:14:05.056 fused_ordering(392) 00:14:05.056 fused_ordering(393) 00:14:05.056 fused_ordering(394) 00:14:05.056 fused_ordering(395) 00:14:05.056 fused_ordering(396) 00:14:05.056 fused_ordering(397) 00:14:05.056 fused_ordering(398) 00:14:05.056 fused_ordering(399) 00:14:05.056 fused_ordering(400) 00:14:05.056 fused_ordering(401) 00:14:05.056 fused_ordering(402) 00:14:05.056 fused_ordering(403) 00:14:05.056 fused_ordering(404) 00:14:05.056 fused_ordering(405) 00:14:05.056 fused_ordering(406) 00:14:05.056 fused_ordering(407) 00:14:05.056 fused_ordering(408) 00:14:05.056 fused_ordering(409) 00:14:05.056 fused_ordering(410) 00:14:05.056 fused_ordering(411) 00:14:05.056 fused_ordering(412) 00:14:05.056 fused_ordering(413) 00:14:05.056 fused_ordering(414) 00:14:05.056 fused_ordering(415) 00:14:05.056 fused_ordering(416) 00:14:05.056 fused_ordering(417) 00:14:05.056 fused_ordering(418) 00:14:05.056 fused_ordering(419) 00:14:05.056 fused_ordering(420) 00:14:05.056 fused_ordering(421) 00:14:05.056 fused_ordering(422) 00:14:05.056 fused_ordering(423) 00:14:05.056 fused_ordering(424) 00:14:05.056 fused_ordering(425) 00:14:05.056 fused_ordering(426) 00:14:05.056 fused_ordering(427) 00:14:05.056 fused_ordering(428) 00:14:05.056 fused_ordering(429) 00:14:05.056 fused_ordering(430) 00:14:05.056 fused_ordering(431) 00:14:05.056 fused_ordering(432) 00:14:05.056 fused_ordering(433) 00:14:05.056 fused_ordering(434) 00:14:05.056 fused_ordering(435) 00:14:05.056 fused_ordering(436) 00:14:05.056 fused_ordering(437) 00:14:05.056 fused_ordering(438) 00:14:05.056 fused_ordering(439) 00:14:05.056 fused_ordering(440) 00:14:05.056 fused_ordering(441) 00:14:05.056 fused_ordering(442) 00:14:05.056 fused_ordering(443) 00:14:05.056 fused_ordering(444) 00:14:05.056 fused_ordering(445) 00:14:05.056 fused_ordering(446) 00:14:05.056 fused_ordering(447) 00:14:05.056 fused_ordering(448) 00:14:05.056 fused_ordering(449) 00:14:05.056 fused_ordering(450) 00:14:05.056 fused_ordering(451) 00:14:05.056 fused_ordering(452) 00:14:05.056 fused_ordering(453) 00:14:05.056 fused_ordering(454) 00:14:05.056 fused_ordering(455) 00:14:05.056 fused_ordering(456) 00:14:05.056 fused_ordering(457) 00:14:05.056 fused_ordering(458) 00:14:05.056 fused_ordering(459) 00:14:05.056 fused_ordering(460) 00:14:05.056 fused_ordering(461) 00:14:05.056 fused_ordering(462) 00:14:05.056 fused_ordering(463) 00:14:05.056 fused_ordering(464) 00:14:05.056 fused_ordering(465) 00:14:05.056 fused_ordering(466) 00:14:05.056 fused_ordering(467) 00:14:05.056 fused_ordering(468) 00:14:05.056 fused_ordering(469) 00:14:05.056 fused_ordering(470) 00:14:05.056 fused_ordering(471) 00:14:05.056 fused_ordering(472) 00:14:05.056 fused_ordering(473) 00:14:05.056 fused_ordering(474) 00:14:05.056 fused_ordering(475) 00:14:05.056 fused_ordering(476) 00:14:05.056 fused_ordering(477) 00:14:05.056 fused_ordering(478) 00:14:05.056 fused_ordering(479) 00:14:05.056 fused_ordering(480) 00:14:05.056 fused_ordering(481) 00:14:05.056 fused_ordering(482) 00:14:05.056 fused_ordering(483) 00:14:05.056 fused_ordering(484) 00:14:05.056 fused_ordering(485) 00:14:05.056 fused_ordering(486) 00:14:05.056 fused_ordering(487) 00:14:05.056 fused_ordering(488) 00:14:05.056 fused_ordering(489) 00:14:05.056 fused_ordering(490) 00:14:05.056 fused_ordering(491) 00:14:05.056 fused_ordering(492) 00:14:05.056 fused_ordering(493) 00:14:05.056 fused_ordering(494) 00:14:05.056 fused_ordering(495) 00:14:05.056 fused_ordering(496) 00:14:05.056 fused_ordering(497) 00:14:05.056 fused_ordering(498) 00:14:05.056 fused_ordering(499) 00:14:05.056 fused_ordering(500) 00:14:05.056 fused_ordering(501) 00:14:05.056 fused_ordering(502) 00:14:05.056 fused_ordering(503) 00:14:05.056 fused_ordering(504) 00:14:05.056 fused_ordering(505) 00:14:05.056 fused_ordering(506) 00:14:05.056 fused_ordering(507) 00:14:05.056 fused_ordering(508) 00:14:05.056 fused_ordering(509) 00:14:05.056 fused_ordering(510) 00:14:05.056 fused_ordering(511) 00:14:05.056 fused_ordering(512) 00:14:05.056 fused_ordering(513) 00:14:05.056 fused_ordering(514) 00:14:05.056 fused_ordering(515) 00:14:05.056 fused_ordering(516) 00:14:05.056 fused_ordering(517) 00:14:05.056 fused_ordering(518) 00:14:05.056 fused_ordering(519) 00:14:05.056 fused_ordering(520) 00:14:05.056 fused_ordering(521) 00:14:05.056 fused_ordering(522) 00:14:05.056 fused_ordering(523) 00:14:05.056 fused_ordering(524) 00:14:05.056 fused_ordering(525) 00:14:05.056 fused_ordering(526) 00:14:05.056 fused_ordering(527) 00:14:05.056 fused_ordering(528) 00:14:05.056 fused_ordering(529) 00:14:05.056 fused_ordering(530) 00:14:05.056 fused_ordering(531) 00:14:05.056 fused_ordering(532) 00:14:05.056 fused_ordering(533) 00:14:05.056 fused_ordering(534) 00:14:05.056 fused_ordering(535) 00:14:05.056 fused_ordering(536) 00:14:05.056 fused_ordering(537) 00:14:05.056 fused_ordering(538) 00:14:05.056 fused_ordering(539) 00:14:05.056 fused_ordering(540) 00:14:05.056 fused_ordering(541) 00:14:05.056 fused_ordering(542) 00:14:05.056 fused_ordering(543) 00:14:05.056 fused_ordering(544) 00:14:05.056 fused_ordering(545) 00:14:05.056 fused_ordering(546) 00:14:05.056 fused_ordering(547) 00:14:05.056 fused_ordering(548) 00:14:05.056 fused_ordering(549) 00:14:05.056 fused_ordering(550) 00:14:05.056 fused_ordering(551) 00:14:05.056 fused_ordering(552) 00:14:05.056 fused_ordering(553) 00:14:05.056 fused_ordering(554) 00:14:05.056 fused_ordering(555) 00:14:05.056 fused_ordering(556) 00:14:05.056 fused_ordering(557) 00:14:05.056 fused_ordering(558) 00:14:05.056 fused_ordering(559) 00:14:05.056 fused_ordering(560) 00:14:05.056 fused_ordering(561) 00:14:05.056 fused_ordering(562) 00:14:05.056 fused_ordering(563) 00:14:05.056 fused_ordering(564) 00:14:05.056 fused_ordering(565) 00:14:05.056 fused_ordering(566) 00:14:05.056 fused_ordering(567) 00:14:05.056 fused_ordering(568) 00:14:05.056 fused_ordering(569) 00:14:05.056 fused_ordering(570) 00:14:05.056 fused_ordering(571) 00:14:05.056 fused_ordering(572) 00:14:05.056 fused_ordering(573) 00:14:05.056 fused_ordering(574) 00:14:05.056 fused_ordering(575) 00:14:05.056 fused_ordering(576) 00:14:05.056 fused_ordering(577) 00:14:05.056 fused_ordering(578) 00:14:05.056 fused_ordering(579) 00:14:05.056 fused_ordering(580) 00:14:05.056 fused_ordering(581) 00:14:05.056 fused_ordering(582) 00:14:05.056 fused_ordering(583) 00:14:05.056 fused_ordering(584) 00:14:05.056 fused_ordering(585) 00:14:05.056 fused_ordering(586) 00:14:05.056 fused_ordering(587) 00:14:05.056 fused_ordering(588) 00:14:05.056 fused_ordering(589) 00:14:05.056 fused_ordering(590) 00:14:05.056 fused_ordering(591) 00:14:05.056 fused_ordering(592) 00:14:05.056 fused_ordering(593) 00:14:05.056 fused_ordering(594) 00:14:05.056 fused_ordering(595) 00:14:05.056 fused_ordering(596) 00:14:05.056 fused_ordering(597) 00:14:05.056 fused_ordering(598) 00:14:05.056 fused_ordering(599) 00:14:05.056 fused_ordering(600) 00:14:05.056 fused_ordering(601) 00:14:05.056 fused_ordering(602) 00:14:05.056 fused_ordering(603) 00:14:05.056 fused_ordering(604) 00:14:05.056 fused_ordering(605) 00:14:05.056 fused_ordering(606) 00:14:05.056 fused_ordering(607) 00:14:05.056 fused_ordering(608) 00:14:05.056 fused_ordering(609) 00:14:05.056 fused_ordering(610) 00:14:05.056 fused_ordering(611) 00:14:05.056 fused_ordering(612) 00:14:05.056 fused_ordering(613) 00:14:05.056 fused_ordering(614) 00:14:05.056 fused_ordering(615) 00:14:05.316 fused_ordering(616) 00:14:05.316 fused_ordering(617) 00:14:05.316 fused_ordering(618) 00:14:05.316 fused_ordering(619) 00:14:05.316 fused_ordering(620) 00:14:05.316 fused_ordering(621) 00:14:05.316 fused_ordering(622) 00:14:05.316 fused_ordering(623) 00:14:05.316 fused_ordering(624) 00:14:05.316 fused_ordering(625) 00:14:05.316 fused_ordering(626) 00:14:05.316 fused_ordering(627) 00:14:05.316 fused_ordering(628) 00:14:05.316 fused_ordering(629) 00:14:05.316 fused_ordering(630) 00:14:05.316 fused_ordering(631) 00:14:05.316 fused_ordering(632) 00:14:05.316 fused_ordering(633) 00:14:05.316 fused_ordering(634) 00:14:05.316 fused_ordering(635) 00:14:05.316 fused_ordering(636) 00:14:05.316 fused_ordering(637) 00:14:05.316 fused_ordering(638) 00:14:05.316 fused_ordering(639) 00:14:05.316 fused_ordering(640) 00:14:05.316 fused_ordering(641) 00:14:05.316 fused_ordering(642) 00:14:05.316 fused_ordering(643) 00:14:05.316 fused_ordering(644) 00:14:05.316 fused_ordering(645) 00:14:05.316 fused_ordering(646) 00:14:05.316 fused_ordering(647) 00:14:05.316 fused_ordering(648) 00:14:05.316 fused_ordering(649) 00:14:05.316 fused_ordering(650) 00:14:05.316 fused_ordering(651) 00:14:05.316 fused_ordering(652) 00:14:05.316 fused_ordering(653) 00:14:05.316 fused_ordering(654) 00:14:05.316 fused_ordering(655) 00:14:05.316 fused_ordering(656) 00:14:05.316 fused_ordering(657) 00:14:05.316 fused_ordering(658) 00:14:05.316 fused_ordering(659) 00:14:05.316 fused_ordering(660) 00:14:05.316 fused_ordering(661) 00:14:05.316 fused_ordering(662) 00:14:05.316 fused_ordering(663) 00:14:05.316 fused_ordering(664) 00:14:05.316 fused_ordering(665) 00:14:05.316 fused_ordering(666) 00:14:05.316 fused_ordering(667) 00:14:05.316 fused_ordering(668) 00:14:05.316 fused_ordering(669) 00:14:05.316 fused_ordering(670) 00:14:05.316 fused_ordering(671) 00:14:05.316 fused_ordering(672) 00:14:05.316 fused_ordering(673) 00:14:05.316 fused_ordering(674) 00:14:05.316 fused_ordering(675) 00:14:05.316 fused_ordering(676) 00:14:05.316 fused_ordering(677) 00:14:05.316 fused_ordering(678) 00:14:05.316 fused_ordering(679) 00:14:05.316 fused_ordering(680) 00:14:05.316 fused_ordering(681) 00:14:05.316 fused_ordering(682) 00:14:05.316 fused_ordering(683) 00:14:05.316 fused_ordering(684) 00:14:05.316 fused_ordering(685) 00:14:05.316 fused_ordering(686) 00:14:05.316 fused_ordering(687) 00:14:05.316 fused_ordering(688) 00:14:05.316 fused_ordering(689) 00:14:05.316 fused_ordering(690) 00:14:05.316 fused_ordering(691) 00:14:05.316 fused_ordering(692) 00:14:05.316 fused_ordering(693) 00:14:05.316 fused_ordering(694) 00:14:05.316 fused_ordering(695) 00:14:05.316 fused_ordering(696) 00:14:05.316 fused_ordering(697) 00:14:05.316 fused_ordering(698) 00:14:05.316 fused_ordering(699) 00:14:05.316 fused_ordering(700) 00:14:05.316 fused_ordering(701) 00:14:05.316 fused_ordering(702) 00:14:05.316 fused_ordering(703) 00:14:05.316 fused_ordering(704) 00:14:05.316 fused_ordering(705) 00:14:05.316 fused_ordering(706) 00:14:05.316 fused_ordering(707) 00:14:05.316 fused_ordering(708) 00:14:05.316 fused_ordering(709) 00:14:05.316 fused_ordering(710) 00:14:05.316 fused_ordering(711) 00:14:05.316 fused_ordering(712) 00:14:05.316 fused_ordering(713) 00:14:05.316 fused_ordering(714) 00:14:05.316 fused_ordering(715) 00:14:05.316 fused_ordering(716) 00:14:05.316 fused_ordering(717) 00:14:05.316 fused_ordering(718) 00:14:05.316 fused_ordering(719) 00:14:05.316 fused_ordering(720) 00:14:05.316 fused_ordering(721) 00:14:05.316 fused_ordering(722) 00:14:05.316 fused_ordering(723) 00:14:05.316 fused_ordering(724) 00:14:05.316 fused_ordering(725) 00:14:05.316 fused_ordering(726) 00:14:05.316 fused_ordering(727) 00:14:05.316 fused_ordering(728) 00:14:05.316 fused_ordering(729) 00:14:05.316 fused_ordering(730) 00:14:05.316 fused_ordering(731) 00:14:05.316 fused_ordering(732) 00:14:05.316 fused_ordering(733) 00:14:05.316 fused_ordering(734) 00:14:05.316 fused_ordering(735) 00:14:05.316 fused_ordering(736) 00:14:05.316 fused_ordering(737) 00:14:05.316 fused_ordering(738) 00:14:05.316 fused_ordering(739) 00:14:05.316 fused_ordering(740) 00:14:05.316 fused_ordering(741) 00:14:05.316 fused_ordering(742) 00:14:05.316 fused_ordering(743) 00:14:05.316 fused_ordering(744) 00:14:05.316 fused_ordering(745) 00:14:05.316 fused_ordering(746) 00:14:05.316 fused_ordering(747) 00:14:05.316 fused_ordering(748) 00:14:05.316 fused_ordering(749) 00:14:05.316 fused_ordering(750) 00:14:05.316 fused_ordering(751) 00:14:05.316 fused_ordering(752) 00:14:05.316 fused_ordering(753) 00:14:05.316 fused_ordering(754) 00:14:05.316 fused_ordering(755) 00:14:05.316 fused_ordering(756) 00:14:05.316 fused_ordering(757) 00:14:05.316 fused_ordering(758) 00:14:05.316 fused_ordering(759) 00:14:05.316 fused_ordering(760) 00:14:05.316 fused_ordering(761) 00:14:05.316 fused_ordering(762) 00:14:05.316 fused_ordering(763) 00:14:05.316 fused_ordering(764) 00:14:05.316 fused_ordering(765) 00:14:05.316 fused_ordering(766) 00:14:05.316 fused_ordering(767) 00:14:05.316 fused_ordering(768) 00:14:05.316 fused_ordering(769) 00:14:05.316 fused_ordering(770) 00:14:05.316 fused_ordering(771) 00:14:05.316 fused_ordering(772) 00:14:05.316 fused_ordering(773) 00:14:05.316 fused_ordering(774) 00:14:05.316 fused_ordering(775) 00:14:05.316 fused_ordering(776) 00:14:05.317 fused_ordering(777) 00:14:05.317 fused_ordering(778) 00:14:05.317 fused_ordering(779) 00:14:05.317 fused_ordering(780) 00:14:05.317 fused_ordering(781) 00:14:05.317 fused_ordering(782) 00:14:05.317 fused_ordering(783) 00:14:05.317 fused_ordering(784) 00:14:05.317 fused_ordering(785) 00:14:05.317 fused_ordering(786) 00:14:05.317 fused_ordering(787) 00:14:05.317 fused_ordering(788) 00:14:05.317 fused_ordering(789) 00:14:05.317 fused_ordering(790) 00:14:05.317 fused_ordering(791) 00:14:05.317 fused_ordering(792) 00:14:05.317 fused_ordering(793) 00:14:05.317 fused_ordering(794) 00:14:05.317 fused_ordering(795) 00:14:05.317 fused_ordering(796) 00:14:05.317 fused_ordering(797) 00:14:05.317 fused_ordering(798) 00:14:05.317 fused_ordering(799) 00:14:05.317 fused_ordering(800) 00:14:05.317 fused_ordering(801) 00:14:05.317 fused_ordering(802) 00:14:05.317 fused_ordering(803) 00:14:05.317 fused_ordering(804) 00:14:05.317 fused_ordering(805) 00:14:05.317 fused_ordering(806) 00:14:05.317 fused_ordering(807) 00:14:05.317 fused_ordering(808) 00:14:05.317 fused_ordering(809) 00:14:05.317 fused_ordering(810) 00:14:05.317 fused_ordering(811) 00:14:05.317 fused_ordering(812) 00:14:05.317 fused_ordering(813) 00:14:05.317 fused_ordering(814) 00:14:05.317 fused_ordering(815) 00:14:05.317 fused_ordering(816) 00:14:05.317 fused_ordering(817) 00:14:05.317 fused_ordering(818) 00:14:05.317 fused_ordering(819) 00:14:05.317 fused_ordering(820) 00:14:05.317 fused_ordering(821) 00:14:05.317 fused_ordering(822) 00:14:05.317 fused_ordering(823) 00:14:05.317 fused_ordering(824) 00:14:05.317 fused_ordering(825) 00:14:05.317 fused_ordering(826) 00:14:05.317 fused_ordering(827) 00:14:05.317 fused_ordering(828) 00:14:05.317 fused_ordering(829) 00:14:05.317 fused_ordering(830) 00:14:05.317 fused_ordering(831) 00:14:05.317 fused_ordering(832) 00:14:05.317 fused_ordering(833) 00:14:05.317 fused_ordering(834) 00:14:05.317 fused_ordering(835) 00:14:05.317 fused_ordering(836) 00:14:05.317 fused_ordering(837) 00:14:05.317 fused_ordering(838) 00:14:05.317 fused_ordering(839) 00:14:05.317 fused_ordering(840) 00:14:05.317 fused_ordering(841) 00:14:05.317 fused_ordering(842) 00:14:05.317 fused_ordering(843) 00:14:05.317 fused_ordering(844) 00:14:05.317 fused_ordering(845) 00:14:05.317 fused_ordering(846) 00:14:05.317 fused_ordering(847) 00:14:05.317 fused_ordering(848) 00:14:05.317 fused_ordering(849) 00:14:05.317 fused_ordering(850) 00:14:05.317 fused_ordering(851) 00:14:05.317 fused_ordering(852) 00:14:05.317 fused_ordering(853) 00:14:05.317 fused_ordering(854) 00:14:05.317 fused_ordering(855) 00:14:05.317 fused_ordering(856) 00:14:05.317 fused_ordering(857) 00:14:05.317 fused_ordering(858) 00:14:05.317 fused_ordering(859) 00:14:05.317 fused_ordering(860) 00:14:05.317 fused_ordering(861) 00:14:05.317 fused_ordering(862) 00:14:05.317 fused_ordering(863) 00:14:05.317 fused_ordering(864) 00:14:05.317 fused_ordering(865) 00:14:05.317 fused_ordering(866) 00:14:05.317 fused_ordering(867) 00:14:05.317 fused_ordering(868) 00:14:05.317 fused_ordering(869) 00:14:05.317 fused_ordering(870) 00:14:05.317 fused_ordering(871) 00:14:05.317 fused_ordering(872) 00:14:05.317 fused_ordering(873) 00:14:05.317 fused_ordering(874) 00:14:05.317 fused_ordering(875) 00:14:05.317 fused_ordering(876) 00:14:05.317 fused_ordering(877) 00:14:05.317 fused_ordering(878) 00:14:05.317 fused_ordering(879) 00:14:05.317 fused_ordering(880) 00:14:05.317 fused_ordering(881) 00:14:05.317 fused_ordering(882) 00:14:05.317 fused_ordering(883) 00:14:05.317 fused_ordering(884) 00:14:05.317 fused_ordering(885) 00:14:05.317 fused_ordering(886) 00:14:05.317 fused_ordering(887) 00:14:05.317 fused_ordering(888) 00:14:05.317 fused_ordering(889) 00:14:05.317 fused_ordering(890) 00:14:05.317 fused_ordering(891) 00:14:05.317 fused_ordering(892) 00:14:05.317 fused_ordering(893) 00:14:05.317 fused_ordering(894) 00:14:05.317 fused_ordering(895) 00:14:05.317 fused_ordering(896) 00:14:05.317 fused_ordering(897) 00:14:05.317 fused_ordering(898) 00:14:05.317 fused_ordering(899) 00:14:05.317 fused_ordering(900) 00:14:05.317 fused_ordering(901) 00:14:05.317 fused_ordering(902) 00:14:05.317 fused_ordering(903) 00:14:05.317 fused_ordering(904) 00:14:05.317 fused_ordering(905) 00:14:05.317 fused_ordering(906) 00:14:05.317 fused_ordering(907) 00:14:05.317 fused_ordering(908) 00:14:05.317 fused_ordering(909) 00:14:05.317 fused_ordering(910) 00:14:05.317 fused_ordering(911) 00:14:05.317 fused_ordering(912) 00:14:05.317 fused_ordering(913) 00:14:05.317 fused_ordering(914) 00:14:05.317 fused_ordering(915) 00:14:05.317 fused_ordering(916) 00:14:05.317 fused_ordering(917) 00:14:05.317 fused_ordering(918) 00:14:05.317 fused_ordering(919) 00:14:05.317 fused_ordering(920) 00:14:05.317 fused_ordering(921) 00:14:05.317 fused_ordering(922) 00:14:05.317 fused_ordering(923) 00:14:05.317 fused_ordering(924) 00:14:05.317 fused_ordering(925) 00:14:05.317 fused_ordering(926) 00:14:05.317 fused_ordering(927) 00:14:05.317 fused_ordering(928) 00:14:05.317 fused_ordering(929) 00:14:05.317 fused_ordering(930) 00:14:05.317 fused_ordering(931) 00:14:05.317 fused_ordering(932) 00:14:05.317 fused_ordering(933) 00:14:05.317 fused_ordering(934) 00:14:05.317 fused_ordering(935) 00:14:05.317 fused_ordering(936) 00:14:05.317 fused_ordering(937) 00:14:05.317 fused_ordering(938) 00:14:05.317 fused_ordering(939) 00:14:05.317 fused_ordering(940) 00:14:05.317 fused_ordering(941) 00:14:05.317 fused_ordering(942) 00:14:05.317 fused_ordering(943) 00:14:05.317 fused_ordering(944) 00:14:05.317 fused_ordering(945) 00:14:05.317 fused_ordering(946) 00:14:05.317 fused_ordering(947) 00:14:05.317 fused_ordering(948) 00:14:05.317 fused_ordering(949) 00:14:05.317 fused_ordering(950) 00:14:05.317 fused_ordering(951) 00:14:05.317 fused_ordering(952) 00:14:05.317 fused_ordering(953) 00:14:05.317 fused_ordering(954) 00:14:05.317 fused_ordering(955) 00:14:05.317 fused_ordering(956) 00:14:05.317 fused_ordering(957) 00:14:05.317 fused_ordering(958) 00:14:05.317 fused_ordering(959) 00:14:05.317 fused_ordering(960) 00:14:05.317 fused_ordering(961) 00:14:05.317 fused_ordering(962) 00:14:05.317 fused_ordering(963) 00:14:05.317 fused_ordering(964) 00:14:05.317 fused_ordering(965) 00:14:05.317 fused_ordering(966) 00:14:05.317 fused_ordering(967) 00:14:05.317 fused_ordering(968) 00:14:05.317 fused_ordering(969) 00:14:05.317 fused_ordering(970) 00:14:05.317 fused_ordering(971) 00:14:05.317 fused_ordering(972) 00:14:05.317 fused_ordering(973) 00:14:05.317 fused_ordering(974) 00:14:05.317 fused_ordering(975) 00:14:05.317 fused_ordering(976) 00:14:05.317 fused_ordering(977) 00:14:05.317 fused_ordering(978) 00:14:05.317 fused_ordering(979) 00:14:05.317 fused_ordering(980) 00:14:05.317 fused_ordering(981) 00:14:05.317 fused_ordering(982) 00:14:05.317 fused_ordering(983) 00:14:05.317 fused_ordering(984) 00:14:05.317 fused_ordering(985) 00:14:05.317 fused_ordering(986) 00:14:05.317 fused_ordering(987) 00:14:05.317 fused_ordering(988) 00:14:05.317 fused_ordering(989) 00:14:05.317 fused_ordering(990) 00:14:05.317 fused_ordering(991) 00:14:05.317 fused_ordering(992) 00:14:05.317 fused_ordering(993) 00:14:05.317 fused_ordering(994) 00:14:05.317 fused_ordering(995) 00:14:05.317 fused_ordering(996) 00:14:05.317 fused_ordering(997) 00:14:05.317 fused_ordering(998) 00:14:05.317 fused_ordering(999) 00:14:05.317 fused_ordering(1000) 00:14:05.317 fused_ordering(1001) 00:14:05.317 fused_ordering(1002) 00:14:05.317 fused_ordering(1003) 00:14:05.317 fused_ordering(1004) 00:14:05.317 fused_ordering(1005) 00:14:05.317 fused_ordering(1006) 00:14:05.317 fused_ordering(1007) 00:14:05.317 fused_ordering(1008) 00:14:05.317 fused_ordering(1009) 00:14:05.317 fused_ordering(1010) 00:14:05.317 fused_ordering(1011) 00:14:05.317 fused_ordering(1012) 00:14:05.317 fused_ordering(1013) 00:14:05.317 fused_ordering(1014) 00:14:05.317 fused_ordering(1015) 00:14:05.317 fused_ordering(1016) 00:14:05.317 fused_ordering(1017) 00:14:05.317 fused_ordering(1018) 00:14:05.317 fused_ordering(1019) 00:14:05.317 fused_ordering(1020) 00:14:05.317 fused_ordering(1021) 00:14:05.317 fused_ordering(1022) 00:14:05.317 fused_ordering(1023) 00:14:05.317 03:14:39 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:14:05.317 03:14:39 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:14:05.317 03:14:39 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:05.317 03:14:39 -- nvmf/common.sh@117 -- # sync 00:14:05.317 03:14:39 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:14:05.317 03:14:39 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:14:05.317 03:14:39 -- nvmf/common.sh@120 -- # set +e 00:14:05.317 03:14:39 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:05.317 03:14:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:14:05.317 rmmod nvme_rdma 00:14:05.577 rmmod nvme_fabrics 00:14:05.577 03:14:39 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:05.577 03:14:39 -- nvmf/common.sh@124 -- # set -e 00:14:05.577 03:14:39 -- nvmf/common.sh@125 -- # return 0 00:14:05.577 03:14:39 -- nvmf/common.sh@478 -- # '[' -n 4031522 ']' 00:14:05.577 03:14:39 -- nvmf/common.sh@479 -- # killprocess 4031522 00:14:05.577 03:14:39 -- common/autotest_common.sh@936 -- # '[' -z 4031522 ']' 00:14:05.577 03:14:39 -- common/autotest_common.sh@940 -- # kill -0 4031522 00:14:05.577 03:14:39 -- common/autotest_common.sh@941 -- # uname 00:14:05.577 03:14:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:05.577 03:14:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4031522 00:14:05.577 03:14:39 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:05.577 03:14:39 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:05.577 03:14:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4031522' 00:14:05.577 killing process with pid 4031522 00:14:05.577 03:14:39 -- common/autotest_common.sh@955 -- # kill 4031522 00:14:05.577 03:14:39 -- common/autotest_common.sh@960 -- # wait 4031522 00:14:05.577 [2024-04-25 03:14:39.936532] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:14:05.836 03:14:40 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:05.836 03:14:40 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:14:05.836 00:14:05.836 real 0m7.946s 00:14:05.836 user 0m4.402s 00:14:05.836 sys 0m4.767s 00:14:05.836 03:14:40 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:14:05.836 03:14:40 -- common/autotest_common.sh@10 -- # set +x 00:14:05.836 ************************************ 00:14:05.836 END TEST nvmf_fused_ordering 00:14:05.836 ************************************ 00:14:05.836 03:14:40 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=rdma 00:14:05.836 03:14:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:05.836 03:14:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:05.836 03:14:40 -- common/autotest_common.sh@10 -- # set +x 00:14:05.836 ************************************ 00:14:05.836 START TEST nvmf_delete_subsystem 00:14:05.836 ************************************ 00:14:05.836 03:14:40 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=rdma 00:14:05.836 * Looking for test storage... 00:14:06.096 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:14:06.096 03:14:40 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:14:06.096 03:14:40 -- nvmf/common.sh@7 -- # uname -s 00:14:06.096 03:14:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:06.096 03:14:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:06.096 03:14:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:06.096 03:14:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:06.096 03:14:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:06.096 03:14:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:06.096 03:14:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:06.096 03:14:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:06.096 03:14:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:06.096 03:14:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:06.096 03:14:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:14:06.096 03:14:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:14:06.096 03:14:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:06.096 03:14:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:06.096 03:14:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:06.096 03:14:40 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:06.096 03:14:40 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:14:06.096 03:14:40 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:06.096 03:14:40 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:06.096 03:14:40 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:06.096 03:14:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:06.096 03:14:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:06.096 03:14:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:06.096 03:14:40 -- paths/export.sh@5 -- # export PATH 00:14:06.096 03:14:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:06.096 03:14:40 -- nvmf/common.sh@47 -- # : 0 00:14:06.096 03:14:40 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:06.096 03:14:40 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:06.096 03:14:40 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:06.096 03:14:40 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:06.096 03:14:40 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:06.096 03:14:40 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:06.096 03:14:40 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:06.096 03:14:40 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:06.096 03:14:40 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:14:06.096 03:14:40 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:14:06.096 03:14:40 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:06.096 03:14:40 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:06.096 03:14:40 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:06.096 03:14:40 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:06.096 03:14:40 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:06.096 03:14:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:06.096 03:14:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:06.096 03:14:40 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:06.096 03:14:40 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:06.096 03:14:40 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:06.096 03:14:40 -- common/autotest_common.sh@10 -- # set +x 00:14:12.672 03:14:46 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:12.672 03:14:46 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:12.672 03:14:46 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:12.672 03:14:46 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:12.672 03:14:46 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:12.672 03:14:46 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:12.672 03:14:46 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:12.672 03:14:46 -- nvmf/common.sh@295 -- # net_devs=() 00:14:12.672 03:14:46 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:12.672 03:14:46 -- nvmf/common.sh@296 -- # e810=() 00:14:12.672 03:14:46 -- nvmf/common.sh@296 -- # local -ga e810 00:14:12.672 03:14:46 -- nvmf/common.sh@297 -- # x722=() 00:14:12.672 03:14:46 -- nvmf/common.sh@297 -- # local -ga x722 00:14:12.672 03:14:46 -- nvmf/common.sh@298 -- # mlx=() 00:14:12.672 03:14:46 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:12.672 03:14:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:12.672 03:14:46 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:12.672 03:14:46 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:12.672 03:14:46 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:12.672 03:14:46 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:12.672 03:14:46 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:12.672 03:14:46 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:12.672 03:14:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:12.672 03:14:46 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:12.672 03:14:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:12.672 03:14:46 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:12.672 03:14:46 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:12.672 03:14:46 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:14:12.672 03:14:46 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:14:12.672 03:14:46 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:14:12.672 03:14:46 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:14:12.672 03:14:46 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:14:12.672 03:14:46 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:14:12.672 03:14:46 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:12.672 03:14:46 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:12.672 03:14:46 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:14:12.672 Found 0000:af:00.0 (0x8086 - 0x159b) 00:14:12.672 03:14:46 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:12.672 03:14:46 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:12.672 03:14:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:12.672 03:14:46 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:12.672 03:14:46 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:12.672 03:14:46 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:12.672 03:14:46 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:12.672 03:14:46 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:14:12.672 Found 0000:af:00.1 (0x8086 - 0x159b) 00:14:12.672 03:14:46 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:12.672 03:14:46 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:12.672 03:14:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:12.672 03:14:46 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:12.672 03:14:46 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:12.672 03:14:46 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:12.672 03:14:46 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:12.672 03:14:46 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:14:12.672 03:14:46 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:14:12.672 03:14:46 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:14:12.672 03:14:46 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:14:12.672 03:14:46 -- nvmf/common.sh@377 -- # modinfo irdma 00:14:12.672 03:14:46 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:14:12.672 03:14:46 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:12.672 03:14:46 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:12.673 03:14:46 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:12.673 03:14:46 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:12.673 03:14:46 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:14:12.673 Found net devices under 0000:af:00.0: cvl_0_0 00:14:12.673 03:14:46 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:12.673 03:14:46 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:12.673 03:14:46 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:12.673 03:14:46 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:12.673 03:14:46 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:12.673 03:14:46 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:14:12.673 Found net devices under 0000:af:00.1: cvl_0_1 00:14:12.673 03:14:46 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:12.673 03:14:46 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:12.673 03:14:46 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:12.673 03:14:46 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:12.673 03:14:46 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:14:12.673 03:14:46 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:14:12.673 03:14:46 -- nvmf/common.sh@409 -- # rdma_device_init 00:14:12.673 03:14:46 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:14:12.673 03:14:46 -- nvmf/common.sh@58 -- # uname 00:14:12.673 03:14:46 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:14:12.673 03:14:46 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:14:12.673 03:14:46 -- nvmf/common.sh@63 -- # modprobe ib_core 00:14:12.673 03:14:46 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:14:12.673 03:14:46 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:14:12.673 03:14:46 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:14:12.673 03:14:46 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:14:12.673 03:14:46 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:14:12.673 03:14:46 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:14:12.673 03:14:46 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:14:12.673 03:14:46 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:14:12.673 03:14:46 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:12.673 03:14:46 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:12.673 03:14:46 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:12.673 03:14:46 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:12.673 03:14:46 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:12.673 03:14:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:12.673 03:14:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:12.673 03:14:46 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:14:12.673 03:14:46 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:14:12.673 03:14:46 -- nvmf/common.sh@105 -- # continue 2 00:14:12.673 03:14:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:12.673 03:14:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:12.673 03:14:46 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:14:12.673 03:14:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:12.673 03:14:46 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:14:12.673 03:14:46 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:14:12.673 03:14:46 -- nvmf/common.sh@105 -- # continue 2 00:14:12.673 03:14:46 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:12.673 03:14:46 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:14:12.673 03:14:46 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:14:12.673 03:14:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:14:12.673 03:14:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:12.673 03:14:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:12.673 03:14:46 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:14:12.673 03:14:46 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:14:12.673 03:14:46 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:14:12.673 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:14:12.673 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:14:12.673 altname enp175s0f0np0 00:14:12.673 altname ens801f0np0 00:14:12.673 inet 192.168.100.8/24 scope global cvl_0_0 00:14:12.673 valid_lft forever preferred_lft forever 00:14:12.673 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:14:12.673 valid_lft forever preferred_lft forever 00:14:12.673 03:14:46 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:12.673 03:14:46 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:14:12.673 03:14:46 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:14:12.673 03:14:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:12.673 03:14:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:14:12.673 03:14:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:12.673 03:14:46 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:14:12.673 03:14:46 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:14:12.673 03:14:46 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:14:12.673 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:14:12.673 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:14:12.673 altname enp175s0f1np1 00:14:12.673 altname ens801f1np1 00:14:12.673 inet 192.168.100.9/24 scope global cvl_0_1 00:14:12.673 valid_lft forever preferred_lft forever 00:14:12.673 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:14:12.673 valid_lft forever preferred_lft forever 00:14:12.673 03:14:46 -- nvmf/common.sh@411 -- # return 0 00:14:12.673 03:14:46 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:12.673 03:14:46 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:14:12.673 03:14:46 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:14:12.673 03:14:46 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:14:12.673 03:14:46 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:14:12.673 03:14:46 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:12.673 03:14:46 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:12.673 03:14:46 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:12.673 03:14:46 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:12.673 03:14:46 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:12.673 03:14:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:12.673 03:14:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:12.673 03:14:46 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:14:12.673 03:14:46 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:14:12.673 03:14:46 -- nvmf/common.sh@105 -- # continue 2 00:14:12.673 03:14:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:12.673 03:14:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:12.673 03:14:46 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:14:12.673 03:14:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:12.673 03:14:46 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:14:12.673 03:14:46 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:14:12.673 03:14:46 -- nvmf/common.sh@105 -- # continue 2 00:14:12.673 03:14:46 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:12.673 03:14:46 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:14:12.673 03:14:46 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:14:12.673 03:14:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:14:12.673 03:14:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:12.673 03:14:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:12.674 03:14:46 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:12.674 03:14:46 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:14:12.674 03:14:46 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:14:12.674 03:14:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:14:12.674 03:14:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:12.674 03:14:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:12.674 03:14:46 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:14:12.674 192.168.100.9' 00:14:12.674 03:14:46 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:14:12.674 192.168.100.9' 00:14:12.674 03:14:46 -- nvmf/common.sh@446 -- # head -n 1 00:14:12.674 03:14:46 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:14:12.674 03:14:46 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:14:12.674 192.168.100.9' 00:14:12.674 03:14:46 -- nvmf/common.sh@447 -- # tail -n +2 00:14:12.674 03:14:46 -- nvmf/common.sh@447 -- # head -n 1 00:14:12.674 03:14:46 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:14:12.674 03:14:46 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:14:12.674 03:14:46 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:14:12.674 03:14:46 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:14:12.674 03:14:46 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:14:12.674 03:14:46 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:14:12.674 03:14:46 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:14:12.674 03:14:46 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:12.674 03:14:46 -- common/autotest_common.sh@710 -- # xtrace_disable 00:14:12.674 03:14:46 -- common/autotest_common.sh@10 -- # set +x 00:14:12.674 03:14:46 -- nvmf/common.sh@470 -- # nvmfpid=4035339 00:14:12.674 03:14:46 -- nvmf/common.sh@471 -- # waitforlisten 4035339 00:14:12.674 03:14:46 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:14:12.674 03:14:46 -- common/autotest_common.sh@817 -- # '[' -z 4035339 ']' 00:14:12.674 03:14:46 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:12.674 03:14:46 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:12.674 03:14:46 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:12.674 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:12.674 03:14:46 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:12.674 03:14:46 -- common/autotest_common.sh@10 -- # set +x 00:14:12.674 [2024-04-25 03:14:46.742939] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:14:12.674 [2024-04-25 03:14:46.742980] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:12.674 EAL: No free 2048 kB hugepages reported on node 1 00:14:12.674 [2024-04-25 03:14:46.802457] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:14:12.674 [2024-04-25 03:14:46.875175] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:12.674 [2024-04-25 03:14:46.875216] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:12.674 [2024-04-25 03:14:46.875223] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:12.674 [2024-04-25 03:14:46.875228] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:12.674 [2024-04-25 03:14:46.875233] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:12.674 [2024-04-25 03:14:46.875275] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:12.674 [2024-04-25 03:14:46.875278] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:13.243 03:14:47 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:13.243 03:14:47 -- common/autotest_common.sh@850 -- # return 0 00:14:13.243 03:14:47 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:13.243 03:14:47 -- common/autotest_common.sh@716 -- # xtrace_disable 00:14:13.243 03:14:47 -- common/autotest_common.sh@10 -- # set +x 00:14:13.243 03:14:47 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:13.243 03:14:47 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:14:13.243 03:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:13.243 03:14:47 -- common/autotest_common.sh@10 -- # set +x 00:14:13.243 [2024-04-25 03:14:47.576246] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x20957f0/0x2094e30) succeed. 00:14:13.243 [2024-04-25 03:14:47.584907] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x2096a60/0x20953b0) succeed. 00:14:13.243 [2024-04-25 03:14:47.584930] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:14:13.243 03:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:13.243 03:14:47 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:13.243 03:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:13.243 03:14:47 -- common/autotest_common.sh@10 -- # set +x 00:14:13.243 03:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:13.243 03:14:47 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:13.243 03:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:13.243 03:14:47 -- common/autotest_common.sh@10 -- # set +x 00:14:13.243 [2024-04-25 03:14:47.605131] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:13.243 03:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:13.243 03:14:47 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:13.243 03:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:13.243 03:14:47 -- common/autotest_common.sh@10 -- # set +x 00:14:13.243 NULL1 00:14:13.243 03:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:13.243 03:14:47 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:14:13.243 03:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:13.243 03:14:47 -- common/autotest_common.sh@10 -- # set +x 00:14:13.243 Delay0 00:14:13.243 03:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:13.243 03:14:47 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:13.243 03:14:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:13.243 03:14:47 -- common/autotest_common.sh@10 -- # set +x 00:14:13.243 03:14:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:13.243 03:14:47 -- target/delete_subsystem.sh@28 -- # perf_pid=4035433 00:14:13.243 03:14:47 -- target/delete_subsystem.sh@30 -- # sleep 2 00:14:13.243 03:14:47 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:14:13.243 EAL: No free 2048 kB hugepages reported on node 1 00:14:13.243 [2024-04-25 03:14:47.696431] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on RDMA/192.168.100.8/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:15.145 03:14:49 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:15.145 03:14:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:15.145 03:14:49 -- common/autotest_common.sh@10 -- # set +x 00:14:16.521 NVMe io qpair process completion error 00:14:16.521 NVMe io qpair process completion error 00:14:16.521 NVMe io qpair process completion error 00:14:16.521 NVMe io qpair process completion error 00:14:16.521 NVMe io qpair process completion error 00:14:16.521 NVMe io qpair process completion error 00:14:16.521 03:14:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:16.521 03:14:50 -- target/delete_subsystem.sh@34 -- # delay=0 00:14:16.521 03:14:50 -- target/delete_subsystem.sh@35 -- # kill -0 4035433 00:14:16.521 03:14:50 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:14:17.090 [2024-04-25 03:14:51.295875] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 starting I/O failed: -6 00:14:17.090 [2024-04-25 03:14:51.296431] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 [2024-04-25 03:14:51.296786] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Read completed with error (sct=0, sc=8) 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.090 Write completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 [2024-04-25 03:14:51.297158] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 [2024-04-25 03:14:51.297328] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 starting I/O failed: -6 00:14:17.091 03:14:51 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:14:17.091 03:14:51 -- target/delete_subsystem.sh@35 -- # kill -0 4035433 00:14:17.091 03:14:51 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:14:17.091 [2024-04-25 03:14:51.359892] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 [2024-04-25 03:14:51.360200] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 [2024-04-25 03:14:51.360381] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Write completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.091 Read completed with error (sct=0, sc=8) 00:14:17.092 Read completed with error (sct=0, sc=8) 00:14:17.092 Read completed with error (sct=0, sc=8) 00:14:17.092 [2024-04-25 03:14:51.361229] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:14:17.092 [2024-04-25 03:14:51.374250] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:14:17.092 [2024-04-25 03:14:51.374263] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:14:17.092 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:14:17.092 Initializing NVMe Controllers 00:14:17.092 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:14:17.092 Controller IO queue size 128, less than required. 00:14:17.092 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:17.092 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:17.092 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:17.092 Initialization complete. Launching workers. 00:14:17.092 ======================================================== 00:14:17.092 Latency(us) 00:14:17.092 Device Information : IOPS MiB/s Average min max 00:14:17.092 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 81.80 0.04 1564811.77 1000250.51 2519509.41 00:14:17.092 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 99.98 0.05 1293448.08 1000621.12 2518645.89 00:14:17.092 ======================================================== 00:14:17.092 Total : 181.79 0.09 1415561.74 1000250.51 2519509.41 00:14:17.092 00:14:17.350 03:14:51 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:14:17.350 03:14:51 -- target/delete_subsystem.sh@35 -- # kill -0 4035433 00:14:17.350 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (4035433) - No such process 00:14:17.350 03:14:51 -- target/delete_subsystem.sh@45 -- # NOT wait 4035433 00:14:17.350 03:14:51 -- common/autotest_common.sh@638 -- # local es=0 00:14:17.350 03:14:51 -- common/autotest_common.sh@640 -- # valid_exec_arg wait 4035433 00:14:17.350 03:14:51 -- common/autotest_common.sh@626 -- # local arg=wait 00:14:17.350 03:14:51 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:17.350 03:14:51 -- common/autotest_common.sh@630 -- # type -t wait 00:14:17.350 03:14:51 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:17.350 03:14:51 -- common/autotest_common.sh@641 -- # wait 4035433 00:14:17.350 03:14:51 -- common/autotest_common.sh@641 -- # es=1 00:14:17.350 03:14:51 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:14:17.350 03:14:51 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:14:17.350 03:14:51 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:14:17.350 03:14:51 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:17.350 03:14:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:17.350 03:14:51 -- common/autotest_common.sh@10 -- # set +x 00:14:17.350 03:14:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:17.350 03:14:51 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:17.350 03:14:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:17.350 03:14:51 -- common/autotest_common.sh@10 -- # set +x 00:14:17.350 [2024-04-25 03:14:51.824234] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:17.350 03:14:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:17.350 03:14:51 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:17.350 03:14:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:17.350 03:14:51 -- common/autotest_common.sh@10 -- # set +x 00:14:17.350 03:14:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:17.350 03:14:51 -- target/delete_subsystem.sh@54 -- # perf_pid=4036152 00:14:17.350 03:14:51 -- target/delete_subsystem.sh@56 -- # delay=0 00:14:17.351 03:14:51 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:14:17.351 03:14:51 -- target/delete_subsystem.sh@57 -- # kill -0 4036152 00:14:17.351 03:14:51 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:17.609 EAL: No free 2048 kB hugepages reported on node 1 00:14:17.609 [2024-04-25 03:14:51.902009] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on RDMA/192.168.100.8/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:17.868 03:14:52 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:17.868 03:14:52 -- target/delete_subsystem.sh@57 -- # kill -0 4036152 00:14:17.868 03:14:52 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:18.436 03:14:52 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:18.436 03:14:52 -- target/delete_subsystem.sh@57 -- # kill -0 4036152 00:14:18.436 03:14:52 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:19.026 03:14:53 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:19.026 03:14:53 -- target/delete_subsystem.sh@57 -- # kill -0 4036152 00:14:19.026 03:14:53 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:19.591 03:14:53 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:19.591 03:14:53 -- target/delete_subsystem.sh@57 -- # kill -0 4036152 00:14:19.591 03:14:53 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:20.158 03:14:54 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:20.158 03:14:54 -- target/delete_subsystem.sh@57 -- # kill -0 4036152 00:14:20.158 03:14:54 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:20.417 03:14:54 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:20.417 03:14:54 -- target/delete_subsystem.sh@57 -- # kill -0 4036152 00:14:20.417 03:14:54 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:20.985 03:14:55 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:20.985 03:14:55 -- target/delete_subsystem.sh@57 -- # kill -0 4036152 00:14:20.985 03:14:55 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:21.554 03:14:55 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:21.554 03:14:55 -- target/delete_subsystem.sh@57 -- # kill -0 4036152 00:14:21.554 03:14:55 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:22.122 03:14:56 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:22.122 03:14:56 -- target/delete_subsystem.sh@57 -- # kill -0 4036152 00:14:22.122 03:14:56 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:22.689 03:14:56 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:22.689 03:14:56 -- target/delete_subsystem.sh@57 -- # kill -0 4036152 00:14:22.689 03:14:56 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:22.948 03:14:57 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:22.948 03:14:57 -- target/delete_subsystem.sh@57 -- # kill -0 4036152 00:14:22.948 03:14:57 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:23.515 03:14:57 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:23.515 03:14:57 -- target/delete_subsystem.sh@57 -- # kill -0 4036152 00:14:23.515 03:14:57 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:24.083 03:14:58 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:24.084 03:14:58 -- target/delete_subsystem.sh@57 -- # kill -0 4036152 00:14:24.084 03:14:58 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:24.651 03:14:58 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:24.651 03:14:58 -- target/delete_subsystem.sh@57 -- # kill -0 4036152 00:14:24.651 03:14:58 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:24.651 Initializing NVMe Controllers 00:14:24.651 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:14:24.651 Controller IO queue size 128, less than required. 00:14:24.651 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:24.651 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:24.651 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:24.651 Initialization complete. Launching workers. 00:14:24.651 ======================================================== 00:14:24.651 Latency(us) 00:14:24.651 Device Information : IOPS MiB/s Average min max 00:14:24.651 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1001304.41 1000072.88 1003750.08 00:14:24.651 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1002435.37 1000068.35 1006267.90 00:14:24.651 ======================================================== 00:14:24.651 Total : 256.00 0.12 1001869.89 1000068.35 1006267.90 00:14:24.651 00:14:24.910 03:14:59 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:24.910 03:14:59 -- target/delete_subsystem.sh@57 -- # kill -0 4036152 00:14:24.910 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (4036152) - No such process 00:14:24.910 03:14:59 -- target/delete_subsystem.sh@67 -- # wait 4036152 00:14:24.910 03:14:59 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:14:24.910 03:14:59 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:14:24.910 03:14:59 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:24.910 03:14:59 -- nvmf/common.sh@117 -- # sync 00:14:24.910 03:14:59 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:14:24.910 03:14:59 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:14:24.910 03:14:59 -- nvmf/common.sh@120 -- # set +e 00:14:24.910 03:14:59 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:24.910 03:14:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:14:25.170 rmmod nvme_rdma 00:14:25.170 rmmod nvme_fabrics 00:14:25.170 03:14:59 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:25.170 03:14:59 -- nvmf/common.sh@124 -- # set -e 00:14:25.170 03:14:59 -- nvmf/common.sh@125 -- # return 0 00:14:25.170 03:14:59 -- nvmf/common.sh@478 -- # '[' -n 4035339 ']' 00:14:25.170 03:14:59 -- nvmf/common.sh@479 -- # killprocess 4035339 00:14:25.170 03:14:59 -- common/autotest_common.sh@936 -- # '[' -z 4035339 ']' 00:14:25.170 03:14:59 -- common/autotest_common.sh@940 -- # kill -0 4035339 00:14:25.170 03:14:59 -- common/autotest_common.sh@941 -- # uname 00:14:25.170 03:14:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:25.170 03:14:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4035339 00:14:25.170 03:14:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:25.170 03:14:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:25.170 03:14:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4035339' 00:14:25.170 killing process with pid 4035339 00:14:25.170 03:14:59 -- common/autotest_common.sh@955 -- # kill 4035339 00:14:25.170 03:14:59 -- common/autotest_common.sh@960 -- # wait 4035339 00:14:25.170 [2024-04-25 03:14:59.529702] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:14:25.429 03:14:59 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:25.429 03:14:59 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:14:25.429 00:14:25.429 real 0m19.470s 00:14:25.429 user 0m48.491s 00:14:25.429 sys 0m5.638s 00:14:25.429 03:14:59 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:14:25.430 03:14:59 -- common/autotest_common.sh@10 -- # set +x 00:14:25.430 ************************************ 00:14:25.430 END TEST nvmf_delete_subsystem 00:14:25.430 ************************************ 00:14:25.430 03:14:59 -- nvmf/nvmf.sh@36 -- # run_test nvmf_ns_masking test/nvmf/target/ns_masking.sh --transport=rdma 00:14:25.430 03:14:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:25.430 03:14:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:25.430 03:14:59 -- common/autotest_common.sh@10 -- # set +x 00:14:25.430 ************************************ 00:14:25.430 START TEST nvmf_ns_masking 00:14:25.430 ************************************ 00:14:25.430 03:14:59 -- common/autotest_common.sh@1111 -- # test/nvmf/target/ns_masking.sh --transport=rdma 00:14:25.689 * Looking for test storage... 00:14:25.689 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:14:25.689 03:14:59 -- target/ns_masking.sh@8 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:14:25.689 03:14:59 -- nvmf/common.sh@7 -- # uname -s 00:14:25.689 03:15:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:25.689 03:15:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:25.689 03:15:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:25.689 03:15:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:25.689 03:15:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:25.689 03:15:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:25.689 03:15:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:25.689 03:15:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:25.689 03:15:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:25.689 03:15:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:25.689 03:15:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:14:25.689 03:15:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:14:25.689 03:15:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:25.689 03:15:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:25.689 03:15:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:25.689 03:15:00 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:25.689 03:15:00 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:14:25.689 03:15:00 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:25.689 03:15:00 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:25.689 03:15:00 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:25.689 03:15:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:25.689 03:15:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:25.689 03:15:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:25.689 03:15:00 -- paths/export.sh@5 -- # export PATH 00:14:25.689 03:15:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:25.689 03:15:00 -- nvmf/common.sh@47 -- # : 0 00:14:25.689 03:15:00 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:25.689 03:15:00 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:25.689 03:15:00 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:25.689 03:15:00 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:25.689 03:15:00 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:25.689 03:15:00 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:25.689 03:15:00 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:25.689 03:15:00 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:25.689 03:15:00 -- target/ns_masking.sh@10 -- # rpc_py=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:14:25.689 03:15:00 -- target/ns_masking.sh@11 -- # loops=5 00:14:25.689 03:15:00 -- target/ns_masking.sh@13 -- # SUBSYSNQN=nqn.2016-06.io.spdk:cnode1 00:14:25.689 03:15:00 -- target/ns_masking.sh@14 -- # HOSTNQN=nqn.2016-06.io.spdk:host1 00:14:25.689 03:15:00 -- target/ns_masking.sh@15 -- # uuidgen 00:14:25.689 03:15:00 -- target/ns_masking.sh@15 -- # HOSTID=d22024f3-af8b-4c2f-8991-210b200102d2 00:14:25.689 03:15:00 -- target/ns_masking.sh@44 -- # nvmftestinit 00:14:25.689 03:15:00 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:14:25.689 03:15:00 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:25.689 03:15:00 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:25.689 03:15:00 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:25.689 03:15:00 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:25.689 03:15:00 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:25.689 03:15:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:25.689 03:15:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:25.689 03:15:00 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:25.689 03:15:00 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:25.689 03:15:00 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:25.689 03:15:00 -- common/autotest_common.sh@10 -- # set +x 00:14:32.258 03:15:06 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:32.258 03:15:06 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:32.258 03:15:06 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:32.258 03:15:06 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:32.258 03:15:06 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:32.258 03:15:06 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:32.258 03:15:06 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:32.258 03:15:06 -- nvmf/common.sh@295 -- # net_devs=() 00:14:32.258 03:15:06 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:32.258 03:15:06 -- nvmf/common.sh@296 -- # e810=() 00:14:32.258 03:15:06 -- nvmf/common.sh@296 -- # local -ga e810 00:14:32.258 03:15:06 -- nvmf/common.sh@297 -- # x722=() 00:14:32.258 03:15:06 -- nvmf/common.sh@297 -- # local -ga x722 00:14:32.258 03:15:06 -- nvmf/common.sh@298 -- # mlx=() 00:14:32.258 03:15:06 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:32.258 03:15:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:32.258 03:15:06 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:32.258 03:15:06 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:32.258 03:15:06 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:32.258 03:15:06 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:32.258 03:15:06 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:32.258 03:15:06 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:32.258 03:15:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:32.258 03:15:06 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:32.258 03:15:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:32.258 03:15:06 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:32.258 03:15:06 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:32.258 03:15:06 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:14:32.258 03:15:06 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:14:32.258 03:15:06 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:14:32.258 03:15:06 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:14:32.258 03:15:06 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:14:32.258 03:15:06 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:14:32.258 03:15:06 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:32.258 03:15:06 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:32.258 03:15:06 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:14:32.258 Found 0000:af:00.0 (0x8086 - 0x159b) 00:14:32.258 03:15:06 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:32.258 03:15:06 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:32.258 03:15:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:32.258 03:15:06 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:32.258 03:15:06 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:32.258 03:15:06 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:32.258 03:15:06 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:32.258 03:15:06 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:14:32.258 Found 0000:af:00.1 (0x8086 - 0x159b) 00:14:32.258 03:15:06 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:32.258 03:15:06 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:32.258 03:15:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:32.258 03:15:06 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:32.258 03:15:06 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:32.258 03:15:06 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:32.258 03:15:06 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:32.258 03:15:06 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:14:32.258 03:15:06 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:14:32.258 03:15:06 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:14:32.258 03:15:06 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:14:32.258 03:15:06 -- nvmf/common.sh@377 -- # modinfo irdma 00:14:32.258 03:15:06 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:14:32.258 03:15:06 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:32.258 03:15:06 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:32.258 03:15:06 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:32.258 03:15:06 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:32.258 03:15:06 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:14:32.258 Found net devices under 0000:af:00.0: cvl_0_0 00:14:32.258 03:15:06 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:32.258 03:15:06 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:32.258 03:15:06 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:32.258 03:15:06 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:32.258 03:15:06 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:32.258 03:15:06 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:14:32.258 Found net devices under 0000:af:00.1: cvl_0_1 00:14:32.258 03:15:06 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:32.258 03:15:06 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:32.258 03:15:06 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:32.258 03:15:06 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:32.258 03:15:06 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:14:32.258 03:15:06 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:14:32.258 03:15:06 -- nvmf/common.sh@409 -- # rdma_device_init 00:14:32.258 03:15:06 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:14:32.258 03:15:06 -- nvmf/common.sh@58 -- # uname 00:14:32.258 03:15:06 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:14:32.258 03:15:06 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:14:32.258 03:15:06 -- nvmf/common.sh@63 -- # modprobe ib_core 00:14:32.258 03:15:06 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:14:32.258 03:15:06 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:14:32.258 03:15:06 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:14:32.258 03:15:06 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:14:32.258 03:15:06 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:14:32.258 03:15:06 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:14:32.258 03:15:06 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:14:32.258 03:15:06 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:14:32.258 03:15:06 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:32.258 03:15:06 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:32.258 03:15:06 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:32.258 03:15:06 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:32.258 03:15:06 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:32.258 03:15:06 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:32.258 03:15:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:32.258 03:15:06 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:14:32.258 03:15:06 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:14:32.258 03:15:06 -- nvmf/common.sh@105 -- # continue 2 00:14:32.258 03:15:06 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:32.258 03:15:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:32.258 03:15:06 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:14:32.258 03:15:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:32.258 03:15:06 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:14:32.258 03:15:06 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:14:32.258 03:15:06 -- nvmf/common.sh@105 -- # continue 2 00:14:32.258 03:15:06 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:32.258 03:15:06 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:14:32.259 03:15:06 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:14:32.259 03:15:06 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:14:32.259 03:15:06 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:32.259 03:15:06 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:32.259 03:15:06 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:14:32.259 03:15:06 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:14:32.259 03:15:06 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:14:32.259 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:14:32.259 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:14:32.259 altname enp175s0f0np0 00:14:32.259 altname ens801f0np0 00:14:32.259 inet 192.168.100.8/24 scope global cvl_0_0 00:14:32.259 valid_lft forever preferred_lft forever 00:14:32.259 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:14:32.259 valid_lft forever preferred_lft forever 00:14:32.259 03:15:06 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:32.259 03:15:06 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:14:32.259 03:15:06 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:14:32.259 03:15:06 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:14:32.259 03:15:06 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:32.259 03:15:06 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:32.259 03:15:06 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:14:32.259 03:15:06 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:14:32.259 03:15:06 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:14:32.259 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:14:32.259 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:14:32.259 altname enp175s0f1np1 00:14:32.259 altname ens801f1np1 00:14:32.259 inet 192.168.100.9/24 scope global cvl_0_1 00:14:32.259 valid_lft forever preferred_lft forever 00:14:32.259 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:14:32.259 valid_lft forever preferred_lft forever 00:14:32.259 03:15:06 -- nvmf/common.sh@411 -- # return 0 00:14:32.259 03:15:06 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:32.259 03:15:06 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:14:32.259 03:15:06 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:14:32.259 03:15:06 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:14:32.259 03:15:06 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:14:32.259 03:15:06 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:32.259 03:15:06 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:32.259 03:15:06 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:32.259 03:15:06 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:32.259 03:15:06 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:32.259 03:15:06 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:32.259 03:15:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:32.259 03:15:06 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:14:32.259 03:15:06 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:14:32.259 03:15:06 -- nvmf/common.sh@105 -- # continue 2 00:14:32.259 03:15:06 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:32.259 03:15:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:32.259 03:15:06 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:14:32.259 03:15:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:32.259 03:15:06 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:14:32.259 03:15:06 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:14:32.259 03:15:06 -- nvmf/common.sh@105 -- # continue 2 00:14:32.259 03:15:06 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:32.259 03:15:06 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:14:32.259 03:15:06 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:14:32.259 03:15:06 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:14:32.259 03:15:06 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:32.259 03:15:06 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:32.259 03:15:06 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:32.259 03:15:06 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:14:32.259 03:15:06 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:14:32.259 03:15:06 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:14:32.259 03:15:06 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:32.259 03:15:06 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:32.259 03:15:06 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:14:32.259 192.168.100.9' 00:14:32.259 03:15:06 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:14:32.259 192.168.100.9' 00:14:32.259 03:15:06 -- nvmf/common.sh@446 -- # head -n 1 00:14:32.259 03:15:06 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:14:32.259 03:15:06 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:14:32.259 192.168.100.9' 00:14:32.259 03:15:06 -- nvmf/common.sh@447 -- # tail -n +2 00:14:32.259 03:15:06 -- nvmf/common.sh@447 -- # head -n 1 00:14:32.259 03:15:06 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:14:32.259 03:15:06 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:14:32.259 03:15:06 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:14:32.259 03:15:06 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:14:32.259 03:15:06 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:14:32.259 03:15:06 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:14:32.259 03:15:06 -- target/ns_masking.sh@45 -- # nvmfappstart -m 0xF 00:14:32.259 03:15:06 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:32.259 03:15:06 -- common/autotest_common.sh@710 -- # xtrace_disable 00:14:32.259 03:15:06 -- common/autotest_common.sh@10 -- # set +x 00:14:32.259 03:15:06 -- nvmf/common.sh@470 -- # nvmfpid=4041097 00:14:32.259 03:15:06 -- nvmf/common.sh@471 -- # waitforlisten 4041097 00:14:32.259 03:15:06 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:32.259 03:15:06 -- common/autotest_common.sh@817 -- # '[' -z 4041097 ']' 00:14:32.259 03:15:06 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:32.259 03:15:06 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:32.259 03:15:06 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:32.259 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:32.259 03:15:06 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:32.259 03:15:06 -- common/autotest_common.sh@10 -- # set +x 00:14:32.259 [2024-04-25 03:15:06.428422] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:14:32.259 [2024-04-25 03:15:06.428471] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:32.259 EAL: No free 2048 kB hugepages reported on node 1 00:14:32.259 [2024-04-25 03:15:06.488671] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:32.259 [2024-04-25 03:15:06.568658] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:32.259 [2024-04-25 03:15:06.568692] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:32.259 [2024-04-25 03:15:06.568699] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:32.259 [2024-04-25 03:15:06.568705] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:32.259 [2024-04-25 03:15:06.568710] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:32.259 [2024-04-25 03:15:06.568749] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:32.259 [2024-04-25 03:15:06.568844] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:32.259 [2024-04-25 03:15:06.568866] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:32.259 [2024-04-25 03:15:06.568867] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:32.826 03:15:07 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:32.826 03:15:07 -- common/autotest_common.sh@850 -- # return 0 00:14:32.826 03:15:07 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:32.826 03:15:07 -- common/autotest_common.sh@716 -- # xtrace_disable 00:14:32.826 03:15:07 -- common/autotest_common.sh@10 -- # set +x 00:14:32.826 03:15:07 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:32.826 03:15:07 -- target/ns_masking.sh@47 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:14:33.084 [2024-04-25 03:15:07.430705] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x5b8ea0/0x5b84e0) succeed. 00:14:33.084 [2024-04-25 03:15:07.440727] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x5ba210/0x5b8a60) succeed. 00:14:33.084 [2024-04-25 03:15:07.440748] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:14:33.084 03:15:07 -- target/ns_masking.sh@49 -- # MALLOC_BDEV_SIZE=64 00:14:33.084 03:15:07 -- target/ns_masking.sh@50 -- # MALLOC_BLOCK_SIZE=512 00:14:33.084 03:15:07 -- target/ns_masking.sh@52 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:14:33.343 Malloc1 00:14:33.343 03:15:07 -- target/ns_masking.sh@53 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:14:33.343 Malloc2 00:14:33.601 03:15:07 -- target/ns_masking.sh@56 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:14:33.601 03:15:08 -- target/ns_masking.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 00:14:33.860 03:15:08 -- target/ns_masking.sh@58 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:34.118 [2024-04-25 03:15:08.400994] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:34.118 03:15:08 -- target/ns_masking.sh@61 -- # connect 00:14:34.118 03:15:08 -- target/ns_masking.sh@18 -- # nvme connect -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I d22024f3-af8b-4c2f-8991-210b200102d2 -a 192.168.100.8 -s 4420 -i 4 00:14:34.118 03:15:08 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 00:14:34.118 03:15:08 -- common/autotest_common.sh@1184 -- # local i=0 00:14:34.118 03:15:08 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:34.118 03:15:08 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:14:34.118 03:15:08 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:36.653 03:15:10 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:36.653 03:15:10 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:36.653 03:15:10 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:36.653 03:15:10 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:14:36.653 03:15:10 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:36.653 03:15:10 -- common/autotest_common.sh@1194 -- # return 0 00:14:36.653 03:15:10 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:14:36.653 03:15:10 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:14:36.653 03:15:10 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:14:36.653 03:15:10 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:14:36.653 03:15:10 -- target/ns_masking.sh@62 -- # ns_is_visible 0x1 00:14:36.653 03:15:10 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:36.653 03:15:10 -- target/ns_masking.sh@39 -- # grep 0x1 00:14:36.653 [ 0]:0x1 00:14:36.653 03:15:10 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:14:36.653 03:15:10 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:36.653 03:15:10 -- target/ns_masking.sh@40 -- # nguid=66dfa8e1f2c047c393aae3b0278dfafd 00:14:36.653 03:15:10 -- target/ns_masking.sh@41 -- # [[ 66dfa8e1f2c047c393aae3b0278dfafd != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:36.653 03:15:10 -- target/ns_masking.sh@65 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc2 -n 2 00:14:36.653 03:15:10 -- target/ns_masking.sh@66 -- # ns_is_visible 0x1 00:14:36.653 03:15:10 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:36.653 03:15:10 -- target/ns_masking.sh@39 -- # grep 0x1 00:14:36.653 [ 0]:0x1 00:14:36.653 03:15:10 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:14:36.653 03:15:10 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:36.653 03:15:10 -- target/ns_masking.sh@40 -- # nguid=66dfa8e1f2c047c393aae3b0278dfafd 00:14:36.653 03:15:10 -- target/ns_masking.sh@41 -- # [[ 66dfa8e1f2c047c393aae3b0278dfafd != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:36.653 03:15:10 -- target/ns_masking.sh@67 -- # ns_is_visible 0x2 00:14:36.653 03:15:10 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:36.653 03:15:10 -- target/ns_masking.sh@39 -- # grep 0x2 00:14:36.653 [ 1]:0x2 00:14:36.653 03:15:10 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:14:36.653 03:15:10 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:36.653 03:15:10 -- target/ns_masking.sh@40 -- # nguid=db67da53765c414789ce75e91c3abb9f 00:14:36.653 03:15:10 -- target/ns_masking.sh@41 -- # [[ db67da53765c414789ce75e91c3abb9f != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:36.653 03:15:10 -- target/ns_masking.sh@69 -- # disconnect 00:14:36.653 03:15:10 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:36.912 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:36.912 03:15:11 -- target/ns_masking.sh@73 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:37.170 03:15:11 -- target/ns_masking.sh@74 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 --no-auto-visible 00:14:37.170 03:15:11 -- target/ns_masking.sh@77 -- # connect 1 00:14:37.170 03:15:11 -- target/ns_masking.sh@18 -- # nvme connect -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I d22024f3-af8b-4c2f-8991-210b200102d2 -a 192.168.100.8 -s 4420 -i 4 00:14:37.429 03:15:11 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 1 00:14:37.429 03:15:11 -- common/autotest_common.sh@1184 -- # local i=0 00:14:37.429 03:15:11 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:37.429 03:15:11 -- common/autotest_common.sh@1186 -- # [[ -n 1 ]] 00:14:37.429 03:15:11 -- common/autotest_common.sh@1187 -- # nvme_device_counter=1 00:14:37.429 03:15:11 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:39.368 03:15:13 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:39.368 03:15:13 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:39.368 03:15:13 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:39.368 03:15:13 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:14:39.368 03:15:13 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:39.369 03:15:13 -- common/autotest_common.sh@1194 -- # return 0 00:14:39.369 03:15:13 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:14:39.369 03:15:13 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:14:39.369 03:15:13 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:14:39.369 03:15:13 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:14:39.369 03:15:13 -- target/ns_masking.sh@78 -- # NOT ns_is_visible 0x1 00:14:39.369 03:15:13 -- common/autotest_common.sh@638 -- # local es=0 00:14:39.369 03:15:13 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:14:39.369 03:15:13 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:14:39.369 03:15:13 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:39.369 03:15:13 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:14:39.369 03:15:13 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:39.369 03:15:13 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:14:39.369 03:15:13 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:39.369 03:15:13 -- target/ns_masking.sh@39 -- # grep 0x1 00:14:39.369 03:15:13 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:14:39.369 03:15:13 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:39.627 03:15:13 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:14:39.627 03:15:13 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:39.627 03:15:13 -- common/autotest_common.sh@641 -- # es=1 00:14:39.627 03:15:13 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:14:39.627 03:15:13 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:14:39.627 03:15:13 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:14:39.627 03:15:13 -- target/ns_masking.sh@79 -- # ns_is_visible 0x2 00:14:39.628 03:15:13 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:39.628 03:15:13 -- target/ns_masking.sh@39 -- # grep 0x2 00:14:39.628 [ 0]:0x2 00:14:39.628 03:15:13 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:14:39.628 03:15:13 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:39.628 03:15:13 -- target/ns_masking.sh@40 -- # nguid=db67da53765c414789ce75e91c3abb9f 00:14:39.628 03:15:13 -- target/ns_masking.sh@41 -- # [[ db67da53765c414789ce75e91c3abb9f != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:39.628 03:15:13 -- target/ns_masking.sh@82 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:14:39.628 03:15:14 -- target/ns_masking.sh@83 -- # ns_is_visible 0x1 00:14:39.628 03:15:14 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:39.628 03:15:14 -- target/ns_masking.sh@39 -- # grep 0x1 00:14:39.628 [ 0]:0x1 00:14:39.886 03:15:14 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:14:39.886 03:15:14 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:39.886 03:15:14 -- target/ns_masking.sh@40 -- # nguid=66dfa8e1f2c047c393aae3b0278dfafd 00:14:39.886 03:15:14 -- target/ns_masking.sh@41 -- # [[ 66dfa8e1f2c047c393aae3b0278dfafd != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:39.886 03:15:14 -- target/ns_masking.sh@84 -- # ns_is_visible 0x2 00:14:39.886 03:15:14 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:39.886 03:15:14 -- target/ns_masking.sh@39 -- # grep 0x2 00:14:39.886 [ 1]:0x2 00:14:39.886 03:15:14 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:14:39.886 03:15:14 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:39.886 03:15:14 -- target/ns_masking.sh@40 -- # nguid=db67da53765c414789ce75e91c3abb9f 00:14:39.886 03:15:14 -- target/ns_masking.sh@41 -- # [[ db67da53765c414789ce75e91c3abb9f != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:39.886 03:15:14 -- target/ns_masking.sh@87 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:14:39.886 03:15:14 -- target/ns_masking.sh@88 -- # NOT ns_is_visible 0x1 00:14:39.886 03:15:14 -- common/autotest_common.sh@638 -- # local es=0 00:14:39.886 03:15:14 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:14:39.886 03:15:14 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:14:39.887 03:15:14 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:39.887 03:15:14 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:14:39.887 03:15:14 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:39.887 03:15:14 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:14:39.887 03:15:14 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:40.143 03:15:14 -- target/ns_masking.sh@39 -- # grep 0x1 00:14:40.143 03:15:14 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:14:40.143 03:15:14 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:40.143 03:15:14 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:14:40.143 03:15:14 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:40.143 03:15:14 -- common/autotest_common.sh@641 -- # es=1 00:14:40.143 03:15:14 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:14:40.143 03:15:14 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:14:40.143 03:15:14 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:14:40.143 03:15:14 -- target/ns_masking.sh@89 -- # ns_is_visible 0x2 00:14:40.143 03:15:14 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:40.143 03:15:14 -- target/ns_masking.sh@39 -- # grep 0x2 00:14:40.143 [ 0]:0x2 00:14:40.143 03:15:14 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:14:40.143 03:15:14 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:40.143 03:15:14 -- target/ns_masking.sh@40 -- # nguid=db67da53765c414789ce75e91c3abb9f 00:14:40.143 03:15:14 -- target/ns_masking.sh@41 -- # [[ db67da53765c414789ce75e91c3abb9f != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:40.143 03:15:14 -- target/ns_masking.sh@91 -- # disconnect 00:14:40.143 03:15:14 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:40.401 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:40.401 03:15:14 -- target/ns_masking.sh@94 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:14:40.660 03:15:15 -- target/ns_masking.sh@95 -- # connect 2 00:14:40.660 03:15:15 -- target/ns_masking.sh@18 -- # nvme connect -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I d22024f3-af8b-4c2f-8991-210b200102d2 -a 192.168.100.8 -s 4420 -i 4 00:14:40.660 03:15:15 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 2 00:14:40.660 03:15:15 -- common/autotest_common.sh@1184 -- # local i=0 00:14:40.660 03:15:15 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:40.660 03:15:15 -- common/autotest_common.sh@1186 -- # [[ -n 2 ]] 00:14:40.660 03:15:15 -- common/autotest_common.sh@1187 -- # nvme_device_counter=2 00:14:40.660 03:15:15 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:43.195 03:15:17 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:43.195 03:15:17 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:43.195 03:15:17 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:43.195 03:15:17 -- common/autotest_common.sh@1193 -- # nvme_devices=2 00:14:43.195 03:15:17 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:43.195 03:15:17 -- common/autotest_common.sh@1194 -- # return 0 00:14:43.195 03:15:17 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:14:43.195 03:15:17 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:14:43.195 03:15:17 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:14:43.195 03:15:17 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:14:43.195 03:15:17 -- target/ns_masking.sh@96 -- # ns_is_visible 0x1 00:14:43.195 03:15:17 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:43.195 03:15:17 -- target/ns_masking.sh@39 -- # grep 0x1 00:14:43.195 [ 0]:0x1 00:14:43.195 03:15:17 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:14:43.195 03:15:17 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:43.195 03:15:17 -- target/ns_masking.sh@40 -- # nguid=66dfa8e1f2c047c393aae3b0278dfafd 00:14:43.195 03:15:17 -- target/ns_masking.sh@41 -- # [[ 66dfa8e1f2c047c393aae3b0278dfafd != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:43.195 03:15:17 -- target/ns_masking.sh@97 -- # ns_is_visible 0x2 00:14:43.195 03:15:17 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:43.195 03:15:17 -- target/ns_masking.sh@39 -- # grep 0x2 00:14:43.195 [ 1]:0x2 00:14:43.195 03:15:17 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:14:43.195 03:15:17 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:43.195 03:15:17 -- target/ns_masking.sh@40 -- # nguid=db67da53765c414789ce75e91c3abb9f 00:14:43.195 03:15:17 -- target/ns_masking.sh@41 -- # [[ db67da53765c414789ce75e91c3abb9f != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:43.195 03:15:17 -- target/ns_masking.sh@100 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:14:43.195 03:15:17 -- target/ns_masking.sh@101 -- # NOT ns_is_visible 0x1 00:14:43.195 03:15:17 -- common/autotest_common.sh@638 -- # local es=0 00:14:43.195 03:15:17 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:14:43.195 03:15:17 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:14:43.195 03:15:17 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:43.195 03:15:17 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:14:43.195 03:15:17 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:43.195 03:15:17 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:14:43.195 03:15:17 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:43.195 03:15:17 -- target/ns_masking.sh@39 -- # grep 0x1 00:14:43.195 03:15:17 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:14:43.195 03:15:17 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:43.195 03:15:17 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:14:43.195 03:15:17 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:43.195 03:15:17 -- common/autotest_common.sh@641 -- # es=1 00:14:43.195 03:15:17 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:14:43.195 03:15:17 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:14:43.195 03:15:17 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:14:43.195 03:15:17 -- target/ns_masking.sh@102 -- # ns_is_visible 0x2 00:14:43.195 03:15:17 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:43.195 03:15:17 -- target/ns_masking.sh@39 -- # grep 0x2 00:14:43.195 [ 0]:0x2 00:14:43.195 03:15:17 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:14:43.195 03:15:17 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:43.195 03:15:17 -- target/ns_masking.sh@40 -- # nguid=db67da53765c414789ce75e91c3abb9f 00:14:43.195 03:15:17 -- target/ns_masking.sh@41 -- # [[ db67da53765c414789ce75e91c3abb9f != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:43.195 03:15:17 -- target/ns_masking.sh@105 -- # NOT /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:14:43.195 03:15:17 -- common/autotest_common.sh@638 -- # local es=0 00:14:43.195 03:15:17 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:14:43.195 03:15:17 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:14:43.195 03:15:17 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:43.195 03:15:17 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:14:43.195 03:15:17 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:43.195 03:15:17 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:14:43.195 03:15:17 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:43.195 03:15:17 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:14:43.195 03:15:17 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py ]] 00:14:43.195 03:15:17 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:14:43.195 [2024-04-25 03:15:17.665583] nvmf_rpc.c:1779:nvmf_rpc_ns_visible_paused: *ERROR*: Unable to add/remove nqn.2016-06.io.spdk:host1 to namespace ID 2 00:14:43.195 request: 00:14:43.195 { 00:14:43.195 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:14:43.195 "nsid": 2, 00:14:43.195 "host": "nqn.2016-06.io.spdk:host1", 00:14:43.195 "method": "nvmf_ns_remove_host", 00:14:43.195 "req_id": 1 00:14:43.195 } 00:14:43.195 Got JSON-RPC error response 00:14:43.195 response: 00:14:43.195 { 00:14:43.195 "code": -32602, 00:14:43.195 "message": "Invalid parameters" 00:14:43.195 } 00:14:43.195 03:15:17 -- common/autotest_common.sh@641 -- # es=1 00:14:43.453 03:15:17 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:14:43.453 03:15:17 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:14:43.453 03:15:17 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:14:43.453 03:15:17 -- target/ns_masking.sh@106 -- # NOT ns_is_visible 0x1 00:14:43.453 03:15:17 -- common/autotest_common.sh@638 -- # local es=0 00:14:43.453 03:15:17 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:14:43.453 03:15:17 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:14:43.453 03:15:17 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:43.453 03:15:17 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:14:43.453 03:15:17 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:43.453 03:15:17 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:14:43.453 03:15:17 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:43.453 03:15:17 -- target/ns_masking.sh@39 -- # grep 0x1 00:14:43.453 03:15:17 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:14:43.453 03:15:17 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:43.453 03:15:17 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:14:43.453 03:15:17 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:43.453 03:15:17 -- common/autotest_common.sh@641 -- # es=1 00:14:43.453 03:15:17 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:14:43.453 03:15:17 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:14:43.453 03:15:17 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:14:43.453 03:15:17 -- target/ns_masking.sh@107 -- # ns_is_visible 0x2 00:14:43.453 03:15:17 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:14:43.453 03:15:17 -- target/ns_masking.sh@39 -- # grep 0x2 00:14:43.453 [ 0]:0x2 00:14:43.453 03:15:17 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:14:43.454 03:15:17 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:14:43.454 03:15:17 -- target/ns_masking.sh@40 -- # nguid=db67da53765c414789ce75e91c3abb9f 00:14:43.454 03:15:17 -- target/ns_masking.sh@41 -- # [[ db67da53765c414789ce75e91c3abb9f != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:14:43.454 03:15:17 -- target/ns_masking.sh@108 -- # disconnect 00:14:43.454 03:15:17 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:43.712 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:43.712 03:15:18 -- target/ns_masking.sh@110 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:43.971 03:15:18 -- target/ns_masking.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:14:43.971 03:15:18 -- target/ns_masking.sh@114 -- # nvmftestfini 00:14:43.971 03:15:18 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:43.971 03:15:18 -- nvmf/common.sh@117 -- # sync 00:14:43.971 03:15:18 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:14:43.971 03:15:18 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:14:43.971 03:15:18 -- nvmf/common.sh@120 -- # set +e 00:14:43.971 03:15:18 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:43.971 03:15:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:14:43.971 rmmod nvme_rdma 00:14:43.971 rmmod nvme_fabrics 00:14:43.971 03:15:18 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:43.971 03:15:18 -- nvmf/common.sh@124 -- # set -e 00:14:43.971 03:15:18 -- nvmf/common.sh@125 -- # return 0 00:14:43.971 03:15:18 -- nvmf/common.sh@478 -- # '[' -n 4041097 ']' 00:14:43.971 03:15:18 -- nvmf/common.sh@479 -- # killprocess 4041097 00:14:43.971 03:15:18 -- common/autotest_common.sh@936 -- # '[' -z 4041097 ']' 00:14:43.971 03:15:18 -- common/autotest_common.sh@940 -- # kill -0 4041097 00:14:43.971 03:15:18 -- common/autotest_common.sh@941 -- # uname 00:14:43.971 03:15:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:43.971 03:15:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4041097 00:14:43.971 03:15:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:43.971 03:15:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:43.971 03:15:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4041097' 00:14:43.971 killing process with pid 4041097 00:14:43.971 03:15:18 -- common/autotest_common.sh@955 -- # kill 4041097 00:14:43.971 03:15:18 -- common/autotest_common.sh@960 -- # wait 4041097 00:14:44.230 [2024-04-25 03:15:18.483396] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:14:44.230 03:15:18 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:44.230 03:15:18 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:14:44.230 00:14:44.230 real 0m18.814s 00:14:44.230 user 0m53.312s 00:14:44.230 sys 0m5.918s 00:14:44.230 03:15:18 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:14:44.230 03:15:18 -- common/autotest_common.sh@10 -- # set +x 00:14:44.230 ************************************ 00:14:44.230 END TEST nvmf_ns_masking 00:14:44.230 ************************************ 00:14:44.490 03:15:18 -- nvmf/nvmf.sh@37 -- # [[ 1 -eq 1 ]] 00:14:44.490 03:15:18 -- nvmf/nvmf.sh@38 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=rdma 00:14:44.490 03:15:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:44.490 03:15:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:44.490 03:15:18 -- common/autotest_common.sh@10 -- # set +x 00:14:44.490 ************************************ 00:14:44.490 START TEST nvmf_nvme_cli 00:14:44.490 ************************************ 00:14:44.490 03:15:18 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=rdma 00:14:44.490 * Looking for test storage... 00:14:44.490 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:14:44.490 03:15:18 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:14:44.490 03:15:18 -- nvmf/common.sh@7 -- # uname -s 00:14:44.490 03:15:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:44.490 03:15:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:44.490 03:15:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:44.490 03:15:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:44.490 03:15:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:44.490 03:15:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:44.490 03:15:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:44.490 03:15:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:44.490 03:15:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:44.490 03:15:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:44.490 03:15:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:14:44.490 03:15:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:14:44.490 03:15:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:44.490 03:15:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:44.490 03:15:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:44.490 03:15:18 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:44.490 03:15:18 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:14:44.490 03:15:18 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:44.490 03:15:18 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:44.490 03:15:18 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:44.490 03:15:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:44.490 03:15:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:44.490 03:15:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:44.490 03:15:18 -- paths/export.sh@5 -- # export PATH 00:14:44.490 03:15:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:44.490 03:15:18 -- nvmf/common.sh@47 -- # : 0 00:14:44.490 03:15:18 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:44.490 03:15:18 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:44.490 03:15:18 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:44.490 03:15:18 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:44.490 03:15:18 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:44.490 03:15:18 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:44.490 03:15:18 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:44.490 03:15:18 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:44.490 03:15:18 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:44.490 03:15:18 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:44.490 03:15:18 -- target/nvme_cli.sh@14 -- # devs=() 00:14:44.490 03:15:18 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:14:44.490 03:15:18 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:14:44.490 03:15:18 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:44.490 03:15:18 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:44.490 03:15:18 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:44.490 03:15:18 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:44.490 03:15:18 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:44.490 03:15:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:44.490 03:15:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:44.490 03:15:18 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:44.490 03:15:18 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:44.490 03:15:18 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:44.490 03:15:18 -- common/autotest_common.sh@10 -- # set +x 00:14:51.057 03:15:24 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:51.057 03:15:24 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:51.057 03:15:24 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:51.057 03:15:24 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:51.057 03:15:24 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:51.057 03:15:24 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:51.057 03:15:24 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:51.057 03:15:24 -- nvmf/common.sh@295 -- # net_devs=() 00:14:51.057 03:15:24 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:51.057 03:15:24 -- nvmf/common.sh@296 -- # e810=() 00:14:51.057 03:15:24 -- nvmf/common.sh@296 -- # local -ga e810 00:14:51.057 03:15:24 -- nvmf/common.sh@297 -- # x722=() 00:14:51.057 03:15:24 -- nvmf/common.sh@297 -- # local -ga x722 00:14:51.057 03:15:24 -- nvmf/common.sh@298 -- # mlx=() 00:14:51.057 03:15:24 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:51.057 03:15:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:51.058 03:15:24 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:51.058 03:15:24 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:51.058 03:15:24 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:51.058 03:15:24 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:51.058 03:15:24 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:51.058 03:15:24 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:51.058 03:15:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:51.058 03:15:24 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:51.058 03:15:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:51.058 03:15:24 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:51.058 03:15:24 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:51.058 03:15:24 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:14:51.058 03:15:24 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:14:51.058 03:15:24 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:14:51.058 03:15:24 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:14:51.058 03:15:24 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:14:51.058 03:15:24 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:14:51.058 03:15:24 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:51.058 03:15:24 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:51.058 03:15:24 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:14:51.058 Found 0000:af:00.0 (0x8086 - 0x159b) 00:14:51.058 03:15:24 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:51.058 03:15:24 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:51.058 03:15:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:51.058 03:15:24 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:51.058 03:15:24 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:51.058 03:15:24 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:51.058 03:15:24 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:51.058 03:15:24 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:14:51.058 Found 0000:af:00.1 (0x8086 - 0x159b) 00:14:51.058 03:15:24 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:51.058 03:15:24 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:51.058 03:15:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:51.058 03:15:24 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:51.058 03:15:24 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:51.058 03:15:24 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:51.058 03:15:24 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:51.058 03:15:24 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:14:51.058 03:15:24 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:14:51.058 03:15:24 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:14:51.058 03:15:24 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:14:51.058 03:15:24 -- nvmf/common.sh@377 -- # modinfo irdma 00:14:51.058 03:15:24 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:14:51.058 03:15:24 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:51.058 03:15:24 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:51.058 03:15:24 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:51.058 03:15:24 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:51.058 03:15:24 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:14:51.058 Found net devices under 0000:af:00.0: cvl_0_0 00:14:51.058 03:15:24 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:51.058 03:15:24 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:51.058 03:15:24 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:51.058 03:15:24 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:51.058 03:15:24 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:51.058 03:15:24 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:14:51.058 Found net devices under 0000:af:00.1: cvl_0_1 00:14:51.058 03:15:24 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:51.058 03:15:24 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:51.058 03:15:24 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:51.058 03:15:24 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:51.058 03:15:24 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:14:51.058 03:15:24 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:14:51.058 03:15:24 -- nvmf/common.sh@409 -- # rdma_device_init 00:14:51.058 03:15:24 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:14:51.058 03:15:24 -- nvmf/common.sh@58 -- # uname 00:14:51.058 03:15:24 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:14:51.058 03:15:24 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:14:51.058 03:15:24 -- nvmf/common.sh@63 -- # modprobe ib_core 00:14:51.058 03:15:24 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:14:51.058 03:15:24 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:14:51.058 03:15:24 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:14:51.058 03:15:24 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:14:51.058 03:15:24 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:14:51.058 03:15:24 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:14:51.058 03:15:24 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:14:51.058 03:15:24 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:14:51.058 03:15:24 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:51.058 03:15:24 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:51.058 03:15:24 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:51.058 03:15:24 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:51.058 03:15:24 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:51.058 03:15:24 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:51.058 03:15:24 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:51.058 03:15:24 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:14:51.058 03:15:24 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:14:51.058 03:15:24 -- nvmf/common.sh@105 -- # continue 2 00:14:51.058 03:15:24 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:51.058 03:15:24 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:51.058 03:15:24 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:14:51.058 03:15:24 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:51.058 03:15:24 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:14:51.058 03:15:24 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:14:51.058 03:15:24 -- nvmf/common.sh@105 -- # continue 2 00:14:51.058 03:15:24 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:51.058 03:15:24 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:14:51.058 03:15:24 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:14:51.058 03:15:24 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:14:51.058 03:15:24 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:51.058 03:15:24 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:51.058 03:15:24 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:14:51.058 03:15:24 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:14:51.058 03:15:24 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:14:51.058 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:14:51.058 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:14:51.058 altname enp175s0f0np0 00:14:51.058 altname ens801f0np0 00:14:51.058 inet 192.168.100.8/24 scope global cvl_0_0 00:14:51.058 valid_lft forever preferred_lft forever 00:14:51.058 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:14:51.058 valid_lft forever preferred_lft forever 00:14:51.058 03:15:24 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:51.058 03:15:24 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:14:51.058 03:15:24 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:14:51.058 03:15:24 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:14:51.058 03:15:24 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:51.058 03:15:24 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:51.058 03:15:24 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:14:51.058 03:15:24 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:14:51.058 03:15:24 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:14:51.058 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:14:51.058 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:14:51.058 altname enp175s0f1np1 00:14:51.058 altname ens801f1np1 00:14:51.058 inet 192.168.100.9/24 scope global cvl_0_1 00:14:51.058 valid_lft forever preferred_lft forever 00:14:51.058 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:14:51.058 valid_lft forever preferred_lft forever 00:14:51.058 03:15:24 -- nvmf/common.sh@411 -- # return 0 00:14:51.058 03:15:24 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:51.058 03:15:24 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:14:51.058 03:15:24 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:14:51.058 03:15:24 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:14:51.058 03:15:24 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:14:51.058 03:15:24 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:51.058 03:15:24 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:51.058 03:15:24 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:51.058 03:15:24 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:51.058 03:15:24 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:51.058 03:15:24 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:51.058 03:15:24 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:51.058 03:15:24 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:14:51.058 03:15:24 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:14:51.058 03:15:24 -- nvmf/common.sh@105 -- # continue 2 00:14:51.058 03:15:24 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:51.058 03:15:24 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:51.058 03:15:24 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:14:51.058 03:15:24 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:51.058 03:15:24 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:14:51.058 03:15:24 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:14:51.058 03:15:24 -- nvmf/common.sh@105 -- # continue 2 00:14:51.058 03:15:24 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:51.058 03:15:24 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:14:51.058 03:15:24 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:14:51.058 03:15:24 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:14:51.058 03:15:24 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:51.058 03:15:24 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:51.058 03:15:24 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:51.058 03:15:24 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:14:51.059 03:15:24 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:14:51.059 03:15:24 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:14:51.059 03:15:24 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:51.059 03:15:24 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:51.059 03:15:24 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:14:51.059 192.168.100.9' 00:14:51.059 03:15:24 -- nvmf/common.sh@446 -- # head -n 1 00:14:51.059 03:15:24 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:14:51.059 192.168.100.9' 00:14:51.059 03:15:24 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:14:51.059 03:15:24 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:14:51.059 192.168.100.9' 00:14:51.059 03:15:24 -- nvmf/common.sh@447 -- # tail -n +2 00:14:51.059 03:15:24 -- nvmf/common.sh@447 -- # head -n 1 00:14:51.059 03:15:24 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:14:51.059 03:15:24 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:14:51.059 03:15:24 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:14:51.059 03:15:24 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:14:51.059 03:15:24 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:14:51.059 03:15:24 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:14:51.059 03:15:24 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:14:51.059 03:15:24 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:51.059 03:15:24 -- common/autotest_common.sh@710 -- # xtrace_disable 00:14:51.059 03:15:24 -- common/autotest_common.sh@10 -- # set +x 00:14:51.059 03:15:24 -- nvmf/common.sh@470 -- # nvmfpid=4047017 00:14:51.059 03:15:24 -- nvmf/common.sh@471 -- # waitforlisten 4047017 00:14:51.059 03:15:24 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:51.059 03:15:24 -- common/autotest_common.sh@817 -- # '[' -z 4047017 ']' 00:14:51.059 03:15:24 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:51.059 03:15:24 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:51.059 03:15:24 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:51.059 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:51.059 03:15:24 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:51.059 03:15:24 -- common/autotest_common.sh@10 -- # set +x 00:14:51.059 [2024-04-25 03:15:24.882220] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:14:51.059 [2024-04-25 03:15:24.882264] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:51.059 EAL: No free 2048 kB hugepages reported on node 1 00:14:51.059 [2024-04-25 03:15:24.943258] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:51.059 [2024-04-25 03:15:25.020475] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:51.059 [2024-04-25 03:15:25.020514] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:51.059 [2024-04-25 03:15:25.020521] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:51.059 [2024-04-25 03:15:25.020527] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:51.059 [2024-04-25 03:15:25.020532] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:51.059 [2024-04-25 03:15:25.020576] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:51.059 [2024-04-25 03:15:25.020679] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:51.059 [2024-04-25 03:15:25.020770] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:51.059 [2024-04-25 03:15:25.020771] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:51.318 03:15:25 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:51.318 03:15:25 -- common/autotest_common.sh@850 -- # return 0 00:14:51.318 03:15:25 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:51.318 03:15:25 -- common/autotest_common.sh@716 -- # xtrace_disable 00:14:51.318 03:15:25 -- common/autotest_common.sh@10 -- # set +x 00:14:51.318 03:15:25 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:51.318 03:15:25 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:14:51.318 03:15:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:51.318 03:15:25 -- common/autotest_common.sh@10 -- # set +x 00:14:51.318 [2024-04-25 03:15:25.728097] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x10a9ea0/0x10a94e0) succeed. 00:14:51.318 [2024-04-25 03:15:25.737915] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x10ab210/0x10a9a60) succeed. 00:14:51.318 [2024-04-25 03:15:25.737937] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:14:51.318 03:15:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:51.318 03:15:25 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:51.318 03:15:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:51.318 03:15:25 -- common/autotest_common.sh@10 -- # set +x 00:14:51.318 Malloc0 00:14:51.318 03:15:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:51.318 03:15:25 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:14:51.318 03:15:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:51.318 03:15:25 -- common/autotest_common.sh@10 -- # set +x 00:14:51.318 Malloc1 00:14:51.318 03:15:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:51.318 03:15:25 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:14:51.318 03:15:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:51.318 03:15:25 -- common/autotest_common.sh@10 -- # set +x 00:14:51.318 03:15:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:51.319 03:15:25 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:51.319 03:15:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:51.319 03:15:25 -- common/autotest_common.sh@10 -- # set +x 00:14:51.319 03:15:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:51.319 03:15:25 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:51.319 03:15:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:51.319 03:15:25 -- common/autotest_common.sh@10 -- # set +x 00:14:51.578 03:15:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:51.578 03:15:25 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:51.578 03:15:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:51.578 03:15:25 -- common/autotest_common.sh@10 -- # set +x 00:14:51.578 [2024-04-25 03:15:25.822703] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:51.578 03:15:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:51.578 03:15:25 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:14:51.578 03:15:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:51.578 03:15:25 -- common/autotest_common.sh@10 -- # set +x 00:14:51.578 03:15:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:51.578 03:15:25 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 4420 00:14:51.578 00:14:51.578 Discovery Log Number of Records 2, Generation counter 2 00:14:51.578 =====Discovery Log Entry 0====== 00:14:51.578 trtype: rdma 00:14:51.578 adrfam: ipv4 00:14:51.578 subtype: current discovery subsystem 00:14:51.578 treq: not required 00:14:51.578 portid: 0 00:14:51.578 trsvcid: 4420 00:14:51.578 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:14:51.578 traddr: 192.168.100.8 00:14:51.578 eflags: explicit discovery connections, duplicate discovery information 00:14:51.578 rdma_prtype: not specified 00:14:51.578 rdma_qptype: connected 00:14:51.578 rdma_cms: rdma-cm 00:14:51.578 rdma_pkey: 0x0000 00:14:51.578 =====Discovery Log Entry 1====== 00:14:51.578 trtype: rdma 00:14:51.578 adrfam: ipv4 00:14:51.578 subtype: nvme subsystem 00:14:51.578 treq: not required 00:14:51.578 portid: 0 00:14:51.578 trsvcid: 4420 00:14:51.578 subnqn: nqn.2016-06.io.spdk:cnode1 00:14:51.578 traddr: 192.168.100.8 00:14:51.578 eflags: none 00:14:51.578 rdma_prtype: not specified 00:14:51.578 rdma_qptype: connected 00:14:51.578 rdma_cms: rdma-cm 00:14:51.578 rdma_pkey: 0x0000 00:14:51.578 03:15:25 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:14:51.578 03:15:25 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:14:51.578 03:15:25 -- nvmf/common.sh@511 -- # local dev _ 00:14:51.578 03:15:25 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:51.578 03:15:25 -- nvmf/common.sh@510 -- # nvme list 00:14:51.578 03:15:25 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:14:51.578 03:15:25 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:51.578 03:15:25 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:14:51.578 03:15:25 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:51.578 03:15:25 -- nvmf/common.sh@514 -- # [[ /dev/nvme1n2 == /dev/nvme* ]] 00:14:51.578 03:15:25 -- nvmf/common.sh@515 -- # echo /dev/nvme1n2 00:14:51.578 03:15:25 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:51.578 03:15:25 -- nvmf/common.sh@514 -- # [[ /dev/nvme1n1 == /dev/nvme* ]] 00:14:51.578 03:15:25 -- nvmf/common.sh@515 -- # echo /dev/nvme1n1 00:14:51.578 03:15:25 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:51.578 03:15:25 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=2 00:14:51.578 03:15:25 -- target/nvme_cli.sh@32 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:51.837 03:15:26 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:14:51.838 03:15:26 -- common/autotest_common.sh@1184 -- # local i=0 00:14:51.838 03:15:26 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:51.838 03:15:26 -- common/autotest_common.sh@1186 -- # [[ -n 2 ]] 00:14:51.838 03:15:26 -- common/autotest_common.sh@1187 -- # nvme_device_counter=2 00:14:51.838 03:15:26 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:53.745 03:15:28 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:53.745 03:15:28 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:53.745 03:15:28 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:53.745 03:15:28 -- common/autotest_common.sh@1193 -- # nvme_devices=2 00:14:53.745 03:15:28 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:53.745 03:15:28 -- common/autotest_common.sh@1194 -- # return 0 00:14:53.745 03:15:28 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:14:53.745 03:15:28 -- nvmf/common.sh@511 -- # local dev _ 00:14:53.745 03:15:28 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:53.745 03:15:28 -- nvmf/common.sh@510 -- # nvme list 00:14:53.745 03:15:28 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:14:53.745 03:15:28 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:53.745 03:15:28 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:14:53.745 03:15:28 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:53.745 03:15:28 -- nvmf/common.sh@514 -- # [[ /dev/nvme1n2 == /dev/nvme* ]] 00:14:53.745 03:15:28 -- nvmf/common.sh@515 -- # echo /dev/nvme1n2 00:14:53.745 03:15:28 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:53.745 03:15:28 -- nvmf/common.sh@514 -- # [[ /dev/nvme1n1 == /dev/nvme* ]] 00:14:53.745 03:15:28 -- nvmf/common.sh@515 -- # echo /dev/nvme1n1 00:14:53.745 03:15:28 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:53.745 03:15:28 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:53.745 03:15:28 -- nvmf/common.sh@515 -- # echo /dev/nvme0n2 00:14:53.745 03:15:28 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:53.745 03:15:28 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:53.745 03:15:28 -- nvmf/common.sh@515 -- # echo /dev/nvme0n1 00:14:53.745 03:15:28 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:53.745 03:15:28 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme1n2 00:14:53.745 /dev/nvme1n1 00:14:53.745 /dev/nvme0n2 00:14:53.745 /dev/nvme0n1 ]] 00:14:53.745 03:15:28 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:14:53.745 03:15:28 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:14:53.745 03:15:28 -- nvmf/common.sh@511 -- # local dev _ 00:14:53.745 03:15:28 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:53.745 03:15:28 -- nvmf/common.sh@510 -- # nvme list 00:14:54.004 03:15:28 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:14:54.004 03:15:28 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:54.004 03:15:28 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:14:54.004 03:15:28 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:54.004 03:15:28 -- nvmf/common.sh@514 -- # [[ /dev/nvme1n2 == /dev/nvme* ]] 00:14:54.004 03:15:28 -- nvmf/common.sh@515 -- # echo /dev/nvme1n2 00:14:54.004 03:15:28 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:54.004 03:15:28 -- nvmf/common.sh@514 -- # [[ /dev/nvme1n1 == /dev/nvme* ]] 00:14:54.004 03:15:28 -- nvmf/common.sh@515 -- # echo /dev/nvme1n1 00:14:54.004 03:15:28 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:54.004 03:15:28 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:54.004 03:15:28 -- nvmf/common.sh@515 -- # echo /dev/nvme0n2 00:14:54.004 03:15:28 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:54.004 03:15:28 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:54.004 03:15:28 -- nvmf/common.sh@515 -- # echo /dev/nvme0n1 00:14:54.004 03:15:28 -- nvmf/common.sh@513 -- # read -r dev _ 00:14:54.004 03:15:28 -- target/nvme_cli.sh@59 -- # nvme_num=4 00:14:54.004 03:15:28 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:54.940 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:54.940 03:15:29 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:54.940 03:15:29 -- common/autotest_common.sh@1205 -- # local i=0 00:14:54.940 03:15:29 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:14:54.940 03:15:29 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:54.940 03:15:29 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:14:54.940 03:15:29 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:54.940 03:15:29 -- common/autotest_common.sh@1217 -- # return 0 00:14:54.940 03:15:29 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:14:54.940 03:15:29 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:54.940 03:15:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:54.940 03:15:29 -- common/autotest_common.sh@10 -- # set +x 00:14:54.940 03:15:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:54.940 03:15:29 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:54.940 03:15:29 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:14:54.940 03:15:29 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:54.940 03:15:29 -- nvmf/common.sh@117 -- # sync 00:14:54.940 03:15:29 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:14:54.940 03:15:29 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:14:54.940 03:15:29 -- nvmf/common.sh@120 -- # set +e 00:14:54.940 03:15:29 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:54.940 03:15:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:14:54.940 rmmod nvme_rdma 00:14:54.940 rmmod nvme_fabrics 00:14:54.940 03:15:29 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:54.940 03:15:29 -- nvmf/common.sh@124 -- # set -e 00:14:54.940 03:15:29 -- nvmf/common.sh@125 -- # return 0 00:14:54.940 03:15:29 -- nvmf/common.sh@478 -- # '[' -n 4047017 ']' 00:14:54.940 03:15:29 -- nvmf/common.sh@479 -- # killprocess 4047017 00:14:54.940 03:15:29 -- common/autotest_common.sh@936 -- # '[' -z 4047017 ']' 00:14:54.940 03:15:29 -- common/autotest_common.sh@940 -- # kill -0 4047017 00:14:54.940 03:15:29 -- common/autotest_common.sh@941 -- # uname 00:14:54.940 03:15:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:54.940 03:15:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4047017 00:14:54.940 03:15:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:54.940 03:15:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:54.940 03:15:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4047017' 00:14:54.940 killing process with pid 4047017 00:14:54.940 03:15:29 -- common/autotest_common.sh@955 -- # kill 4047017 00:14:54.940 03:15:29 -- common/autotest_common.sh@960 -- # wait 4047017 00:14:54.940 [2024-04-25 03:15:29.372612] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:14:55.199 03:15:29 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:55.199 03:15:29 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:14:55.199 00:14:55.199 real 0m10.753s 00:14:55.199 user 0m20.033s 00:14:55.199 sys 0m4.913s 00:14:55.199 03:15:29 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:14:55.199 03:15:29 -- common/autotest_common.sh@10 -- # set +x 00:14:55.199 ************************************ 00:14:55.199 END TEST nvmf_nvme_cli 00:14:55.200 ************************************ 00:14:55.200 03:15:29 -- nvmf/nvmf.sh@40 -- # [[ 0 -eq 1 ]] 00:14:55.200 03:15:29 -- nvmf/nvmf.sh@47 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=rdma 00:14:55.200 03:15:29 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:55.200 03:15:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:55.200 03:15:29 -- common/autotest_common.sh@10 -- # set +x 00:14:55.459 ************************************ 00:14:55.459 START TEST nvmf_host_management 00:14:55.459 ************************************ 00:14:55.459 03:15:29 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=rdma 00:14:55.459 * Looking for test storage... 00:14:55.459 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:14:55.459 03:15:29 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:14:55.459 03:15:29 -- nvmf/common.sh@7 -- # uname -s 00:14:55.459 03:15:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:55.459 03:15:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:55.459 03:15:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:55.459 03:15:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:55.459 03:15:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:55.459 03:15:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:55.459 03:15:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:55.459 03:15:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:55.459 03:15:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:55.459 03:15:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:55.459 03:15:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:14:55.459 03:15:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:14:55.459 03:15:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:55.459 03:15:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:55.459 03:15:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:55.459 03:15:29 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:55.459 03:15:29 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:14:55.459 03:15:29 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:55.459 03:15:29 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:55.459 03:15:29 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:55.459 03:15:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:55.459 03:15:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:55.459 03:15:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:55.459 03:15:29 -- paths/export.sh@5 -- # export PATH 00:14:55.459 03:15:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:55.459 03:15:29 -- nvmf/common.sh@47 -- # : 0 00:14:55.459 03:15:29 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:55.459 03:15:29 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:55.459 03:15:29 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:55.459 03:15:29 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:55.459 03:15:29 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:55.459 03:15:29 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:55.459 03:15:29 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:55.459 03:15:29 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:55.459 03:15:29 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:55.459 03:15:29 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:55.459 03:15:29 -- target/host_management.sh@105 -- # nvmftestinit 00:14:55.459 03:15:29 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:14:55.459 03:15:29 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:55.459 03:15:29 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:55.459 03:15:29 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:55.459 03:15:29 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:55.459 03:15:29 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:55.459 03:15:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:55.459 03:15:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:55.459 03:15:29 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:55.459 03:15:29 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:55.459 03:15:29 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:55.459 03:15:29 -- common/autotest_common.sh@10 -- # set +x 00:15:02.040 03:15:35 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:02.040 03:15:35 -- nvmf/common.sh@291 -- # pci_devs=() 00:15:02.040 03:15:35 -- nvmf/common.sh@291 -- # local -a pci_devs 00:15:02.040 03:15:35 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:15:02.040 03:15:35 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:15:02.040 03:15:35 -- nvmf/common.sh@293 -- # pci_drivers=() 00:15:02.040 03:15:35 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:15:02.040 03:15:35 -- nvmf/common.sh@295 -- # net_devs=() 00:15:02.040 03:15:35 -- nvmf/common.sh@295 -- # local -ga net_devs 00:15:02.040 03:15:35 -- nvmf/common.sh@296 -- # e810=() 00:15:02.040 03:15:35 -- nvmf/common.sh@296 -- # local -ga e810 00:15:02.040 03:15:35 -- nvmf/common.sh@297 -- # x722=() 00:15:02.040 03:15:35 -- nvmf/common.sh@297 -- # local -ga x722 00:15:02.040 03:15:35 -- nvmf/common.sh@298 -- # mlx=() 00:15:02.040 03:15:35 -- nvmf/common.sh@298 -- # local -ga mlx 00:15:02.040 03:15:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:02.040 03:15:35 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:02.040 03:15:35 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:02.040 03:15:35 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:02.040 03:15:35 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:02.040 03:15:35 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:02.040 03:15:35 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:02.040 03:15:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:02.040 03:15:35 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:02.040 03:15:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:02.040 03:15:35 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:02.040 03:15:35 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:15:02.040 03:15:35 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:15:02.040 03:15:35 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:15:02.040 03:15:35 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:15:02.040 03:15:35 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:15:02.040 03:15:35 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:15:02.040 03:15:35 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:15:02.040 03:15:35 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:15:02.040 03:15:35 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:02.040 03:15:35 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:15:02.040 Found 0000:af:00.0 (0x8086 - 0x159b) 00:15:02.040 03:15:35 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:15:02.040 03:15:35 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:15:02.040 03:15:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:02.040 03:15:35 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:02.040 03:15:35 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:02.040 03:15:35 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:02.040 03:15:35 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:02.040 03:15:35 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:15:02.040 Found 0000:af:00.1 (0x8086 - 0x159b) 00:15:02.040 03:15:35 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:15:02.040 03:15:35 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:15:02.040 03:15:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:02.040 03:15:35 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:02.040 03:15:35 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:02.040 03:15:35 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:02.040 03:15:35 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:15:02.040 03:15:35 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:15:02.040 03:15:35 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:15:02.040 03:15:35 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:15:02.040 03:15:35 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:15:02.040 03:15:35 -- nvmf/common.sh@377 -- # modinfo irdma 00:15:02.040 03:15:35 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:15:02.040 03:15:35 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:02.040 03:15:35 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:02.040 03:15:35 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:02.040 03:15:35 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:02.040 03:15:35 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:15:02.040 Found net devices under 0000:af:00.0: cvl_0_0 00:15:02.040 03:15:35 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:02.040 03:15:35 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:02.040 03:15:35 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:02.040 03:15:35 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:02.040 03:15:35 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:02.040 03:15:35 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:15:02.040 Found net devices under 0000:af:00.1: cvl_0_1 00:15:02.040 03:15:35 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:02.040 03:15:35 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:15:02.040 03:15:35 -- nvmf/common.sh@403 -- # is_hw=yes 00:15:02.040 03:15:35 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:15:02.040 03:15:35 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:15:02.040 03:15:35 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:15:02.040 03:15:35 -- nvmf/common.sh@409 -- # rdma_device_init 00:15:02.040 03:15:35 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:15:02.040 03:15:35 -- nvmf/common.sh@58 -- # uname 00:15:02.040 03:15:35 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:15:02.040 03:15:35 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:15:02.040 03:15:35 -- nvmf/common.sh@63 -- # modprobe ib_core 00:15:02.040 03:15:35 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:15:02.040 03:15:35 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:15:02.040 03:15:35 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:15:02.041 03:15:35 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:15:02.041 03:15:35 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:15:02.041 03:15:35 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:15:02.041 03:15:35 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:15:02.041 03:15:35 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:15:02.041 03:15:35 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:02.041 03:15:35 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:02.041 03:15:35 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:02.041 03:15:35 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:02.041 03:15:35 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:02.041 03:15:35 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:02.041 03:15:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:02.041 03:15:35 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:15:02.041 03:15:35 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:15:02.041 03:15:35 -- nvmf/common.sh@105 -- # continue 2 00:15:02.041 03:15:35 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:02.041 03:15:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:02.041 03:15:35 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:15:02.041 03:15:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:02.041 03:15:35 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:15:02.041 03:15:35 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:15:02.041 03:15:35 -- nvmf/common.sh@105 -- # continue 2 00:15:02.041 03:15:35 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:02.041 03:15:35 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:15:02.041 03:15:35 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:15:02.041 03:15:35 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:15:02.041 03:15:35 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:02.041 03:15:35 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:02.041 03:15:35 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:15:02.041 03:15:35 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:15:02.041 03:15:35 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:15:02.041 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:15:02.041 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:15:02.041 altname enp175s0f0np0 00:15:02.041 altname ens801f0np0 00:15:02.041 inet 192.168.100.8/24 scope global cvl_0_0 00:15:02.041 valid_lft forever preferred_lft forever 00:15:02.041 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:15:02.041 valid_lft forever preferred_lft forever 00:15:02.041 03:15:35 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:02.041 03:15:35 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:15:02.041 03:15:35 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:15:02.041 03:15:35 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:15:02.041 03:15:35 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:02.041 03:15:35 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:02.041 03:15:35 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:15:02.041 03:15:35 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:15:02.041 03:15:35 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:15:02.041 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:15:02.041 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:15:02.041 altname enp175s0f1np1 00:15:02.041 altname ens801f1np1 00:15:02.041 inet 192.168.100.9/24 scope global cvl_0_1 00:15:02.041 valid_lft forever preferred_lft forever 00:15:02.041 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:15:02.041 valid_lft forever preferred_lft forever 00:15:02.041 03:15:35 -- nvmf/common.sh@411 -- # return 0 00:15:02.041 03:15:35 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:15:02.041 03:15:35 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:15:02.041 03:15:35 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:15:02.041 03:15:35 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:15:02.041 03:15:35 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:15:02.041 03:15:35 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:02.041 03:15:35 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:02.041 03:15:35 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:02.041 03:15:35 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:02.041 03:15:35 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:02.041 03:15:35 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:02.041 03:15:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:02.041 03:15:35 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:15:02.041 03:15:35 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:15:02.041 03:15:35 -- nvmf/common.sh@105 -- # continue 2 00:15:02.041 03:15:35 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:02.041 03:15:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:02.041 03:15:35 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:15:02.041 03:15:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:02.041 03:15:35 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:15:02.041 03:15:35 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:15:02.041 03:15:35 -- nvmf/common.sh@105 -- # continue 2 00:15:02.041 03:15:35 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:02.041 03:15:35 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:15:02.041 03:15:35 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:15:02.041 03:15:35 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:15:02.041 03:15:35 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:02.041 03:15:35 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:02.041 03:15:35 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:02.041 03:15:35 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:15:02.041 03:15:35 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:15:02.041 03:15:35 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:15:02.041 03:15:35 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:02.041 03:15:35 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:02.041 03:15:35 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:15:02.041 192.168.100.9' 00:15:02.041 03:15:35 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:15:02.041 192.168.100.9' 00:15:02.041 03:15:35 -- nvmf/common.sh@446 -- # head -n 1 00:15:02.041 03:15:35 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:15:02.041 03:15:35 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:15:02.041 192.168.100.9' 00:15:02.041 03:15:35 -- nvmf/common.sh@447 -- # tail -n +2 00:15:02.041 03:15:35 -- nvmf/common.sh@447 -- # head -n 1 00:15:02.041 03:15:35 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:15:02.041 03:15:35 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:15:02.041 03:15:35 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:15:02.041 03:15:35 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:15:02.041 03:15:35 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:15:02.041 03:15:35 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:15:02.041 03:15:35 -- target/host_management.sh@107 -- # run_test nvmf_host_management nvmf_host_management 00:15:02.041 03:15:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:15:02.041 03:15:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:02.041 03:15:35 -- common/autotest_common.sh@10 -- # set +x 00:15:02.041 ************************************ 00:15:02.041 START TEST nvmf_host_management 00:15:02.041 ************************************ 00:15:02.041 03:15:36 -- common/autotest_common.sh@1111 -- # nvmf_host_management 00:15:02.041 03:15:36 -- target/host_management.sh@69 -- # starttarget 00:15:02.041 03:15:36 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:15:02.041 03:15:36 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:15:02.041 03:15:36 -- common/autotest_common.sh@710 -- # xtrace_disable 00:15:02.041 03:15:36 -- common/autotest_common.sh@10 -- # set +x 00:15:02.041 03:15:36 -- nvmf/common.sh@470 -- # nvmfpid=4051309 00:15:02.041 03:15:36 -- nvmf/common.sh@471 -- # waitforlisten 4051309 00:15:02.041 03:15:36 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:15:02.041 03:15:36 -- common/autotest_common.sh@817 -- # '[' -z 4051309 ']' 00:15:02.041 03:15:36 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:02.041 03:15:36 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:02.041 03:15:36 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:02.041 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:02.041 03:15:36 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:02.041 03:15:36 -- common/autotest_common.sh@10 -- # set +x 00:15:02.041 [2024-04-25 03:15:36.057352] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:15:02.041 [2024-04-25 03:15:36.057386] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:02.041 EAL: No free 2048 kB hugepages reported on node 1 00:15:02.041 [2024-04-25 03:15:36.117377] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:02.041 [2024-04-25 03:15:36.195526] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:02.041 [2024-04-25 03:15:36.195560] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:02.041 [2024-04-25 03:15:36.195568] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:02.041 [2024-04-25 03:15:36.195573] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:02.041 [2024-04-25 03:15:36.195578] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:02.041 [2024-04-25 03:15:36.195673] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:02.041 [2024-04-25 03:15:36.195758] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:02.041 [2024-04-25 03:15:36.195889] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:02.041 [2024-04-25 03:15:36.195889] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:15:02.648 03:15:36 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:02.648 03:15:36 -- common/autotest_common.sh@850 -- # return 0 00:15:02.648 03:15:36 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:15:02.648 03:15:36 -- common/autotest_common.sh@716 -- # xtrace_disable 00:15:02.648 03:15:36 -- common/autotest_common.sh@10 -- # set +x 00:15:02.648 03:15:36 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:02.648 03:15:36 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:15:02.648 03:15:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:02.648 03:15:36 -- common/autotest_common.sh@10 -- # set +x 00:15:02.648 [2024-04-25 03:15:36.914398] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x1d06190/0x1d057d0) succeed. 00:15:02.648 [2024-04-25 03:15:36.924498] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x1d07500/0x1d05d50) succeed. 00:15:02.648 [2024-04-25 03:15:36.924522] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:15:02.648 03:15:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:02.648 03:15:36 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:15:02.648 03:15:36 -- common/autotest_common.sh@710 -- # xtrace_disable 00:15:02.648 03:15:36 -- common/autotest_common.sh@10 -- # set +x 00:15:02.648 03:15:36 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:15:02.648 03:15:36 -- target/host_management.sh@23 -- # cat 00:15:02.648 03:15:36 -- target/host_management.sh@30 -- # rpc_cmd 00:15:02.648 03:15:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:02.648 03:15:36 -- common/autotest_common.sh@10 -- # set +x 00:15:02.648 Malloc0 00:15:02.648 [2024-04-25 03:15:36.987538] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:15:02.648 03:15:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:02.648 03:15:36 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:15:02.648 03:15:36 -- common/autotest_common.sh@716 -- # xtrace_disable 00:15:02.648 03:15:37 -- common/autotest_common.sh@10 -- # set +x 00:15:02.648 03:15:37 -- target/host_management.sh@73 -- # perfpid=4051572 00:15:02.648 03:15:37 -- target/host_management.sh@74 -- # waitforlisten 4051572 /var/tmp/bdevperf.sock 00:15:02.648 03:15:37 -- common/autotest_common.sh@817 -- # '[' -z 4051572 ']' 00:15:02.648 03:15:37 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:02.648 03:15:37 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:15:02.648 03:15:37 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:15:02.648 03:15:37 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:02.648 03:15:37 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:02.648 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:02.648 03:15:37 -- nvmf/common.sh@521 -- # config=() 00:15:02.648 03:15:37 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:02.648 03:15:37 -- nvmf/common.sh@521 -- # local subsystem config 00:15:02.648 03:15:37 -- common/autotest_common.sh@10 -- # set +x 00:15:02.648 03:15:37 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:15:02.648 03:15:37 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:15:02.648 { 00:15:02.648 "params": { 00:15:02.648 "name": "Nvme$subsystem", 00:15:02.648 "trtype": "$TEST_TRANSPORT", 00:15:02.648 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:02.648 "adrfam": "ipv4", 00:15:02.648 "trsvcid": "$NVMF_PORT", 00:15:02.648 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:02.648 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:02.648 "hdgst": ${hdgst:-false}, 00:15:02.648 "ddgst": ${ddgst:-false} 00:15:02.648 }, 00:15:02.648 "method": "bdev_nvme_attach_controller" 00:15:02.648 } 00:15:02.648 EOF 00:15:02.648 )") 00:15:02.648 03:15:37 -- nvmf/common.sh@543 -- # cat 00:15:02.648 03:15:37 -- nvmf/common.sh@545 -- # jq . 00:15:02.648 03:15:37 -- nvmf/common.sh@546 -- # IFS=, 00:15:02.649 03:15:37 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:15:02.649 "params": { 00:15:02.649 "name": "Nvme0", 00:15:02.649 "trtype": "rdma", 00:15:02.649 "traddr": "192.168.100.8", 00:15:02.649 "adrfam": "ipv4", 00:15:02.649 "trsvcid": "4420", 00:15:02.649 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:15:02.649 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:15:02.649 "hdgst": false, 00:15:02.649 "ddgst": false 00:15:02.649 }, 00:15:02.649 "method": "bdev_nvme_attach_controller" 00:15:02.649 }' 00:15:02.649 [2024-04-25 03:15:37.076924] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:15:02.649 [2024-04-25 03:15:37.076969] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4051572 ] 00:15:02.649 EAL: No free 2048 kB hugepages reported on node 1 00:15:02.649 [2024-04-25 03:15:37.138162] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:02.907 [2024-04-25 03:15:37.209070] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:02.907 Running I/O for 10 seconds... 00:15:03.476 03:15:37 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:03.476 03:15:37 -- common/autotest_common.sh@850 -- # return 0 00:15:03.476 03:15:37 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:15:03.476 03:15:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:03.476 03:15:37 -- common/autotest_common.sh@10 -- # set +x 00:15:03.476 03:15:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:03.476 03:15:37 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:03.476 03:15:37 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:15:03.476 03:15:37 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:15:03.476 03:15:37 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:15:03.476 03:15:37 -- target/host_management.sh@52 -- # local ret=1 00:15:03.476 03:15:37 -- target/host_management.sh@53 -- # local i 00:15:03.476 03:15:37 -- target/host_management.sh@54 -- # (( i = 10 )) 00:15:03.476 03:15:37 -- target/host_management.sh@54 -- # (( i != 0 )) 00:15:03.476 03:15:37 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:15:03.476 03:15:37 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:15:03.476 03:15:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:03.476 03:15:37 -- common/autotest_common.sh@10 -- # set +x 00:15:03.476 03:15:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:03.476 03:15:37 -- target/host_management.sh@55 -- # read_io_count=1724 00:15:03.476 03:15:37 -- target/host_management.sh@58 -- # '[' 1724 -ge 100 ']' 00:15:03.476 03:15:37 -- target/host_management.sh@59 -- # ret=0 00:15:03.476 03:15:37 -- target/host_management.sh@60 -- # break 00:15:03.476 03:15:37 -- target/host_management.sh@64 -- # return 0 00:15:03.476 03:15:37 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:15:03.476 03:15:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:03.476 03:15:37 -- common/autotest_common.sh@10 -- # set +x 00:15:03.735 03:15:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:03.735 03:15:37 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:15:03.735 03:15:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:03.735 03:15:37 -- common/autotest_common.sh@10 -- # set +x 00:15:03.735 03:15:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:03.735 03:15:37 -- target/host_management.sh@87 -- # sleep 1 00:15:04.303 [2024-04-25 03:15:38.527874] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:15:04.303 [2024-04-25 03:15:38.527911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:110336 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190cfe80 len:0x10000 key:0x40472e64 00:15:04.303 [2024-04-25 03:15:38.527921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.527935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:110464 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190bfe00 len:0x10000 key:0x40472e64 00:15:04.303 [2024-04-25 03:15:38.527943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.527951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:110592 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190afd80 len:0x10000 key:0x40472e64 00:15:04.303 [2024-04-25 03:15:38.527958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.527966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:110720 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001909fd00 len:0x10000 key:0x40472e64 00:15:04.303 [2024-04-25 03:15:38.527974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.527982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:110848 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001908fc80 len:0x10000 key:0x40472e64 00:15:04.303 [2024-04-25 03:15:38.527989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.527997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:110976 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001907fc00 len:0x10000 key:0x40472e64 00:15:04.303 [2024-04-25 03:15:38.528004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:111104 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001906fb80 len:0x10000 key:0x40472e64 00:15:04.303 [2024-04-25 03:15:38.528019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:111232 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001905fb00 len:0x10000 key:0x40472e64 00:15:04.303 [2024-04-25 03:15:38.528034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:111360 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001904fa80 len:0x10000 key:0x40472e64 00:15:04.303 [2024-04-25 03:15:38.528053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:111488 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001903fa00 len:0x10000 key:0x40472e64 00:15:04.303 [2024-04-25 03:15:38.528067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:111616 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001902f980 len:0x10000 key:0x40472e64 00:15:04.303 [2024-04-25 03:15:38.528082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:111744 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001901f900 len:0x10000 key:0x40472e64 00:15:04.303 [2024-04-25 03:15:38.528097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:111872 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001900f880 len:0x10000 key:0x40472e64 00:15:04.303 [2024-04-25 03:15:38.528112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:112000 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018eeff80 len:0x10000 key:0x133ce8b6 00:15:04.303 [2024-04-25 03:15:38.528128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:112128 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018edff00 len:0x10000 key:0x133ce8b6 00:15:04.303 [2024-04-25 03:15:38.528143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:112256 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018ecfe80 len:0x10000 key:0x133ce8b6 00:15:04.303 [2024-04-25 03:15:38.528158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:112384 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018ebfe00 len:0x10000 key:0x133ce8b6 00:15:04.303 [2024-04-25 03:15:38.528172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:112512 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018eafd80 len:0x10000 key:0x133ce8b6 00:15:04.303 [2024-04-25 03:15:38.528187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:112640 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e9fd00 len:0x10000 key:0x133ce8b6 00:15:04.303 [2024-04-25 03:15:38.528202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:112768 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e8fc80 len:0x10000 key:0x133ce8b6 00:15:04.303 [2024-04-25 03:15:38.528219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:112896 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e7fc00 len:0x10000 key:0x133ce8b6 00:15:04.303 [2024-04-25 03:15:38.528234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:113024 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e6fb80 len:0x10000 key:0x133ce8b6 00:15:04.303 [2024-04-25 03:15:38.528249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:113152 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e5fb00 len:0x10000 key:0x133ce8b6 00:15:04.303 [2024-04-25 03:15:38.528264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:113280 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e4fa80 len:0x10000 key:0x133ce8b6 00:15:04.303 [2024-04-25 03:15:38.528279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:113408 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e3fa00 len:0x10000 key:0x133ce8b6 00:15:04.303 [2024-04-25 03:15:38.528294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:113536 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e2f980 len:0x10000 key:0x133ce8b6 00:15:04.303 [2024-04-25 03:15:38.528310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:113664 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e1f900 len:0x10000 key:0x133ce8b6 00:15:04.303 [2024-04-25 03:15:38.528325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:113792 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e0f880 len:0x10000 key:0x133ce8b6 00:15:04.303 [2024-04-25 03:15:38.528340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:113920 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200003a4b040 len:0x10000 key:0xf06c979a 00:15:04.303 [2024-04-25 03:15:38.528354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:114048 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200003a3afc0 len:0x10000 key:0xf06c979a 00:15:04.303 [2024-04-25 03:15:38.528369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:114176 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200003a2af40 len:0x10000 key:0xf06c979a 00:15:04.303 [2024-04-25 03:15:38.528386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:114304 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200003a1aec0 len:0x10000 key:0xf06c979a 00:15:04.303 [2024-04-25 03:15:38.528401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:114432 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200003a0ae40 len:0x10000 key:0xf06c979a 00:15:04.303 [2024-04-25 03:15:38.528416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:114560 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000138ea980 len:0x10000 key:0x1fe5002c 00:15:04.303 [2024-04-25 03:15:38.528431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:106496 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bb7a000 len:0x10000 key:0xdc890e49 00:15:04.303 [2024-04-25 03:15:38.528445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:106624 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bbdd000 len:0x10000 key:0xdc890e49 00:15:04.303 [2024-04-25 03:15:38.528460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:106752 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bbbc000 len:0x10000 key:0xdc890e49 00:15:04.303 [2024-04-25 03:15:38.528474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.303 [2024-04-25 03:15:38.528482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:106880 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bb17000 len:0x10000 key:0xdc890e49 00:15:04.303 [2024-04-25 03:15:38.528489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.304 [2024-04-25 03:15:38.528496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:107008 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bbfe000 len:0x10000 key:0xdc890e49 00:15:04.304 [2024-04-25 03:15:38.528503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.304 [2024-04-25 03:15:38.528511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:107136 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bb59000 len:0x10000 key:0xdc890e49 00:15:04.304 [2024-04-25 03:15:38.528517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.304 [2024-04-25 03:15:38.528525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:107264 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000baf6000 len:0x10000 key:0xdc890e49 00:15:04.304 [2024-04-25 03:15:38.528532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.304 [2024-04-25 03:15:38.528540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:107392 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bb9b000 len:0x10000 key:0xdc890e49 00:15:04.304 [2024-04-25 03:15:38.528548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.304 [2024-04-25 03:15:38.528556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:107520 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bb38000 len:0x10000 key:0xdc890e49 00:15:04.304 [2024-04-25 03:15:38.528562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.304 [2024-04-25 03:15:38.528570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:107648 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000ef6d000 len:0x10000 key:0xdc890e49 00:15:04.304 [2024-04-25 03:15:38.528577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.304 [2024-04-25 03:15:38.528585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:107776 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000ef4c000 len:0x10000 key:0xdc890e49 00:15:04.304 [2024-04-25 03:15:38.528591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.304 [2024-04-25 03:15:38.528599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:107904 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000ef2b000 len:0x10000 key:0xdc890e49 00:15:04.304 [2024-04-25 03:15:38.528606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.304 [2024-04-25 03:15:38.528614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:108032 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000ef0a000 len:0x10000 key:0xdc890e49 00:15:04.304 [2024-04-25 03:15:38.528621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.304 [2024-04-25 03:15:38.528629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:108160 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000eee9000 len:0x10000 key:0xdc890e49 00:15:04.304 [2024-04-25 03:15:38.528636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.304 [2024-04-25 03:15:38.528644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:108288 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000eec8000 len:0x10000 key:0xdc890e49 00:15:04.304 [2024-04-25 03:15:38.528650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.304 [2024-04-25 03:15:38.528658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:108416 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000eea7000 len:0x10000 key:0xdc890e49 00:15:04.304 [2024-04-25 03:15:38.528665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.304 [2024-04-25 03:15:38.528674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:108544 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000ee86000 len:0x10000 key:0xdc890e49 00:15:04.304 [2024-04-25 03:15:38.528680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.304 [2024-04-25 03:15:38.528688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:108672 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000ee65000 len:0x10000 key:0xdc890e49 00:15:04.304 [2024-04-25 03:15:38.528695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.304 [2024-04-25 03:15:38.528703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:108800 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000ee44000 len:0x10000 key:0xdc890e49 00:15:04.304 [2024-04-25 03:15:38.528711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.304 [2024-04-25 03:15:38.528719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:108928 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000ee23000 len:0x10000 key:0xdc890e49 00:15:04.304 [2024-04-25 03:15:38.528725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.304 [2024-04-25 03:15:38.528733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:109056 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000ee02000 len:0x10000 key:0xdc890e49 00:15:04.304 [2024-04-25 03:15:38.528740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.304 [2024-04-25 03:15:38.528748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:109184 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000ede1000 len:0x10000 key:0xdc890e49 00:15:04.304 [2024-04-25 03:15:38.528754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.304 [2024-04-25 03:15:38.528762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:109312 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000edc0000 len:0x10000 key:0xdc890e49 00:15:04.304 [2024-04-25 03:15:38.528768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.304 [2024-04-25 03:15:38.528777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:109440 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000f1bf000 len:0x10000 key:0xdc890e49 00:15:04.304 [2024-04-25 03:15:38.528785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.304 [2024-04-25 03:15:38.528793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:109568 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000f19e000 len:0x10000 key:0xdc890e49 00:15:04.304 [2024-04-25 03:15:38.528799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.304 [2024-04-25 03:15:38.528808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:109696 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000f17d000 len:0x10000 key:0xdc890e49 00:15:04.304 [2024-04-25 03:15:38.528814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.304 [2024-04-25 03:15:38.528822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:109824 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000f15c000 len:0x10000 key:0xdc890e49 00:15:04.304 [2024-04-25 03:15:38.528829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.304 [2024-04-25 03:15:38.528837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:109952 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000f13b000 len:0x10000 key:0xdc890e49 00:15:04.304 [2024-04-25 03:15:38.528844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.304 [2024-04-25 03:15:38.528851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:110080 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000f11a000 len:0x10000 key:0xdc890e49 00:15:04.304 [2024-04-25 03:15:38.528863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.304 [2024-04-25 03:15:38.528871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:110208 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000f0f9000 len:0x10000 key:0xdc890e49 00:15:04.304 [2024-04-25 03:15:38.528878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1a60610 sqhd:15c0 p:0 m:0 dnr:0 00:15:04.304 [2024-04-25 03:15:38.529254] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192015c0 was disconnected and freed. reset controller. 00:15:04.304 [2024-04-25 03:15:38.530156] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:15:04.304 task offset: 110336 on job bdev=Nvme0n1 fails 00:15:04.304 00:15:04.304 Latency(us) 00:15:04.304 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:04.304 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:15:04.304 Job: Nvme0n1 ended in about 1.15 seconds with error 00:15:04.304 Verification LBA range: start 0x0 length 0x400 00:15:04.304 Nvme0n1 : 1.15 1614.99 100.94 55.69 0.00 37800.01 1693.01 563235.11 00:15:04.304 =================================================================================================================== 00:15:04.304 Total : 1614.99 100.94 55.69 0.00 37800.01 1693.01 563235.11 00:15:04.304 [2024-04-25 03:15:38.531749] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:15:04.304 [2024-04-25 03:15:38.531761] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:15:04.304 [2024-04-25 03:15:38.545211] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:15:04.304 [2024-04-25 03:15:38.560952] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:15:04.563 03:15:38 -- target/host_management.sh@91 -- # kill -9 4051572 00:15:04.563 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (4051572) - No such process 00:15:04.563 03:15:38 -- target/host_management.sh@91 -- # true 00:15:04.563 03:15:38 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:15:04.563 03:15:38 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:15:04.563 03:15:38 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:15:04.563 03:15:39 -- nvmf/common.sh@521 -- # config=() 00:15:04.563 03:15:39 -- nvmf/common.sh@521 -- # local subsystem config 00:15:04.563 03:15:39 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:15:04.563 03:15:39 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:15:04.563 { 00:15:04.563 "params": { 00:15:04.563 "name": "Nvme$subsystem", 00:15:04.563 "trtype": "$TEST_TRANSPORT", 00:15:04.563 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:04.563 "adrfam": "ipv4", 00:15:04.563 "trsvcid": "$NVMF_PORT", 00:15:04.563 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:04.563 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:04.563 "hdgst": ${hdgst:-false}, 00:15:04.563 "ddgst": ${ddgst:-false} 00:15:04.563 }, 00:15:04.563 "method": "bdev_nvme_attach_controller" 00:15:04.563 } 00:15:04.563 EOF 00:15:04.563 )") 00:15:04.563 03:15:39 -- nvmf/common.sh@543 -- # cat 00:15:04.563 03:15:39 -- nvmf/common.sh@545 -- # jq . 00:15:04.563 03:15:39 -- nvmf/common.sh@546 -- # IFS=, 00:15:04.563 03:15:39 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:15:04.563 "params": { 00:15:04.563 "name": "Nvme0", 00:15:04.563 "trtype": "rdma", 00:15:04.563 "traddr": "192.168.100.8", 00:15:04.563 "adrfam": "ipv4", 00:15:04.563 "trsvcid": "4420", 00:15:04.563 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:15:04.563 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:15:04.563 "hdgst": false, 00:15:04.563 "ddgst": false 00:15:04.563 }, 00:15:04.563 "method": "bdev_nvme_attach_controller" 00:15:04.563 }' 00:15:04.563 [2024-04-25 03:15:39.042155] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:15:04.563 [2024-04-25 03:15:39.042200] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4051839 ] 00:15:04.822 EAL: No free 2048 kB hugepages reported on node 1 00:15:04.822 [2024-04-25 03:15:39.103731] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:04.822 [2024-04-25 03:15:39.173156] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:05.082 Running I/O for 1 seconds... 00:15:06.018 00:15:06.019 Latency(us) 00:15:06.019 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:06.019 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:15:06.019 Verification LBA range: start 0x0 length 0x400 00:15:06.019 Nvme0n1 : 1.01 3153.39 197.09 0.00 0.00 19883.39 1638.40 33454.57 00:15:06.019 =================================================================================================================== 00:15:06.019 Total : 3153.39 197.09 0.00 0.00 19883.39 1638.40 33454.57 00:15:06.278 03:15:40 -- target/host_management.sh@102 -- # stoptarget 00:15:06.278 03:15:40 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:15:06.278 03:15:40 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:15:06.278 03:15:40 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:15:06.278 03:15:40 -- target/host_management.sh@40 -- # nvmftestfini 00:15:06.278 03:15:40 -- nvmf/common.sh@477 -- # nvmfcleanup 00:15:06.278 03:15:40 -- nvmf/common.sh@117 -- # sync 00:15:06.278 03:15:40 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:15:06.278 03:15:40 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:15:06.278 03:15:40 -- nvmf/common.sh@120 -- # set +e 00:15:06.278 03:15:40 -- nvmf/common.sh@121 -- # for i in {1..20} 00:15:06.278 03:15:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:15:06.278 rmmod nvme_rdma 00:15:06.278 rmmod nvme_fabrics 00:15:06.278 03:15:40 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:15:06.278 03:15:40 -- nvmf/common.sh@124 -- # set -e 00:15:06.278 03:15:40 -- nvmf/common.sh@125 -- # return 0 00:15:06.278 03:15:40 -- nvmf/common.sh@478 -- # '[' -n 4051309 ']' 00:15:06.278 03:15:40 -- nvmf/common.sh@479 -- # killprocess 4051309 00:15:06.278 03:15:40 -- common/autotest_common.sh@936 -- # '[' -z 4051309 ']' 00:15:06.278 03:15:40 -- common/autotest_common.sh@940 -- # kill -0 4051309 00:15:06.278 03:15:40 -- common/autotest_common.sh@941 -- # uname 00:15:06.278 03:15:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:06.278 03:15:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4051309 00:15:06.278 03:15:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:06.278 03:15:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:06.278 03:15:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4051309' 00:15:06.278 killing process with pid 4051309 00:15:06.278 03:15:40 -- common/autotest_common.sh@955 -- # kill 4051309 00:15:06.278 03:15:40 -- common/autotest_common.sh@960 -- # wait 4051309 00:15:06.278 [2024-04-25 03:15:40.715235] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:15:06.537 [2024-04-25 03:15:40.916132] app.c: 630:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:15:06.537 03:15:40 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:15:06.537 03:15:40 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:15:06.537 00:15:06.537 real 0m4.927s 00:15:06.537 user 0m22.194s 00:15:06.537 sys 0m0.800s 00:15:06.537 03:15:40 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:15:06.537 03:15:40 -- common/autotest_common.sh@10 -- # set +x 00:15:06.537 ************************************ 00:15:06.537 END TEST nvmf_host_management 00:15:06.537 ************************************ 00:15:06.537 03:15:40 -- target/host_management.sh@109 -- # trap - SIGINT SIGTERM EXIT 00:15:06.537 00:15:06.537 real 0m11.207s 00:15:06.537 user 0m24.061s 00:15:06.537 sys 0m5.373s 00:15:06.537 03:15:40 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:15:06.537 03:15:40 -- common/autotest_common.sh@10 -- # set +x 00:15:06.537 ************************************ 00:15:06.537 END TEST nvmf_host_management 00:15:06.537 ************************************ 00:15:06.537 03:15:40 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=rdma 00:15:06.537 03:15:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:06.537 03:15:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:06.537 03:15:40 -- common/autotest_common.sh@10 -- # set +x 00:15:06.797 ************************************ 00:15:06.797 START TEST nvmf_lvol 00:15:06.797 ************************************ 00:15:06.797 03:15:41 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=rdma 00:15:06.797 * Looking for test storage... 00:15:06.797 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:15:06.797 03:15:41 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:15:06.797 03:15:41 -- nvmf/common.sh@7 -- # uname -s 00:15:06.797 03:15:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:06.797 03:15:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:06.797 03:15:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:06.797 03:15:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:06.797 03:15:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:06.797 03:15:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:06.797 03:15:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:06.797 03:15:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:06.797 03:15:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:06.797 03:15:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:06.797 03:15:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:15:06.797 03:15:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:15:06.797 03:15:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:06.797 03:15:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:06.797 03:15:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:06.797 03:15:41 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:06.797 03:15:41 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:15:06.797 03:15:41 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:06.797 03:15:41 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:06.797 03:15:41 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:06.797 03:15:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:06.797 03:15:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:06.797 03:15:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:06.797 03:15:41 -- paths/export.sh@5 -- # export PATH 00:15:06.797 03:15:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:06.797 03:15:41 -- nvmf/common.sh@47 -- # : 0 00:15:06.797 03:15:41 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:15:06.797 03:15:41 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:15:06.797 03:15:41 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:06.797 03:15:41 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:06.797 03:15:41 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:06.797 03:15:41 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:15:06.797 03:15:41 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:15:06.797 03:15:41 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:15:06.797 03:15:41 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:06.797 03:15:41 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:06.797 03:15:41 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:15:06.797 03:15:41 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:15:06.797 03:15:41 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:15:06.797 03:15:41 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:15:06.797 03:15:41 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:15:06.797 03:15:41 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:06.797 03:15:41 -- nvmf/common.sh@437 -- # prepare_net_devs 00:15:06.797 03:15:41 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:15:06.797 03:15:41 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:15:06.797 03:15:41 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:06.797 03:15:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:06.797 03:15:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:06.797 03:15:41 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:15:06.797 03:15:41 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:15:06.797 03:15:41 -- nvmf/common.sh@285 -- # xtrace_disable 00:15:06.797 03:15:41 -- common/autotest_common.sh@10 -- # set +x 00:15:13.363 03:15:46 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:13.364 03:15:46 -- nvmf/common.sh@291 -- # pci_devs=() 00:15:13.364 03:15:46 -- nvmf/common.sh@291 -- # local -a pci_devs 00:15:13.364 03:15:46 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:15:13.364 03:15:46 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:15:13.364 03:15:46 -- nvmf/common.sh@293 -- # pci_drivers=() 00:15:13.364 03:15:46 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:15:13.364 03:15:46 -- nvmf/common.sh@295 -- # net_devs=() 00:15:13.364 03:15:46 -- nvmf/common.sh@295 -- # local -ga net_devs 00:15:13.364 03:15:46 -- nvmf/common.sh@296 -- # e810=() 00:15:13.364 03:15:46 -- nvmf/common.sh@296 -- # local -ga e810 00:15:13.364 03:15:46 -- nvmf/common.sh@297 -- # x722=() 00:15:13.364 03:15:46 -- nvmf/common.sh@297 -- # local -ga x722 00:15:13.364 03:15:46 -- nvmf/common.sh@298 -- # mlx=() 00:15:13.364 03:15:46 -- nvmf/common.sh@298 -- # local -ga mlx 00:15:13.364 03:15:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:13.364 03:15:46 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:13.364 03:15:46 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:13.364 03:15:46 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:13.364 03:15:46 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:13.364 03:15:46 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:13.364 03:15:46 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:13.364 03:15:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:13.364 03:15:46 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:13.364 03:15:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:13.364 03:15:46 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:13.364 03:15:46 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:15:13.364 03:15:46 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:15:13.364 03:15:46 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:15:13.364 03:15:46 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:15:13.364 03:15:46 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:15:13.364 03:15:46 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:15:13.364 03:15:46 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:15:13.364 03:15:46 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:15:13.364 03:15:46 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:13.364 03:15:46 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:15:13.364 Found 0000:af:00.0 (0x8086 - 0x159b) 00:15:13.364 03:15:46 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:15:13.364 03:15:46 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:15:13.364 03:15:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:13.364 03:15:46 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:13.364 03:15:46 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:13.364 03:15:46 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:13.364 03:15:46 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:13.364 03:15:46 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:15:13.364 Found 0000:af:00.1 (0x8086 - 0x159b) 00:15:13.364 03:15:46 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:15:13.364 03:15:46 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:15:13.364 03:15:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:13.364 03:15:46 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:13.364 03:15:46 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:13.364 03:15:46 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:13.364 03:15:46 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:15:13.364 03:15:46 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:15:13.364 03:15:46 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:15:13.364 03:15:46 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:15:13.364 03:15:46 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:15:13.364 03:15:46 -- nvmf/common.sh@377 -- # modinfo irdma 00:15:13.364 03:15:46 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:15:13.364 03:15:46 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:13.364 03:15:46 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:13.364 03:15:46 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:13.364 03:15:46 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:13.364 03:15:46 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:15:13.364 Found net devices under 0000:af:00.0: cvl_0_0 00:15:13.364 03:15:46 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:13.364 03:15:46 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:13.364 03:15:46 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:13.364 03:15:46 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:13.364 03:15:46 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:13.364 03:15:46 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:15:13.364 Found net devices under 0000:af:00.1: cvl_0_1 00:15:13.364 03:15:46 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:13.364 03:15:46 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:15:13.364 03:15:46 -- nvmf/common.sh@403 -- # is_hw=yes 00:15:13.364 03:15:46 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:15:13.364 03:15:46 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:15:13.364 03:15:46 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:15:13.364 03:15:46 -- nvmf/common.sh@409 -- # rdma_device_init 00:15:13.364 03:15:46 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:15:13.364 03:15:46 -- nvmf/common.sh@58 -- # uname 00:15:13.364 03:15:46 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:15:13.364 03:15:46 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:15:13.364 03:15:46 -- nvmf/common.sh@63 -- # modprobe ib_core 00:15:13.364 03:15:46 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:15:13.364 03:15:46 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:15:13.364 03:15:46 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:15:13.364 03:15:46 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:15:13.364 03:15:46 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:15:13.364 03:15:46 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:15:13.364 03:15:46 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:15:13.364 03:15:46 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:15:13.364 03:15:46 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:13.364 03:15:46 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:13.364 03:15:46 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:13.364 03:15:46 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:13.364 03:15:46 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:13.364 03:15:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:13.364 03:15:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:13.364 03:15:46 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:15:13.364 03:15:46 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:15:13.364 03:15:46 -- nvmf/common.sh@105 -- # continue 2 00:15:13.364 03:15:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:13.364 03:15:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:13.364 03:15:46 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:15:13.364 03:15:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:13.364 03:15:46 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:15:13.364 03:15:46 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:15:13.364 03:15:46 -- nvmf/common.sh@105 -- # continue 2 00:15:13.364 03:15:46 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:13.364 03:15:46 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:15:13.364 03:15:46 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:15:13.364 03:15:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:15:13.364 03:15:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:13.364 03:15:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:13.364 03:15:46 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:15:13.364 03:15:46 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:15:13.364 03:15:46 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:15:13.364 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:15:13.364 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:15:13.364 altname enp175s0f0np0 00:15:13.364 altname ens801f0np0 00:15:13.364 inet 192.168.100.8/24 scope global cvl_0_0 00:15:13.364 valid_lft forever preferred_lft forever 00:15:13.364 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:15:13.364 valid_lft forever preferred_lft forever 00:15:13.364 03:15:46 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:13.364 03:15:46 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:15:13.364 03:15:46 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:15:13.364 03:15:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:15:13.364 03:15:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:13.364 03:15:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:13.364 03:15:46 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:15:13.364 03:15:46 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:15:13.364 03:15:46 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:15:13.364 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:15:13.364 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:15:13.364 altname enp175s0f1np1 00:15:13.364 altname ens801f1np1 00:15:13.364 inet 192.168.100.9/24 scope global cvl_0_1 00:15:13.364 valid_lft forever preferred_lft forever 00:15:13.364 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:15:13.364 valid_lft forever preferred_lft forever 00:15:13.364 03:15:46 -- nvmf/common.sh@411 -- # return 0 00:15:13.364 03:15:46 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:15:13.364 03:15:46 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:15:13.364 03:15:46 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:15:13.364 03:15:46 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:15:13.364 03:15:46 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:15:13.364 03:15:46 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:13.364 03:15:46 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:13.364 03:15:46 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:13.364 03:15:46 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:13.364 03:15:46 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:13.364 03:15:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:13.364 03:15:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:13.364 03:15:46 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:15:13.364 03:15:46 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:15:13.364 03:15:46 -- nvmf/common.sh@105 -- # continue 2 00:15:13.364 03:15:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:13.365 03:15:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:13.365 03:15:46 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:15:13.365 03:15:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:13.365 03:15:46 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:15:13.365 03:15:46 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:15:13.365 03:15:46 -- nvmf/common.sh@105 -- # continue 2 00:15:13.365 03:15:46 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:13.365 03:15:46 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:15:13.365 03:15:46 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:15:13.365 03:15:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:15:13.365 03:15:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:13.365 03:15:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:13.365 03:15:46 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:13.365 03:15:46 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:15:13.365 03:15:46 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:15:13.365 03:15:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:15:13.365 03:15:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:13.365 03:15:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:13.365 03:15:46 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:15:13.365 192.168.100.9' 00:15:13.365 03:15:47 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:15:13.365 192.168.100.9' 00:15:13.365 03:15:47 -- nvmf/common.sh@446 -- # head -n 1 00:15:13.365 03:15:47 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:15:13.365 03:15:47 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:15:13.365 192.168.100.9' 00:15:13.365 03:15:47 -- nvmf/common.sh@447 -- # tail -n +2 00:15:13.365 03:15:47 -- nvmf/common.sh@447 -- # head -n 1 00:15:13.365 03:15:47 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:15:13.365 03:15:47 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:15:13.365 03:15:47 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:15:13.365 03:15:47 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:15:13.365 03:15:47 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:15:13.365 03:15:47 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:15:13.365 03:15:47 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:15:13.365 03:15:47 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:15:13.365 03:15:47 -- common/autotest_common.sh@710 -- # xtrace_disable 00:15:13.365 03:15:47 -- common/autotest_common.sh@10 -- # set +x 00:15:13.365 03:15:47 -- nvmf/common.sh@470 -- # nvmfpid=4055620 00:15:13.365 03:15:47 -- nvmf/common.sh@471 -- # waitforlisten 4055620 00:15:13.365 03:15:47 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:15:13.365 03:15:47 -- common/autotest_common.sh@817 -- # '[' -z 4055620 ']' 00:15:13.365 03:15:47 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:13.365 03:15:47 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:13.365 03:15:47 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:13.365 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:13.365 03:15:47 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:13.365 03:15:47 -- common/autotest_common.sh@10 -- # set +x 00:15:13.365 [2024-04-25 03:15:47.090742] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:15:13.365 [2024-04-25 03:15:47.090792] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:13.365 EAL: No free 2048 kB hugepages reported on node 1 00:15:13.365 [2024-04-25 03:15:47.153728] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:15:13.365 [2024-04-25 03:15:47.224738] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:13.365 [2024-04-25 03:15:47.224780] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:13.365 [2024-04-25 03:15:47.224786] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:13.365 [2024-04-25 03:15:47.224792] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:13.365 [2024-04-25 03:15:47.224796] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:13.365 [2024-04-25 03:15:47.224891] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:13.365 [2024-04-25 03:15:47.224942] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:13.365 [2024-04-25 03:15:47.224945] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:13.624 03:15:47 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:13.624 03:15:47 -- common/autotest_common.sh@850 -- # return 0 00:15:13.624 03:15:47 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:15:13.624 03:15:47 -- common/autotest_common.sh@716 -- # xtrace_disable 00:15:13.624 03:15:47 -- common/autotest_common.sh@10 -- # set +x 00:15:13.624 03:15:47 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:13.624 03:15:47 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:15:13.624 [2024-04-25 03:15:48.083529] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x13f92c0/0x13f8900) succeed. 00:15:13.624 [2024-04-25 03:15:48.093343] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x13fa5f0/0x13f8e80) succeed. 00:15:13.624 [2024-04-25 03:15:48.093365] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:15:13.624 03:15:48 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:13.883 03:15:48 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:15:13.883 03:15:48 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:14.142 03:15:48 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:15:14.142 03:15:48 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:15:14.401 03:15:48 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:15:14.401 03:15:48 -- target/nvmf_lvol.sh@29 -- # lvs=7fa112d3-4dfa-41aa-beda-b3e35837ba0b 00:15:14.401 03:15:48 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 7fa112d3-4dfa-41aa-beda-b3e35837ba0b lvol 20 00:15:14.660 03:15:49 -- target/nvmf_lvol.sh@32 -- # lvol=997d366e-60da-481f-af61-764f326ff8d4 00:15:14.660 03:15:49 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:15:14.919 03:15:49 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 997d366e-60da-481f-af61-764f326ff8d4 00:15:14.919 03:15:49 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:15:15.178 [2024-04-25 03:15:49.545982] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:15:15.178 03:15:49 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:15:15.436 03:15:49 -- target/nvmf_lvol.sh@42 -- # perf_pid=4056103 00:15:15.436 03:15:49 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:15:15.436 03:15:49 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:15:15.436 EAL: No free 2048 kB hugepages reported on node 1 00:15:16.371 03:15:50 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 997d366e-60da-481f-af61-764f326ff8d4 MY_SNAPSHOT 00:15:16.630 03:15:50 -- target/nvmf_lvol.sh@47 -- # snapshot=61f37314-a575-444b-89ae-af19a5435fc0 00:15:16.630 03:15:50 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 997d366e-60da-481f-af61-764f326ff8d4 30 00:15:16.630 03:15:51 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 61f37314-a575-444b-89ae-af19a5435fc0 MY_CLONE 00:15:16.889 03:15:51 -- target/nvmf_lvol.sh@49 -- # clone=0a34539a-723b-41d8-a61b-b2c4761b95c6 00:15:16.889 03:15:51 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 0a34539a-723b-41d8-a61b-b2c4761b95c6 00:15:17.148 03:15:51 -- target/nvmf_lvol.sh@53 -- # wait 4056103 00:15:27.154 Initializing NVMe Controllers 00:15:27.154 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode0 00:15:27.154 Controller IO queue size 128, less than required. 00:15:27.154 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:27.154 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:15:27.154 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:15:27.154 Initialization complete. Launching workers. 00:15:27.154 ======================================================== 00:15:27.154 Latency(us) 00:15:27.154 Device Information : IOPS MiB/s Average min max 00:15:27.154 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 17026.70 66.51 7519.30 2164.55 36858.39 00:15:27.154 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 17062.80 66.65 7503.84 3690.00 38710.81 00:15:27.154 ======================================================== 00:15:27.154 Total : 34089.50 133.16 7511.56 2164.55 38710.81 00:15:27.154 00:15:27.154 03:16:01 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:27.154 03:16:01 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 997d366e-60da-481f-af61-764f326ff8d4 00:15:27.154 03:16:01 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 7fa112d3-4dfa-41aa-beda-b3e35837ba0b 00:15:27.415 03:16:01 -- target/nvmf_lvol.sh@60 -- # rm -f 00:15:27.415 03:16:01 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:15:27.415 03:16:01 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:15:27.415 03:16:01 -- nvmf/common.sh@477 -- # nvmfcleanup 00:15:27.415 03:16:01 -- nvmf/common.sh@117 -- # sync 00:15:27.415 03:16:01 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:15:27.415 03:16:01 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:15:27.415 03:16:01 -- nvmf/common.sh@120 -- # set +e 00:15:27.415 03:16:01 -- nvmf/common.sh@121 -- # for i in {1..20} 00:15:27.415 03:16:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:15:27.415 rmmod nvme_rdma 00:15:27.415 rmmod nvme_fabrics 00:15:27.415 03:16:01 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:15:27.415 03:16:01 -- nvmf/common.sh@124 -- # set -e 00:15:27.415 03:16:01 -- nvmf/common.sh@125 -- # return 0 00:15:27.415 03:16:01 -- nvmf/common.sh@478 -- # '[' -n 4055620 ']' 00:15:27.415 03:16:01 -- nvmf/common.sh@479 -- # killprocess 4055620 00:15:27.415 03:16:01 -- common/autotest_common.sh@936 -- # '[' -z 4055620 ']' 00:15:27.415 03:16:01 -- common/autotest_common.sh@940 -- # kill -0 4055620 00:15:27.415 03:16:01 -- common/autotest_common.sh@941 -- # uname 00:15:27.415 03:16:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:27.415 03:16:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4055620 00:15:27.415 03:16:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:27.415 03:16:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:27.415 03:16:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4055620' 00:15:27.415 killing process with pid 4055620 00:15:27.415 03:16:01 -- common/autotest_common.sh@955 -- # kill 4055620 00:15:27.415 03:16:01 -- common/autotest_common.sh@960 -- # wait 4055620 00:15:27.415 [2024-04-25 03:16:01.809712] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:15:27.675 03:16:02 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:15:27.675 03:16:02 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:15:27.675 00:15:27.675 real 0m20.944s 00:15:27.675 user 1m10.580s 00:15:27.675 sys 0m5.475s 00:15:27.675 03:16:02 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:15:27.675 03:16:02 -- common/autotest_common.sh@10 -- # set +x 00:15:27.675 ************************************ 00:15:27.675 END TEST nvmf_lvol 00:15:27.675 ************************************ 00:15:27.675 03:16:02 -- nvmf/nvmf.sh@49 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=rdma 00:15:27.675 03:16:02 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:27.675 03:16:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:27.675 03:16:02 -- common/autotest_common.sh@10 -- # set +x 00:15:27.934 ************************************ 00:15:27.934 START TEST nvmf_lvs_grow 00:15:27.934 ************************************ 00:15:27.934 03:16:02 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=rdma 00:15:27.934 * Looking for test storage... 00:15:27.934 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:15:27.934 03:16:02 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:15:27.934 03:16:02 -- nvmf/common.sh@7 -- # uname -s 00:15:27.934 03:16:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:27.934 03:16:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:27.934 03:16:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:27.934 03:16:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:27.934 03:16:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:27.934 03:16:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:27.934 03:16:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:27.934 03:16:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:27.934 03:16:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:27.934 03:16:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:27.934 03:16:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:15:27.934 03:16:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:15:27.934 03:16:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:27.934 03:16:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:27.934 03:16:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:27.934 03:16:02 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:27.934 03:16:02 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:15:27.934 03:16:02 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:27.934 03:16:02 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:27.934 03:16:02 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:27.934 03:16:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:27.934 03:16:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:27.934 03:16:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:27.934 03:16:02 -- paths/export.sh@5 -- # export PATH 00:15:27.934 03:16:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:27.934 03:16:02 -- nvmf/common.sh@47 -- # : 0 00:15:27.934 03:16:02 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:15:27.934 03:16:02 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:15:27.934 03:16:02 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:27.934 03:16:02 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:27.934 03:16:02 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:27.934 03:16:02 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:15:27.934 03:16:02 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:15:27.934 03:16:02 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:15:27.934 03:16:02 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:15:27.934 03:16:02 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:27.934 03:16:02 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:15:27.934 03:16:02 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:15:27.934 03:16:02 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:27.934 03:16:02 -- nvmf/common.sh@437 -- # prepare_net_devs 00:15:27.934 03:16:02 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:15:27.934 03:16:02 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:15:27.934 03:16:02 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:27.934 03:16:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:27.934 03:16:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:27.934 03:16:02 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:15:27.934 03:16:02 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:15:27.934 03:16:02 -- nvmf/common.sh@285 -- # xtrace_disable 00:15:27.934 03:16:02 -- common/autotest_common.sh@10 -- # set +x 00:15:34.501 03:16:08 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:34.501 03:16:08 -- nvmf/common.sh@291 -- # pci_devs=() 00:15:34.501 03:16:08 -- nvmf/common.sh@291 -- # local -a pci_devs 00:15:34.501 03:16:08 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:15:34.501 03:16:08 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:15:34.501 03:16:08 -- nvmf/common.sh@293 -- # pci_drivers=() 00:15:34.501 03:16:08 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:15:34.501 03:16:08 -- nvmf/common.sh@295 -- # net_devs=() 00:15:34.501 03:16:08 -- nvmf/common.sh@295 -- # local -ga net_devs 00:15:34.501 03:16:08 -- nvmf/common.sh@296 -- # e810=() 00:15:34.501 03:16:08 -- nvmf/common.sh@296 -- # local -ga e810 00:15:34.501 03:16:08 -- nvmf/common.sh@297 -- # x722=() 00:15:34.501 03:16:08 -- nvmf/common.sh@297 -- # local -ga x722 00:15:34.501 03:16:08 -- nvmf/common.sh@298 -- # mlx=() 00:15:34.501 03:16:08 -- nvmf/common.sh@298 -- # local -ga mlx 00:15:34.501 03:16:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:34.501 03:16:08 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:34.501 03:16:08 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:34.501 03:16:08 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:34.501 03:16:08 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:34.501 03:16:08 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:34.501 03:16:08 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:34.501 03:16:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:34.501 03:16:08 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:34.501 03:16:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:34.501 03:16:08 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:34.501 03:16:08 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:15:34.501 03:16:08 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:15:34.501 03:16:08 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:15:34.501 03:16:08 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:15:34.501 03:16:08 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:15:34.501 03:16:08 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:15:34.501 03:16:08 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:15:34.501 03:16:08 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:15:34.501 03:16:08 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:34.501 03:16:08 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:15:34.501 Found 0000:af:00.0 (0x8086 - 0x159b) 00:15:34.501 03:16:08 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:15:34.501 03:16:08 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:15:34.501 03:16:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:34.501 03:16:08 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:34.501 03:16:08 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:34.501 03:16:08 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:34.501 03:16:08 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:34.501 03:16:08 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:15:34.501 Found 0000:af:00.1 (0x8086 - 0x159b) 00:15:34.501 03:16:08 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:15:34.501 03:16:08 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:15:34.501 03:16:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:34.501 03:16:08 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:34.501 03:16:08 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:34.501 03:16:08 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:34.501 03:16:08 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:15:34.501 03:16:08 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:15:34.501 03:16:08 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:15:34.501 03:16:08 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:15:34.501 03:16:08 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:15:34.501 03:16:08 -- nvmf/common.sh@377 -- # modinfo irdma 00:15:34.501 03:16:08 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:15:34.502 03:16:08 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:34.502 03:16:08 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:34.502 03:16:08 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:34.502 03:16:08 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:34.502 03:16:08 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:15:34.502 Found net devices under 0000:af:00.0: cvl_0_0 00:15:34.502 03:16:08 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:34.502 03:16:08 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:34.502 03:16:08 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:34.502 03:16:08 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:34.502 03:16:08 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:34.502 03:16:08 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:15:34.502 Found net devices under 0000:af:00.1: cvl_0_1 00:15:34.502 03:16:08 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:34.502 03:16:08 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:15:34.502 03:16:08 -- nvmf/common.sh@403 -- # is_hw=yes 00:15:34.502 03:16:08 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:15:34.502 03:16:08 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:15:34.502 03:16:08 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:15:34.502 03:16:08 -- nvmf/common.sh@409 -- # rdma_device_init 00:15:34.502 03:16:08 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:15:34.502 03:16:08 -- nvmf/common.sh@58 -- # uname 00:15:34.502 03:16:08 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:15:34.502 03:16:08 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:15:34.502 03:16:08 -- nvmf/common.sh@63 -- # modprobe ib_core 00:15:34.502 03:16:08 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:15:34.502 03:16:08 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:15:34.502 03:16:08 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:15:34.502 03:16:08 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:15:34.502 03:16:08 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:15:34.502 03:16:08 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:15:34.502 03:16:08 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:15:34.502 03:16:08 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:15:34.502 03:16:08 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:34.502 03:16:08 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:34.502 03:16:08 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:34.502 03:16:08 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:34.502 03:16:08 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:34.502 03:16:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:34.502 03:16:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:34.502 03:16:08 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:15:34.502 03:16:08 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:15:34.502 03:16:08 -- nvmf/common.sh@105 -- # continue 2 00:15:34.502 03:16:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:34.502 03:16:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:34.502 03:16:08 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:15:34.502 03:16:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:34.502 03:16:08 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:15:34.502 03:16:08 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:15:34.502 03:16:08 -- nvmf/common.sh@105 -- # continue 2 00:15:34.502 03:16:08 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:34.502 03:16:08 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:15:34.502 03:16:08 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:15:34.502 03:16:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:15:34.502 03:16:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:34.502 03:16:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:34.502 03:16:08 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:15:34.502 03:16:08 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:15:34.502 03:16:08 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:15:34.502 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:15:34.502 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:15:34.502 altname enp175s0f0np0 00:15:34.502 altname ens801f0np0 00:15:34.502 inet 192.168.100.8/24 scope global cvl_0_0 00:15:34.502 valid_lft forever preferred_lft forever 00:15:34.502 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:15:34.502 valid_lft forever preferred_lft forever 00:15:34.502 03:16:08 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:34.502 03:16:08 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:15:34.502 03:16:08 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:15:34.502 03:16:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:15:34.502 03:16:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:34.502 03:16:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:34.502 03:16:08 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:15:34.502 03:16:08 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:15:34.502 03:16:08 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:15:34.502 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:15:34.502 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:15:34.502 altname enp175s0f1np1 00:15:34.502 altname ens801f1np1 00:15:34.502 inet 192.168.100.9/24 scope global cvl_0_1 00:15:34.502 valid_lft forever preferred_lft forever 00:15:34.502 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:15:34.502 valid_lft forever preferred_lft forever 00:15:34.502 03:16:08 -- nvmf/common.sh@411 -- # return 0 00:15:34.502 03:16:08 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:15:34.502 03:16:08 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:15:34.502 03:16:08 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:15:34.502 03:16:08 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:15:34.502 03:16:08 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:15:34.502 03:16:08 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:34.502 03:16:08 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:34.502 03:16:08 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:34.502 03:16:08 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:34.502 03:16:08 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:34.502 03:16:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:34.502 03:16:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:34.502 03:16:08 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:15:34.502 03:16:08 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:15:34.502 03:16:08 -- nvmf/common.sh@105 -- # continue 2 00:15:34.502 03:16:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:34.502 03:16:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:34.502 03:16:08 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:15:34.502 03:16:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:34.502 03:16:08 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:15:34.502 03:16:08 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:15:34.502 03:16:08 -- nvmf/common.sh@105 -- # continue 2 00:15:34.502 03:16:08 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:34.502 03:16:08 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:15:34.502 03:16:08 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:15:34.502 03:16:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:34.502 03:16:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:34.502 03:16:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:15:34.502 03:16:08 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:34.502 03:16:08 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:15:34.502 03:16:08 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:15:34.502 03:16:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:15:34.502 03:16:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:34.502 03:16:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:34.502 03:16:08 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:15:34.502 192.168.100.9' 00:15:34.502 03:16:08 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:15:34.502 192.168.100.9' 00:15:34.502 03:16:08 -- nvmf/common.sh@446 -- # head -n 1 00:15:34.502 03:16:08 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:15:34.502 03:16:08 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:15:34.502 192.168.100.9' 00:15:34.502 03:16:08 -- nvmf/common.sh@447 -- # tail -n +2 00:15:34.502 03:16:08 -- nvmf/common.sh@447 -- # head -n 1 00:15:34.502 03:16:08 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:15:34.502 03:16:08 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:15:34.502 03:16:08 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:15:34.502 03:16:08 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:15:34.502 03:16:08 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:15:34.502 03:16:08 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:15:34.502 03:16:08 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:15:34.502 03:16:08 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:15:34.502 03:16:08 -- common/autotest_common.sh@710 -- # xtrace_disable 00:15:34.502 03:16:08 -- common/autotest_common.sh@10 -- # set +x 00:15:34.502 03:16:08 -- nvmf/common.sh@470 -- # nvmfpid=4061485 00:15:34.502 03:16:08 -- nvmf/common.sh@471 -- # waitforlisten 4061485 00:15:34.502 03:16:08 -- common/autotest_common.sh@817 -- # '[' -z 4061485 ']' 00:15:34.502 03:16:08 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:34.502 03:16:08 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:34.502 03:16:08 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:34.502 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:34.502 03:16:08 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:15:34.502 03:16:08 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:34.502 03:16:08 -- common/autotest_common.sh@10 -- # set +x 00:15:34.502 [2024-04-25 03:16:08.296025] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:15:34.502 [2024-04-25 03:16:08.296067] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:34.502 EAL: No free 2048 kB hugepages reported on node 1 00:15:34.502 [2024-04-25 03:16:08.357493] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:34.502 [2024-04-25 03:16:08.426237] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:34.502 [2024-04-25 03:16:08.426274] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:34.502 [2024-04-25 03:16:08.426280] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:34.503 [2024-04-25 03:16:08.426286] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:34.503 [2024-04-25 03:16:08.426291] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:34.503 [2024-04-25 03:16:08.426321] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:34.765 03:16:09 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:34.765 03:16:09 -- common/autotest_common.sh@850 -- # return 0 00:15:34.765 03:16:09 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:15:34.765 03:16:09 -- common/autotest_common.sh@716 -- # xtrace_disable 00:15:34.765 03:16:09 -- common/autotest_common.sh@10 -- # set +x 00:15:34.765 03:16:09 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:34.765 03:16:09 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:15:35.023 [2024-04-25 03:16:09.286059] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x2427cb0/0x24272f0) succeed. 00:15:35.023 [2024-04-25 03:16:09.294475] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x2428f60/0x2427870) succeed. 00:15:35.023 [2024-04-25 03:16:09.294496] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:15:35.023 03:16:09 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:15:35.023 03:16:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:15:35.023 03:16:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:35.023 03:16:09 -- common/autotest_common.sh@10 -- # set +x 00:15:35.023 ************************************ 00:15:35.023 START TEST lvs_grow_clean 00:15:35.023 ************************************ 00:15:35.023 03:16:09 -- common/autotest_common.sh@1111 -- # lvs_grow 00:15:35.023 03:16:09 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:15:35.023 03:16:09 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:15:35.023 03:16:09 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:15:35.023 03:16:09 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:15:35.023 03:16:09 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:15:35.023 03:16:09 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:15:35.023 03:16:09 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:35.023 03:16:09 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:35.023 03:16:09 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:35.283 03:16:09 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:15:35.283 03:16:09 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:15:35.544 03:16:09 -- target/nvmf_lvs_grow.sh@28 -- # lvs=25c213b6-ed7e-4887-ad0c-d4ed9e0ad5ee 00:15:35.544 03:16:09 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 25c213b6-ed7e-4887-ad0c-d4ed9e0ad5ee 00:15:35.544 03:16:09 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:15:35.544 03:16:09 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:15:35.544 03:16:09 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:15:35.544 03:16:09 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 25c213b6-ed7e-4887-ad0c-d4ed9e0ad5ee lvol 150 00:15:35.803 03:16:10 -- target/nvmf_lvs_grow.sh@33 -- # lvol=d395f1a0-63ff-4348-8b01-c2386d88cb28 00:15:35.803 03:16:10 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:35.803 03:16:10 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:15:36.062 [2024-04-25 03:16:10.306637] bdev_aio.c:1030:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:15:36.062 [2024-04-25 03:16:10.306689] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:15:36.062 true 00:15:36.062 03:16:10 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 25c213b6-ed7e-4887-ad0c-d4ed9e0ad5ee 00:15:36.062 03:16:10 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:15:36.062 03:16:10 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:15:36.062 03:16:10 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:15:36.321 03:16:10 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 d395f1a0-63ff-4348-8b01-c2386d88cb28 00:15:36.321 03:16:10 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:15:36.579 [2024-04-25 03:16:10.952527] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:15:36.579 03:16:10 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:15:36.838 03:16:11 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=4062037 00:15:36.838 03:16:11 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:36.838 03:16:11 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 4062037 /var/tmp/bdevperf.sock 00:15:36.838 03:16:11 -- common/autotest_common.sh@817 -- # '[' -z 4062037 ']' 00:15:36.838 03:16:11 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:36.838 03:16:11 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:36.838 03:16:11 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:36.838 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:36.838 03:16:11 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:36.838 03:16:11 -- common/autotest_common.sh@10 -- # set +x 00:15:36.838 03:16:11 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:15:36.839 [2024-04-25 03:16:11.169181] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:15:36.839 [2024-04-25 03:16:11.169229] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4062037 ] 00:15:36.839 EAL: No free 2048 kB hugepages reported on node 1 00:15:36.839 [2024-04-25 03:16:11.229658] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:36.839 [2024-04-25 03:16:11.298798] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:37.774 03:16:11 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:37.774 03:16:11 -- common/autotest_common.sh@850 -- # return 0 00:15:37.774 03:16:11 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:15:37.774 Nvme0n1 00:15:37.774 03:16:12 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:15:38.033 [ 00:15:38.033 { 00:15:38.033 "name": "Nvme0n1", 00:15:38.033 "aliases": [ 00:15:38.033 "d395f1a0-63ff-4348-8b01-c2386d88cb28" 00:15:38.033 ], 00:15:38.033 "product_name": "NVMe disk", 00:15:38.033 "block_size": 4096, 00:15:38.033 "num_blocks": 38912, 00:15:38.033 "uuid": "d395f1a0-63ff-4348-8b01-c2386d88cb28", 00:15:38.033 "assigned_rate_limits": { 00:15:38.033 "rw_ios_per_sec": 0, 00:15:38.033 "rw_mbytes_per_sec": 0, 00:15:38.033 "r_mbytes_per_sec": 0, 00:15:38.033 "w_mbytes_per_sec": 0 00:15:38.033 }, 00:15:38.033 "claimed": false, 00:15:38.033 "zoned": false, 00:15:38.033 "supported_io_types": { 00:15:38.033 "read": true, 00:15:38.033 "write": true, 00:15:38.033 "unmap": true, 00:15:38.033 "write_zeroes": true, 00:15:38.033 "flush": true, 00:15:38.033 "reset": true, 00:15:38.033 "compare": true, 00:15:38.033 "compare_and_write": true, 00:15:38.033 "abort": true, 00:15:38.033 "nvme_admin": true, 00:15:38.033 "nvme_io": true 00:15:38.033 }, 00:15:38.033 "memory_domains": [ 00:15:38.033 { 00:15:38.033 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:15:38.033 "dma_device_type": 0 00:15:38.033 } 00:15:38.033 ], 00:15:38.033 "driver_specific": { 00:15:38.033 "nvme": [ 00:15:38.033 { 00:15:38.033 "trid": { 00:15:38.033 "trtype": "RDMA", 00:15:38.033 "adrfam": "IPv4", 00:15:38.033 "traddr": "192.168.100.8", 00:15:38.033 "trsvcid": "4420", 00:15:38.033 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:15:38.033 }, 00:15:38.033 "ctrlr_data": { 00:15:38.033 "cntlid": 1, 00:15:38.033 "vendor_id": "0x8086", 00:15:38.033 "model_number": "SPDK bdev Controller", 00:15:38.033 "serial_number": "SPDK0", 00:15:38.033 "firmware_revision": "24.05", 00:15:38.033 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:15:38.033 "oacs": { 00:15:38.033 "security": 0, 00:15:38.033 "format": 0, 00:15:38.033 "firmware": 0, 00:15:38.033 "ns_manage": 0 00:15:38.033 }, 00:15:38.033 "multi_ctrlr": true, 00:15:38.033 "ana_reporting": false 00:15:38.033 }, 00:15:38.033 "vs": { 00:15:38.033 "nvme_version": "1.3" 00:15:38.033 }, 00:15:38.033 "ns_data": { 00:15:38.033 "id": 1, 00:15:38.033 "can_share": true 00:15:38.033 } 00:15:38.033 } 00:15:38.033 ], 00:15:38.033 "mp_policy": "active_passive" 00:15:38.033 } 00:15:38.033 } 00:15:38.033 ] 00:15:38.033 03:16:12 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=4062215 00:15:38.033 03:16:12 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:15:38.033 03:16:12 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:38.033 Running I/O for 10 seconds... 00:15:38.968 Latency(us) 00:15:38.969 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:38.969 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:38.969 Nvme0n1 : 1.00 35719.00 139.53 0.00 0.00 0.00 0.00 0.00 00:15:38.969 =================================================================================================================== 00:15:38.969 Total : 35719.00 139.53 0.00 0.00 0.00 0.00 0.00 00:15:38.969 00:15:39.902 03:16:14 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 25c213b6-ed7e-4887-ad0c-d4ed9e0ad5ee 00:15:40.160 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:40.160 Nvme0n1 : 2.00 36077.00 140.93 0.00 0.00 0.00 0.00 0.00 00:15:40.160 =================================================================================================================== 00:15:40.160 Total : 36077.00 140.93 0.00 0.00 0.00 0.00 0.00 00:15:40.160 00:15:40.160 true 00:15:40.160 03:16:14 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 25c213b6-ed7e-4887-ad0c-d4ed9e0ad5ee 00:15:40.160 03:16:14 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:15:40.419 03:16:14 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:15:40.419 03:16:14 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:15:40.419 03:16:14 -- target/nvmf_lvs_grow.sh@65 -- # wait 4062215 00:15:40.986 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:40.986 Nvme0n1 : 3.00 36168.67 141.28 0.00 0.00 0.00 0.00 0.00 00:15:40.986 =================================================================================================================== 00:15:40.986 Total : 36168.67 141.28 0.00 0.00 0.00 0.00 0.00 00:15:40.986 00:15:42.361 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:42.361 Nvme0n1 : 4.00 36318.25 141.87 0.00 0.00 0.00 0.00 0.00 00:15:42.361 =================================================================================================================== 00:15:42.361 Total : 36318.25 141.87 0.00 0.00 0.00 0.00 0.00 00:15:42.361 00:15:43.297 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:43.298 Nvme0n1 : 5.00 36410.60 142.23 0.00 0.00 0.00 0.00 0.00 00:15:43.298 =================================================================================================================== 00:15:43.298 Total : 36410.60 142.23 0.00 0.00 0.00 0.00 0.00 00:15:43.298 00:15:44.241 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:44.241 Nvme0n1 : 6.00 36473.33 142.47 0.00 0.00 0.00 0.00 0.00 00:15:44.241 =================================================================================================================== 00:15:44.241 Total : 36473.33 142.47 0.00 0.00 0.00 0.00 0.00 00:15:44.241 00:15:45.173 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:45.173 Nvme0n1 : 7.00 36526.43 142.68 0.00 0.00 0.00 0.00 0.00 00:15:45.173 =================================================================================================================== 00:15:45.173 Total : 36526.43 142.68 0.00 0.00 0.00 0.00 0.00 00:15:45.173 00:15:46.110 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:46.110 Nvme0n1 : 8.00 36472.62 142.47 0.00 0.00 0.00 0.00 0.00 00:15:46.110 =================================================================================================================== 00:15:46.110 Total : 36472.62 142.47 0.00 0.00 0.00 0.00 0.00 00:15:46.110 00:15:47.104 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:47.104 Nvme0n1 : 9.00 36465.33 142.44 0.00 0.00 0.00 0.00 0.00 00:15:47.104 =================================================================================================================== 00:15:47.104 Total : 36465.33 142.44 0.00 0.00 0.00 0.00 0.00 00:15:47.104 00:15:48.040 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:48.040 Nvme0n1 : 10.00 36502.60 142.59 0.00 0.00 0.00 0.00 0.00 00:15:48.040 =================================================================================================================== 00:15:48.040 Total : 36502.60 142.59 0.00 0.00 0.00 0.00 0.00 00:15:48.040 00:15:48.040 00:15:48.040 Latency(us) 00:15:48.040 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:48.040 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:48.040 Nvme0n1 : 10.00 36503.58 142.59 0.00 0.00 3503.74 2262.55 14979.66 00:15:48.040 =================================================================================================================== 00:15:48.040 Total : 36503.58 142.59 0.00 0.00 3503.74 2262.55 14979.66 00:15:48.040 0 00:15:48.040 03:16:22 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 4062037 00:15:48.040 03:16:22 -- common/autotest_common.sh@936 -- # '[' -z 4062037 ']' 00:15:48.040 03:16:22 -- common/autotest_common.sh@940 -- # kill -0 4062037 00:15:48.040 03:16:22 -- common/autotest_common.sh@941 -- # uname 00:15:48.040 03:16:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:48.040 03:16:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4062037 00:15:48.040 03:16:22 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:48.040 03:16:22 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:48.040 03:16:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4062037' 00:15:48.040 killing process with pid 4062037 00:15:48.040 03:16:22 -- common/autotest_common.sh@955 -- # kill 4062037 00:15:48.040 Received shutdown signal, test time was about 10.000000 seconds 00:15:48.040 00:15:48.040 Latency(us) 00:15:48.040 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:48.040 =================================================================================================================== 00:15:48.040 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:48.040 03:16:22 -- common/autotest_common.sh@960 -- # wait 4062037 00:15:48.298 03:16:22 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:48.557 03:16:22 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 25c213b6-ed7e-4887-ad0c-d4ed9e0ad5ee 00:15:48.557 03:16:22 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:15:48.815 03:16:23 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:15:48.815 03:16:23 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:15:48.815 03:16:23 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:48.815 [2024-04-25 03:16:23.225329] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:15:48.815 03:16:23 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 25c213b6-ed7e-4887-ad0c-d4ed9e0ad5ee 00:15:48.815 03:16:23 -- common/autotest_common.sh@638 -- # local es=0 00:15:48.815 03:16:23 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 25c213b6-ed7e-4887-ad0c-d4ed9e0ad5ee 00:15:48.815 03:16:23 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:15:48.815 03:16:23 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:15:48.815 03:16:23 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:15:48.815 03:16:23 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:15:48.815 03:16:23 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:15:48.815 03:16:23 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:15:48.815 03:16:23 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:15:48.815 03:16:23 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py ]] 00:15:48.815 03:16:23 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 25c213b6-ed7e-4887-ad0c-d4ed9e0ad5ee 00:15:49.074 request: 00:15:49.074 { 00:15:49.074 "uuid": "25c213b6-ed7e-4887-ad0c-d4ed9e0ad5ee", 00:15:49.074 "method": "bdev_lvol_get_lvstores", 00:15:49.074 "req_id": 1 00:15:49.074 } 00:15:49.074 Got JSON-RPC error response 00:15:49.074 response: 00:15:49.074 { 00:15:49.074 "code": -19, 00:15:49.074 "message": "No such device" 00:15:49.074 } 00:15:49.074 03:16:23 -- common/autotest_common.sh@641 -- # es=1 00:15:49.074 03:16:23 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:15:49.074 03:16:23 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:15:49.074 03:16:23 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:15:49.074 03:16:23 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:49.333 aio_bdev 00:15:49.333 03:16:23 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev d395f1a0-63ff-4348-8b01-c2386d88cb28 00:15:49.333 03:16:23 -- common/autotest_common.sh@885 -- # local bdev_name=d395f1a0-63ff-4348-8b01-c2386d88cb28 00:15:49.333 03:16:23 -- common/autotest_common.sh@886 -- # local bdev_timeout= 00:15:49.333 03:16:23 -- common/autotest_common.sh@887 -- # local i 00:15:49.333 03:16:23 -- common/autotest_common.sh@888 -- # [[ -z '' ]] 00:15:49.333 03:16:23 -- common/autotest_common.sh@888 -- # bdev_timeout=2000 00:15:49.333 03:16:23 -- common/autotest_common.sh@890 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:49.333 03:16:23 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b d395f1a0-63ff-4348-8b01-c2386d88cb28 -t 2000 00:15:49.591 [ 00:15:49.591 { 00:15:49.591 "name": "d395f1a0-63ff-4348-8b01-c2386d88cb28", 00:15:49.591 "aliases": [ 00:15:49.591 "lvs/lvol" 00:15:49.591 ], 00:15:49.591 "product_name": "Logical Volume", 00:15:49.591 "block_size": 4096, 00:15:49.591 "num_blocks": 38912, 00:15:49.591 "uuid": "d395f1a0-63ff-4348-8b01-c2386d88cb28", 00:15:49.591 "assigned_rate_limits": { 00:15:49.591 "rw_ios_per_sec": 0, 00:15:49.591 "rw_mbytes_per_sec": 0, 00:15:49.591 "r_mbytes_per_sec": 0, 00:15:49.591 "w_mbytes_per_sec": 0 00:15:49.591 }, 00:15:49.591 "claimed": false, 00:15:49.591 "zoned": false, 00:15:49.591 "supported_io_types": { 00:15:49.591 "read": true, 00:15:49.591 "write": true, 00:15:49.591 "unmap": true, 00:15:49.591 "write_zeroes": true, 00:15:49.591 "flush": false, 00:15:49.591 "reset": true, 00:15:49.591 "compare": false, 00:15:49.591 "compare_and_write": false, 00:15:49.591 "abort": false, 00:15:49.591 "nvme_admin": false, 00:15:49.591 "nvme_io": false 00:15:49.591 }, 00:15:49.591 "driver_specific": { 00:15:49.591 "lvol": { 00:15:49.591 "lvol_store_uuid": "25c213b6-ed7e-4887-ad0c-d4ed9e0ad5ee", 00:15:49.591 "base_bdev": "aio_bdev", 00:15:49.591 "thin_provision": false, 00:15:49.591 "snapshot": false, 00:15:49.591 "clone": false, 00:15:49.591 "esnap_clone": false 00:15:49.591 } 00:15:49.591 } 00:15:49.591 } 00:15:49.591 ] 00:15:49.591 03:16:23 -- common/autotest_common.sh@893 -- # return 0 00:15:49.591 03:16:23 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 25c213b6-ed7e-4887-ad0c-d4ed9e0ad5ee 00:15:49.591 03:16:23 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:49.850 03:16:24 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:49.850 03:16:24 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 25c213b6-ed7e-4887-ad0c-d4ed9e0ad5ee 00:15:49.850 03:16:24 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:49.850 03:16:24 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:49.850 03:16:24 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete d395f1a0-63ff-4348-8b01-c2386d88cb28 00:15:50.109 03:16:24 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 25c213b6-ed7e-4887-ad0c-d4ed9e0ad5ee 00:15:50.368 03:16:24 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:50.368 03:16:24 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:50.368 00:15:50.368 real 0m15.384s 00:15:50.368 user 0m15.455s 00:15:50.368 sys 0m0.993s 00:15:50.368 03:16:24 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:15:50.368 03:16:24 -- common/autotest_common.sh@10 -- # set +x 00:15:50.368 ************************************ 00:15:50.368 END TEST lvs_grow_clean 00:15:50.368 ************************************ 00:15:50.368 03:16:24 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:15:50.368 03:16:24 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:50.368 03:16:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:50.368 03:16:24 -- common/autotest_common.sh@10 -- # set +x 00:15:50.628 ************************************ 00:15:50.628 START TEST lvs_grow_dirty 00:15:50.628 ************************************ 00:15:50.628 03:16:24 -- common/autotest_common.sh@1111 -- # lvs_grow dirty 00:15:50.628 03:16:24 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:15:50.628 03:16:24 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:15:50.628 03:16:24 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:15:50.628 03:16:24 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:15:50.628 03:16:24 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:15:50.628 03:16:24 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:15:50.628 03:16:24 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:50.628 03:16:24 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:50.628 03:16:24 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:50.887 03:16:25 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:15:50.887 03:16:25 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:15:50.887 03:16:25 -- target/nvmf_lvs_grow.sh@28 -- # lvs=bb5f90bb-fffd-482b-8c9d-e8d272d85577 00:15:50.887 03:16:25 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bb5f90bb-fffd-482b-8c9d-e8d272d85577 00:15:50.887 03:16:25 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:15:51.146 03:16:25 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:15:51.146 03:16:25 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:15:51.146 03:16:25 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u bb5f90bb-fffd-482b-8c9d-e8d272d85577 lvol 150 00:15:51.405 03:16:25 -- target/nvmf_lvs_grow.sh@33 -- # lvol=8173517d-2478-4927-ab6b-6046eadc37ff 00:15:51.405 03:16:25 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:51.405 03:16:25 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:15:51.405 [2024-04-25 03:16:25.831517] bdev_aio.c:1030:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:15:51.405 [2024-04-25 03:16:25.831564] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:15:51.405 true 00:15:51.405 03:16:25 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bb5f90bb-fffd-482b-8c9d-e8d272d85577 00:15:51.405 03:16:25 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:15:51.664 03:16:26 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:15:51.664 03:16:26 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:15:51.923 03:16:26 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 8173517d-2478-4927-ab6b-6046eadc37ff 00:15:51.924 03:16:26 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:15:52.183 03:16:26 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:15:52.183 03:16:26 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:15:52.183 03:16:26 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=4064758 00:15:52.183 03:16:26 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:52.183 03:16:26 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 4064758 /var/tmp/bdevperf.sock 00:15:52.183 03:16:26 -- common/autotest_common.sh@817 -- # '[' -z 4064758 ']' 00:15:52.183 03:16:26 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:52.183 03:16:26 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:52.183 03:16:26 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:52.183 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:52.183 03:16:26 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:52.183 03:16:26 -- common/autotest_common.sh@10 -- # set +x 00:15:52.442 [2024-04-25 03:16:26.702226] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:15:52.442 [2024-04-25 03:16:26.702269] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4064758 ] 00:15:52.442 EAL: No free 2048 kB hugepages reported on node 1 00:15:52.442 [2024-04-25 03:16:26.759349] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:52.442 [2024-04-25 03:16:26.828310] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:53.379 03:16:27 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:53.379 03:16:27 -- common/autotest_common.sh@850 -- # return 0 00:15:53.379 03:16:27 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:15:53.379 Nvme0n1 00:15:53.379 03:16:27 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:15:53.638 [ 00:15:53.638 { 00:15:53.638 "name": "Nvme0n1", 00:15:53.638 "aliases": [ 00:15:53.638 "8173517d-2478-4927-ab6b-6046eadc37ff" 00:15:53.638 ], 00:15:53.638 "product_name": "NVMe disk", 00:15:53.638 "block_size": 4096, 00:15:53.638 "num_blocks": 38912, 00:15:53.638 "uuid": "8173517d-2478-4927-ab6b-6046eadc37ff", 00:15:53.638 "assigned_rate_limits": { 00:15:53.638 "rw_ios_per_sec": 0, 00:15:53.638 "rw_mbytes_per_sec": 0, 00:15:53.638 "r_mbytes_per_sec": 0, 00:15:53.638 "w_mbytes_per_sec": 0 00:15:53.638 }, 00:15:53.638 "claimed": false, 00:15:53.638 "zoned": false, 00:15:53.638 "supported_io_types": { 00:15:53.638 "read": true, 00:15:53.638 "write": true, 00:15:53.638 "unmap": true, 00:15:53.638 "write_zeroes": true, 00:15:53.638 "flush": true, 00:15:53.638 "reset": true, 00:15:53.638 "compare": true, 00:15:53.638 "compare_and_write": true, 00:15:53.638 "abort": true, 00:15:53.638 "nvme_admin": true, 00:15:53.638 "nvme_io": true 00:15:53.638 }, 00:15:53.638 "memory_domains": [ 00:15:53.638 { 00:15:53.638 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:15:53.638 "dma_device_type": 0 00:15:53.638 } 00:15:53.638 ], 00:15:53.638 "driver_specific": { 00:15:53.638 "nvme": [ 00:15:53.638 { 00:15:53.638 "trid": { 00:15:53.638 "trtype": "RDMA", 00:15:53.638 "adrfam": "IPv4", 00:15:53.638 "traddr": "192.168.100.8", 00:15:53.638 "trsvcid": "4420", 00:15:53.638 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:15:53.638 }, 00:15:53.638 "ctrlr_data": { 00:15:53.638 "cntlid": 1, 00:15:53.638 "vendor_id": "0x8086", 00:15:53.638 "model_number": "SPDK bdev Controller", 00:15:53.638 "serial_number": "SPDK0", 00:15:53.638 "firmware_revision": "24.05", 00:15:53.638 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:15:53.638 "oacs": { 00:15:53.638 "security": 0, 00:15:53.638 "format": 0, 00:15:53.638 "firmware": 0, 00:15:53.638 "ns_manage": 0 00:15:53.638 }, 00:15:53.638 "multi_ctrlr": true, 00:15:53.638 "ana_reporting": false 00:15:53.638 }, 00:15:53.638 "vs": { 00:15:53.638 "nvme_version": "1.3" 00:15:53.638 }, 00:15:53.638 "ns_data": { 00:15:53.638 "id": 1, 00:15:53.638 "can_share": true 00:15:53.638 } 00:15:53.638 } 00:15:53.638 ], 00:15:53.638 "mp_policy": "active_passive" 00:15:53.638 } 00:15:53.638 } 00:15:53.638 ] 00:15:53.638 03:16:27 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:53.638 03:16:27 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=4064899 00:15:53.638 03:16:27 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:15:53.638 Running I/O for 10 seconds... 00:15:54.574 Latency(us) 00:15:54.574 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:54.574 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:54.574 Nvme0n1 : 1.00 35838.00 139.99 0.00 0.00 0.00 0.00 0.00 00:15:54.574 =================================================================================================================== 00:15:54.574 Total : 35838.00 139.99 0.00 0.00 0.00 0.00 0.00 00:15:54.574 00:15:55.510 03:16:29 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u bb5f90bb-fffd-482b-8c9d-e8d272d85577 00:15:55.510 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:55.511 Nvme0n1 : 2.00 36147.50 141.20 0.00 0.00 0.00 0.00 0.00 00:15:55.511 =================================================================================================================== 00:15:55.511 Total : 36147.50 141.20 0.00 0.00 0.00 0.00 0.00 00:15:55.511 00:15:55.769 true 00:15:55.769 03:16:30 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bb5f90bb-fffd-482b-8c9d-e8d272d85577 00:15:55.769 03:16:30 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:15:56.027 03:16:30 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:15:56.027 03:16:30 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:15:56.027 03:16:30 -- target/nvmf_lvs_grow.sh@65 -- # wait 4064899 00:15:56.595 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:56.595 Nvme0n1 : 3.00 36137.33 141.16 0.00 0.00 0.00 0.00 0.00 00:15:56.595 =================================================================================================================== 00:15:56.595 Total : 36137.33 141.16 0.00 0.00 0.00 0.00 0.00 00:15:56.595 00:15:57.531 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:57.531 Nvme0n1 : 4.00 36311.25 141.84 0.00 0.00 0.00 0.00 0.00 00:15:57.531 =================================================================================================================== 00:15:57.531 Total : 36311.25 141.84 0.00 0.00 0.00 0.00 0.00 00:15:57.531 00:15:58.908 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:58.908 Nvme0n1 : 5.00 36427.60 142.30 0.00 0.00 0.00 0.00 0.00 00:15:58.908 =================================================================================================================== 00:15:58.908 Total : 36427.60 142.30 0.00 0.00 0.00 0.00 0.00 00:15:58.908 00:15:59.843 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:59.843 Nvme0n1 : 6.00 36502.17 142.59 0.00 0.00 0.00 0.00 0.00 00:15:59.844 =================================================================================================================== 00:15:59.844 Total : 36502.17 142.59 0.00 0.00 0.00 0.00 0.00 00:15:59.844 00:16:00.780 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:00.780 Nvme0n1 : 7.00 36562.86 142.82 0.00 0.00 0.00 0.00 0.00 00:16:00.780 =================================================================================================================== 00:16:00.780 Total : 36562.86 142.82 0.00 0.00 0.00 0.00 0.00 00:16:00.780 00:16:01.715 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:01.715 Nvme0n1 : 8.00 36612.25 143.02 0.00 0.00 0.00 0.00 0.00 00:16:01.715 =================================================================================================================== 00:16:01.715 Total : 36612.25 143.02 0.00 0.00 0.00 0.00 0.00 00:16:01.715 00:16:02.679 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:02.679 Nvme0n1 : 9.00 36629.00 143.08 0.00 0.00 0.00 0.00 0.00 00:16:02.679 =================================================================================================================== 00:16:02.679 Total : 36629.00 143.08 0.00 0.00 0.00 0.00 0.00 00:16:02.679 00:16:03.616 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:03.616 Nvme0n1 : 10.00 36649.10 143.16 0.00 0.00 0.00 0.00 0.00 00:16:03.616 =================================================================================================================== 00:16:03.616 Total : 36649.10 143.16 0.00 0.00 0.00 0.00 0.00 00:16:03.616 00:16:03.616 00:16:03.616 Latency(us) 00:16:03.616 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:03.616 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:03.616 Nvme0n1 : 10.00 36650.37 143.17 0.00 0.00 3489.62 2278.16 14979.66 00:16:03.616 =================================================================================================================== 00:16:03.616 Total : 36650.37 143.17 0.00 0.00 3489.62 2278.16 14979.66 00:16:03.616 0 00:16:03.616 03:16:38 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 4064758 00:16:03.616 03:16:38 -- common/autotest_common.sh@936 -- # '[' -z 4064758 ']' 00:16:03.616 03:16:38 -- common/autotest_common.sh@940 -- # kill -0 4064758 00:16:03.616 03:16:38 -- common/autotest_common.sh@941 -- # uname 00:16:03.616 03:16:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:03.616 03:16:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4064758 00:16:03.616 03:16:38 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:03.616 03:16:38 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:03.616 03:16:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4064758' 00:16:03.616 killing process with pid 4064758 00:16:03.616 03:16:38 -- common/autotest_common.sh@955 -- # kill 4064758 00:16:03.616 Received shutdown signal, test time was about 10.000000 seconds 00:16:03.616 00:16:03.616 Latency(us) 00:16:03.616 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:03.616 =================================================================================================================== 00:16:03.616 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:03.616 03:16:38 -- common/autotest_common.sh@960 -- # wait 4064758 00:16:03.875 03:16:38 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:16:04.133 03:16:38 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bb5f90bb-fffd-482b-8c9d-e8d272d85577 00:16:04.133 03:16:38 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:16:04.393 03:16:38 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:16:04.393 03:16:38 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:16:04.393 03:16:38 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 4061485 00:16:04.393 03:16:38 -- target/nvmf_lvs_grow.sh@74 -- # wait 4061485 00:16:04.393 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 4061485 Killed "${NVMF_APP[@]}" "$@" 00:16:04.393 03:16:38 -- target/nvmf_lvs_grow.sh@74 -- # true 00:16:04.393 03:16:38 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:16:04.393 03:16:38 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:04.393 03:16:38 -- common/autotest_common.sh@710 -- # xtrace_disable 00:16:04.393 03:16:38 -- common/autotest_common.sh@10 -- # set +x 00:16:04.393 03:16:38 -- nvmf/common.sh@470 -- # nvmfpid=4066595 00:16:04.393 03:16:38 -- nvmf/common.sh@471 -- # waitforlisten 4066595 00:16:04.393 03:16:38 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:16:04.393 03:16:38 -- common/autotest_common.sh@817 -- # '[' -z 4066595 ']' 00:16:04.393 03:16:38 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:04.393 03:16:38 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:04.393 03:16:38 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:04.393 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:04.393 03:16:38 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:04.393 03:16:38 -- common/autotest_common.sh@10 -- # set +x 00:16:04.393 [2024-04-25 03:16:38.728659] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:16:04.393 [2024-04-25 03:16:38.728706] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:04.393 EAL: No free 2048 kB hugepages reported on node 1 00:16:04.393 [2024-04-25 03:16:38.789211] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:04.393 [2024-04-25 03:16:38.864832] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:04.393 [2024-04-25 03:16:38.864873] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:04.393 [2024-04-25 03:16:38.864881] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:04.393 [2024-04-25 03:16:38.864887] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:04.393 [2024-04-25 03:16:38.864892] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:04.393 [2024-04-25 03:16:38.864911] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:05.330 03:16:39 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:05.330 03:16:39 -- common/autotest_common.sh@850 -- # return 0 00:16:05.330 03:16:39 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:05.330 03:16:39 -- common/autotest_common.sh@716 -- # xtrace_disable 00:16:05.330 03:16:39 -- common/autotest_common.sh@10 -- # set +x 00:16:05.330 03:16:39 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:05.330 03:16:39 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:16:05.330 [2024-04-25 03:16:39.705201] blobstore.c:4779:bs_recover: *NOTICE*: Performing recovery on blobstore 00:16:05.330 [2024-04-25 03:16:39.705271] blobstore.c:4726:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:16:05.330 [2024-04-25 03:16:39.705295] blobstore.c:4726:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:16:05.330 03:16:39 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:16:05.330 03:16:39 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 8173517d-2478-4927-ab6b-6046eadc37ff 00:16:05.330 03:16:39 -- common/autotest_common.sh@885 -- # local bdev_name=8173517d-2478-4927-ab6b-6046eadc37ff 00:16:05.330 03:16:39 -- common/autotest_common.sh@886 -- # local bdev_timeout= 00:16:05.330 03:16:39 -- common/autotest_common.sh@887 -- # local i 00:16:05.330 03:16:39 -- common/autotest_common.sh@888 -- # [[ -z '' ]] 00:16:05.330 03:16:39 -- common/autotest_common.sh@888 -- # bdev_timeout=2000 00:16:05.330 03:16:39 -- common/autotest_common.sh@890 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:16:05.589 03:16:39 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 8173517d-2478-4927-ab6b-6046eadc37ff -t 2000 00:16:05.589 [ 00:16:05.589 { 00:16:05.589 "name": "8173517d-2478-4927-ab6b-6046eadc37ff", 00:16:05.589 "aliases": [ 00:16:05.589 "lvs/lvol" 00:16:05.589 ], 00:16:05.589 "product_name": "Logical Volume", 00:16:05.589 "block_size": 4096, 00:16:05.589 "num_blocks": 38912, 00:16:05.589 "uuid": "8173517d-2478-4927-ab6b-6046eadc37ff", 00:16:05.589 "assigned_rate_limits": { 00:16:05.589 "rw_ios_per_sec": 0, 00:16:05.589 "rw_mbytes_per_sec": 0, 00:16:05.589 "r_mbytes_per_sec": 0, 00:16:05.589 "w_mbytes_per_sec": 0 00:16:05.589 }, 00:16:05.589 "claimed": false, 00:16:05.589 "zoned": false, 00:16:05.589 "supported_io_types": { 00:16:05.589 "read": true, 00:16:05.589 "write": true, 00:16:05.589 "unmap": true, 00:16:05.589 "write_zeroes": true, 00:16:05.589 "flush": false, 00:16:05.589 "reset": true, 00:16:05.589 "compare": false, 00:16:05.589 "compare_and_write": false, 00:16:05.589 "abort": false, 00:16:05.589 "nvme_admin": false, 00:16:05.589 "nvme_io": false 00:16:05.589 }, 00:16:05.589 "driver_specific": { 00:16:05.589 "lvol": { 00:16:05.589 "lvol_store_uuid": "bb5f90bb-fffd-482b-8c9d-e8d272d85577", 00:16:05.589 "base_bdev": "aio_bdev", 00:16:05.589 "thin_provision": false, 00:16:05.589 "snapshot": false, 00:16:05.589 "clone": false, 00:16:05.589 "esnap_clone": false 00:16:05.589 } 00:16:05.589 } 00:16:05.589 } 00:16:05.589 ] 00:16:05.589 03:16:40 -- common/autotest_common.sh@893 -- # return 0 00:16:05.589 03:16:40 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bb5f90bb-fffd-482b-8c9d-e8d272d85577 00:16:05.589 03:16:40 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:16:05.848 03:16:40 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:16:05.848 03:16:40 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bb5f90bb-fffd-482b-8c9d-e8d272d85577 00:16:05.848 03:16:40 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:16:06.106 03:16:40 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:16:06.106 03:16:40 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:16:06.106 [2024-04-25 03:16:40.573912] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:16:06.106 03:16:40 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bb5f90bb-fffd-482b-8c9d-e8d272d85577 00:16:06.106 03:16:40 -- common/autotest_common.sh@638 -- # local es=0 00:16:06.106 03:16:40 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bb5f90bb-fffd-482b-8c9d-e8d272d85577 00:16:06.106 03:16:40 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:16:06.365 03:16:40 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:06.365 03:16:40 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:16:06.365 03:16:40 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:06.365 03:16:40 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:16:06.365 03:16:40 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:06.365 03:16:40 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:16:06.365 03:16:40 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py ]] 00:16:06.365 03:16:40 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bb5f90bb-fffd-482b-8c9d-e8d272d85577 00:16:06.365 request: 00:16:06.365 { 00:16:06.365 "uuid": "bb5f90bb-fffd-482b-8c9d-e8d272d85577", 00:16:06.365 "method": "bdev_lvol_get_lvstores", 00:16:06.365 "req_id": 1 00:16:06.365 } 00:16:06.365 Got JSON-RPC error response 00:16:06.365 response: 00:16:06.365 { 00:16:06.365 "code": -19, 00:16:06.365 "message": "No such device" 00:16:06.365 } 00:16:06.365 03:16:40 -- common/autotest_common.sh@641 -- # es=1 00:16:06.365 03:16:40 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:16:06.365 03:16:40 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:16:06.365 03:16:40 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:16:06.365 03:16:40 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:16:06.624 aio_bdev 00:16:06.624 03:16:40 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 8173517d-2478-4927-ab6b-6046eadc37ff 00:16:06.624 03:16:40 -- common/autotest_common.sh@885 -- # local bdev_name=8173517d-2478-4927-ab6b-6046eadc37ff 00:16:06.624 03:16:40 -- common/autotest_common.sh@886 -- # local bdev_timeout= 00:16:06.624 03:16:40 -- common/autotest_common.sh@887 -- # local i 00:16:06.624 03:16:40 -- common/autotest_common.sh@888 -- # [[ -z '' ]] 00:16:06.624 03:16:40 -- common/autotest_common.sh@888 -- # bdev_timeout=2000 00:16:06.624 03:16:40 -- common/autotest_common.sh@890 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:16:06.624 03:16:41 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 8173517d-2478-4927-ab6b-6046eadc37ff -t 2000 00:16:06.883 [ 00:16:06.883 { 00:16:06.883 "name": "8173517d-2478-4927-ab6b-6046eadc37ff", 00:16:06.883 "aliases": [ 00:16:06.883 "lvs/lvol" 00:16:06.883 ], 00:16:06.883 "product_name": "Logical Volume", 00:16:06.883 "block_size": 4096, 00:16:06.883 "num_blocks": 38912, 00:16:06.883 "uuid": "8173517d-2478-4927-ab6b-6046eadc37ff", 00:16:06.883 "assigned_rate_limits": { 00:16:06.883 "rw_ios_per_sec": 0, 00:16:06.883 "rw_mbytes_per_sec": 0, 00:16:06.883 "r_mbytes_per_sec": 0, 00:16:06.883 "w_mbytes_per_sec": 0 00:16:06.883 }, 00:16:06.883 "claimed": false, 00:16:06.883 "zoned": false, 00:16:06.883 "supported_io_types": { 00:16:06.883 "read": true, 00:16:06.883 "write": true, 00:16:06.883 "unmap": true, 00:16:06.883 "write_zeroes": true, 00:16:06.883 "flush": false, 00:16:06.883 "reset": true, 00:16:06.883 "compare": false, 00:16:06.883 "compare_and_write": false, 00:16:06.883 "abort": false, 00:16:06.883 "nvme_admin": false, 00:16:06.883 "nvme_io": false 00:16:06.883 }, 00:16:06.883 "driver_specific": { 00:16:06.883 "lvol": { 00:16:06.883 "lvol_store_uuid": "bb5f90bb-fffd-482b-8c9d-e8d272d85577", 00:16:06.883 "base_bdev": "aio_bdev", 00:16:06.883 "thin_provision": false, 00:16:06.883 "snapshot": false, 00:16:06.883 "clone": false, 00:16:06.883 "esnap_clone": false 00:16:06.883 } 00:16:06.883 } 00:16:06.883 } 00:16:06.883 ] 00:16:06.883 03:16:41 -- common/autotest_common.sh@893 -- # return 0 00:16:06.883 03:16:41 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bb5f90bb-fffd-482b-8c9d-e8d272d85577 00:16:06.883 03:16:41 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:16:07.141 03:16:41 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:16:07.141 03:16:41 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bb5f90bb-fffd-482b-8c9d-e8d272d85577 00:16:07.141 03:16:41 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:16:07.141 03:16:41 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:16:07.141 03:16:41 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 8173517d-2478-4927-ab6b-6046eadc37ff 00:16:07.400 03:16:41 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u bb5f90bb-fffd-482b-8c9d-e8d272d85577 00:16:07.658 03:16:41 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:16:07.658 03:16:42 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:16:07.658 00:16:07.658 real 0m17.189s 00:16:07.658 user 0m45.093s 00:16:07.658 sys 0m2.827s 00:16:07.658 03:16:42 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:16:07.658 03:16:42 -- common/autotest_common.sh@10 -- # set +x 00:16:07.658 ************************************ 00:16:07.658 END TEST lvs_grow_dirty 00:16:07.658 ************************************ 00:16:07.916 03:16:42 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:16:07.916 03:16:42 -- common/autotest_common.sh@794 -- # type=--id 00:16:07.916 03:16:42 -- common/autotest_common.sh@795 -- # id=0 00:16:07.916 03:16:42 -- common/autotest_common.sh@796 -- # '[' --id = --pid ']' 00:16:07.916 03:16:42 -- common/autotest_common.sh@800 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:16:07.916 03:16:42 -- common/autotest_common.sh@800 -- # shm_files=nvmf_trace.0 00:16:07.916 03:16:42 -- common/autotest_common.sh@802 -- # [[ -z nvmf_trace.0 ]] 00:16:07.916 03:16:42 -- common/autotest_common.sh@806 -- # for n in $shm_files 00:16:07.916 03:16:42 -- common/autotest_common.sh@807 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:16:07.916 nvmf_trace.0 00:16:07.916 03:16:42 -- common/autotest_common.sh@809 -- # return 0 00:16:07.916 03:16:42 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:16:07.916 03:16:42 -- nvmf/common.sh@477 -- # nvmfcleanup 00:16:07.916 03:16:42 -- nvmf/common.sh@117 -- # sync 00:16:07.916 03:16:42 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:16:07.916 03:16:42 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:16:07.916 03:16:42 -- nvmf/common.sh@120 -- # set +e 00:16:07.916 03:16:42 -- nvmf/common.sh@121 -- # for i in {1..20} 00:16:07.916 03:16:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:16:07.916 rmmod nvme_rdma 00:16:07.916 rmmod nvme_fabrics 00:16:07.916 03:16:42 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:16:07.916 03:16:42 -- nvmf/common.sh@124 -- # set -e 00:16:07.916 03:16:42 -- nvmf/common.sh@125 -- # return 0 00:16:07.916 03:16:42 -- nvmf/common.sh@478 -- # '[' -n 4066595 ']' 00:16:07.916 03:16:42 -- nvmf/common.sh@479 -- # killprocess 4066595 00:16:07.916 03:16:42 -- common/autotest_common.sh@936 -- # '[' -z 4066595 ']' 00:16:07.916 03:16:42 -- common/autotest_common.sh@940 -- # kill -0 4066595 00:16:07.916 03:16:42 -- common/autotest_common.sh@941 -- # uname 00:16:07.916 03:16:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:07.916 03:16:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4066595 00:16:07.916 03:16:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:07.916 03:16:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:07.916 03:16:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4066595' 00:16:07.916 killing process with pid 4066595 00:16:07.916 03:16:42 -- common/autotest_common.sh@955 -- # kill 4066595 00:16:07.916 03:16:42 -- common/autotest_common.sh@960 -- # wait 4066595 00:16:08.175 03:16:42 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:16:08.175 03:16:42 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:16:08.175 00:16:08.175 real 0m40.251s 00:16:08.175 user 1m6.367s 00:16:08.175 sys 0m8.775s 00:16:08.175 03:16:42 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:16:08.175 03:16:42 -- common/autotest_common.sh@10 -- # set +x 00:16:08.175 ************************************ 00:16:08.175 END TEST nvmf_lvs_grow 00:16:08.175 ************************************ 00:16:08.175 03:16:42 -- nvmf/nvmf.sh@50 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=rdma 00:16:08.175 03:16:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:08.175 03:16:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:08.175 03:16:42 -- common/autotest_common.sh@10 -- # set +x 00:16:08.175 ************************************ 00:16:08.175 START TEST nvmf_bdev_io_wait 00:16:08.175 ************************************ 00:16:08.175 03:16:42 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=rdma 00:16:08.434 * Looking for test storage... 00:16:08.434 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:16:08.434 03:16:42 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:16:08.434 03:16:42 -- nvmf/common.sh@7 -- # uname -s 00:16:08.434 03:16:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:08.434 03:16:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:08.434 03:16:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:08.434 03:16:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:08.434 03:16:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:08.434 03:16:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:08.434 03:16:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:08.434 03:16:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:08.434 03:16:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:08.434 03:16:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:08.434 03:16:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:16:08.434 03:16:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:16:08.434 03:16:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:08.434 03:16:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:08.434 03:16:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:08.434 03:16:42 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:16:08.434 03:16:42 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:16:08.434 03:16:42 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:08.434 03:16:42 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:08.434 03:16:42 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:08.434 03:16:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:08.434 03:16:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:08.434 03:16:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:08.434 03:16:42 -- paths/export.sh@5 -- # export PATH 00:16:08.434 03:16:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:08.434 03:16:42 -- nvmf/common.sh@47 -- # : 0 00:16:08.434 03:16:42 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:16:08.434 03:16:42 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:16:08.434 03:16:42 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:16:08.434 03:16:42 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:08.434 03:16:42 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:08.434 03:16:42 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:16:08.434 03:16:42 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:16:08.434 03:16:42 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:16:08.434 03:16:42 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:08.434 03:16:42 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:08.434 03:16:42 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:16:08.434 03:16:42 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:16:08.434 03:16:42 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:08.434 03:16:42 -- nvmf/common.sh@437 -- # prepare_net_devs 00:16:08.434 03:16:42 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:16:08.434 03:16:42 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:16:08.434 03:16:42 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:08.434 03:16:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:08.434 03:16:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:08.435 03:16:42 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:16:08.435 03:16:42 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:16:08.435 03:16:42 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:08.435 03:16:42 -- common/autotest_common.sh@10 -- # set +x 00:16:13.702 03:16:47 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:13.702 03:16:47 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:13.702 03:16:47 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:13.702 03:16:47 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:13.702 03:16:47 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:13.703 03:16:47 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:13.703 03:16:47 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:13.703 03:16:47 -- nvmf/common.sh@295 -- # net_devs=() 00:16:13.703 03:16:47 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:13.703 03:16:47 -- nvmf/common.sh@296 -- # e810=() 00:16:13.703 03:16:47 -- nvmf/common.sh@296 -- # local -ga e810 00:16:13.703 03:16:47 -- nvmf/common.sh@297 -- # x722=() 00:16:13.703 03:16:47 -- nvmf/common.sh@297 -- # local -ga x722 00:16:13.703 03:16:47 -- nvmf/common.sh@298 -- # mlx=() 00:16:13.703 03:16:47 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:13.703 03:16:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:13.703 03:16:47 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:13.703 03:16:47 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:13.703 03:16:47 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:13.703 03:16:47 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:13.703 03:16:47 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:13.703 03:16:47 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:13.703 03:16:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:13.703 03:16:47 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:13.703 03:16:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:13.703 03:16:47 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:13.703 03:16:47 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:13.703 03:16:47 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:16:13.703 03:16:47 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:16:13.703 03:16:47 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:16:13.703 03:16:47 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:16:13.703 03:16:47 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:16:13.703 03:16:47 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:16:13.703 03:16:47 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:13.703 03:16:47 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:13.703 03:16:47 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:16:13.703 Found 0000:af:00.0 (0x8086 - 0x159b) 00:16:13.703 03:16:47 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:13.703 03:16:47 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:13.703 03:16:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:13.703 03:16:47 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:13.703 03:16:47 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:13.703 03:16:47 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:13.703 03:16:47 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:13.703 03:16:47 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:16:13.703 Found 0000:af:00.1 (0x8086 - 0x159b) 00:16:13.703 03:16:47 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:13.703 03:16:47 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:13.703 03:16:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:13.703 03:16:47 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:13.703 03:16:47 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:13.703 03:16:47 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:13.703 03:16:47 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:13.703 03:16:47 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:16:13.703 03:16:47 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:16:13.703 03:16:47 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:16:13.703 03:16:47 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:16:13.703 03:16:47 -- nvmf/common.sh@377 -- # modinfo irdma 00:16:13.703 03:16:47 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:16:13.703 03:16:47 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:13.703 03:16:47 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:13.703 03:16:47 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:13.703 03:16:47 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:13.703 03:16:47 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:16:13.703 Found net devices under 0000:af:00.0: cvl_0_0 00:16:13.703 03:16:47 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:13.703 03:16:47 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:13.703 03:16:47 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:13.703 03:16:47 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:13.703 03:16:48 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:13.703 03:16:48 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:16:13.703 Found net devices under 0000:af:00.1: cvl_0_1 00:16:13.703 03:16:48 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:13.703 03:16:48 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:13.703 03:16:48 -- nvmf/common.sh@403 -- # is_hw=yes 00:16:13.703 03:16:48 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:16:13.703 03:16:48 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:16:13.703 03:16:48 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:16:13.703 03:16:48 -- nvmf/common.sh@409 -- # rdma_device_init 00:16:13.703 03:16:48 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:16:13.703 03:16:48 -- nvmf/common.sh@58 -- # uname 00:16:13.703 03:16:48 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:16:13.703 03:16:48 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:16:13.703 03:16:48 -- nvmf/common.sh@63 -- # modprobe ib_core 00:16:13.703 03:16:48 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:16:13.703 03:16:48 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:16:13.703 03:16:48 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:16:13.703 03:16:48 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:16:13.703 03:16:48 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:16:13.703 03:16:48 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:16:13.703 03:16:48 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:16:13.703 03:16:48 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:16:13.703 03:16:48 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:13.703 03:16:48 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:13.703 03:16:48 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:13.703 03:16:48 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:13.703 03:16:48 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:13.703 03:16:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:13.703 03:16:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:13.703 03:16:48 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:16:13.703 03:16:48 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:16:13.703 03:16:48 -- nvmf/common.sh@105 -- # continue 2 00:16:13.703 03:16:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:13.703 03:16:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:13.703 03:16:48 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:16:13.703 03:16:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:13.703 03:16:48 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:16:13.703 03:16:48 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:16:13.703 03:16:48 -- nvmf/common.sh@105 -- # continue 2 00:16:13.703 03:16:48 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:13.703 03:16:48 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:16:13.703 03:16:48 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:16:13.703 03:16:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:13.703 03:16:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:16:13.703 03:16:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:13.703 03:16:48 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:16:13.703 03:16:48 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:16:13.703 03:16:48 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:16:13.703 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:16:13.703 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:16:13.703 altname enp175s0f0np0 00:16:13.703 altname ens801f0np0 00:16:13.703 inet 192.168.100.8/24 scope global cvl_0_0 00:16:13.703 valid_lft forever preferred_lft forever 00:16:13.703 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:16:13.703 valid_lft forever preferred_lft forever 00:16:13.703 03:16:48 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:13.703 03:16:48 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:16:13.703 03:16:48 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:16:13.703 03:16:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:16:13.703 03:16:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:13.703 03:16:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:13.703 03:16:48 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:16:13.703 03:16:48 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:16:13.703 03:16:48 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:16:13.703 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:16:13.703 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:16:13.703 altname enp175s0f1np1 00:16:13.703 altname ens801f1np1 00:16:13.703 inet 192.168.100.9/24 scope global cvl_0_1 00:16:13.703 valid_lft forever preferred_lft forever 00:16:13.703 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:16:13.703 valid_lft forever preferred_lft forever 00:16:13.703 03:16:48 -- nvmf/common.sh@411 -- # return 0 00:16:13.703 03:16:48 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:16:13.703 03:16:48 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:16:13.703 03:16:48 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:16:13.703 03:16:48 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:16:13.703 03:16:48 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:16:13.703 03:16:48 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:13.703 03:16:48 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:13.703 03:16:48 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:13.703 03:16:48 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:13.703 03:16:48 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:13.703 03:16:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:13.703 03:16:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:13.703 03:16:48 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:16:13.703 03:16:48 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:16:13.703 03:16:48 -- nvmf/common.sh@105 -- # continue 2 00:16:13.703 03:16:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:13.703 03:16:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:13.703 03:16:48 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:16:13.703 03:16:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:13.703 03:16:48 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:16:13.704 03:16:48 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:16:13.704 03:16:48 -- nvmf/common.sh@105 -- # continue 2 00:16:13.704 03:16:48 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:13.704 03:16:48 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:16:13.704 03:16:48 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:16:13.704 03:16:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:13.704 03:16:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:16:13.704 03:16:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:13.704 03:16:48 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:13.704 03:16:48 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:16:13.704 03:16:48 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:16:13.704 03:16:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:16:13.704 03:16:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:13.704 03:16:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:13.704 03:16:48 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:16:13.704 192.168.100.9' 00:16:13.704 03:16:48 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:16:13.704 192.168.100.9' 00:16:13.704 03:16:48 -- nvmf/common.sh@446 -- # head -n 1 00:16:13.704 03:16:48 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:16:13.704 03:16:48 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:16:13.704 192.168.100.9' 00:16:13.704 03:16:48 -- nvmf/common.sh@447 -- # tail -n +2 00:16:13.704 03:16:48 -- nvmf/common.sh@447 -- # head -n 1 00:16:13.704 03:16:48 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:16:13.704 03:16:48 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:16:13.704 03:16:48 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:16:13.704 03:16:48 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:16:13.704 03:16:48 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:16:13.704 03:16:48 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:16:13.704 03:16:48 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:16:13.704 03:16:48 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:13.704 03:16:48 -- common/autotest_common.sh@710 -- # xtrace_disable 00:16:13.704 03:16:48 -- common/autotest_common.sh@10 -- # set +x 00:16:13.704 03:16:48 -- nvmf/common.sh@470 -- # nvmfpid=4070658 00:16:13.704 03:16:48 -- nvmf/common.sh@471 -- # waitforlisten 4070658 00:16:13.704 03:16:48 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:16:13.704 03:16:48 -- common/autotest_common.sh@817 -- # '[' -z 4070658 ']' 00:16:13.704 03:16:48 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:13.704 03:16:48 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:13.704 03:16:48 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:13.704 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:13.704 03:16:48 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:13.704 03:16:48 -- common/autotest_common.sh@10 -- # set +x 00:16:13.963 [2024-04-25 03:16:48.221450] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:16:13.963 [2024-04-25 03:16:48.221490] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:13.963 EAL: No free 2048 kB hugepages reported on node 1 00:16:13.963 [2024-04-25 03:16:48.282353] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:13.963 [2024-04-25 03:16:48.351935] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:13.963 [2024-04-25 03:16:48.351976] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:13.963 [2024-04-25 03:16:48.351983] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:13.963 [2024-04-25 03:16:48.351988] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:13.963 [2024-04-25 03:16:48.351993] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:13.963 [2024-04-25 03:16:48.352087] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:13.963 [2024-04-25 03:16:48.352205] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:13.963 [2024-04-25 03:16:48.352274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:13.963 [2024-04-25 03:16:48.352275] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:14.531 03:16:49 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:14.531 03:16:49 -- common/autotest_common.sh@850 -- # return 0 00:16:14.531 03:16:49 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:14.531 03:16:49 -- common/autotest_common.sh@716 -- # xtrace_disable 00:16:14.531 03:16:49 -- common/autotest_common.sh@10 -- # set +x 00:16:14.791 03:16:49 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:14.791 03:16:49 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:16:14.791 03:16:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:14.791 03:16:49 -- common/autotest_common.sh@10 -- # set +x 00:16:14.791 03:16:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:14.791 03:16:49 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:16:14.791 03:16:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:14.791 03:16:49 -- common/autotest_common.sh@10 -- # set +x 00:16:14.791 03:16:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:14.791 03:16:49 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:16:14.791 03:16:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:14.791 03:16:49 -- common/autotest_common.sh@10 -- # set +x 00:16:14.791 [2024-04-25 03:16:49.135638] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x1f05ef0/0x1f05530) succeed. 00:16:14.791 [2024-04-25 03:16:49.145396] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x1f072a0/0x1f05ab0) succeed. 00:16:14.791 [2024-04-25 03:16:49.145418] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:16:14.791 03:16:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:14.791 03:16:49 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:14.791 03:16:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:14.791 03:16:49 -- common/autotest_common.sh@10 -- # set +x 00:16:14.791 Malloc0 00:16:14.791 03:16:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:14.791 03:16:49 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:14.791 03:16:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:14.791 03:16:49 -- common/autotest_common.sh@10 -- # set +x 00:16:14.791 03:16:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:14.791 03:16:49 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:14.791 03:16:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:14.791 03:16:49 -- common/autotest_common.sh@10 -- # set +x 00:16:14.791 03:16:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:14.791 03:16:49 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:16:14.791 03:16:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:14.791 03:16:49 -- common/autotest_common.sh@10 -- # set +x 00:16:14.791 [2024-04-25 03:16:49.207354] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:14.791 03:16:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:14.791 03:16:49 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=4070903 00:16:14.791 03:16:49 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:16:14.791 03:16:49 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:16:14.791 03:16:49 -- target/bdev_io_wait.sh@30 -- # READ_PID=4070905 00:16:14.791 03:16:49 -- nvmf/common.sh@521 -- # config=() 00:16:14.791 03:16:49 -- nvmf/common.sh@521 -- # local subsystem config 00:16:14.791 03:16:49 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:16:14.791 03:16:49 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:16:14.791 { 00:16:14.791 "params": { 00:16:14.791 "name": "Nvme$subsystem", 00:16:14.791 "trtype": "$TEST_TRANSPORT", 00:16:14.791 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:14.791 "adrfam": "ipv4", 00:16:14.791 "trsvcid": "$NVMF_PORT", 00:16:14.791 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:14.791 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:14.791 "hdgst": ${hdgst:-false}, 00:16:14.791 "ddgst": ${ddgst:-false} 00:16:14.791 }, 00:16:14.791 "method": "bdev_nvme_attach_controller" 00:16:14.791 } 00:16:14.791 EOF 00:16:14.791 )") 00:16:14.791 03:16:49 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:16:14.791 03:16:49 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:16:14.791 03:16:49 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=4070907 00:16:14.791 03:16:49 -- nvmf/common.sh@521 -- # config=() 00:16:14.791 03:16:49 -- nvmf/common.sh@521 -- # local subsystem config 00:16:14.791 03:16:49 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:16:14.791 03:16:49 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:16:14.791 { 00:16:14.791 "params": { 00:16:14.791 "name": "Nvme$subsystem", 00:16:14.791 "trtype": "$TEST_TRANSPORT", 00:16:14.791 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:14.791 "adrfam": "ipv4", 00:16:14.791 "trsvcid": "$NVMF_PORT", 00:16:14.791 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:14.791 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:14.791 "hdgst": ${hdgst:-false}, 00:16:14.791 "ddgst": ${ddgst:-false} 00:16:14.791 }, 00:16:14.791 "method": "bdev_nvme_attach_controller" 00:16:14.791 } 00:16:14.791 EOF 00:16:14.791 )") 00:16:14.791 03:16:49 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:16:14.791 03:16:49 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=4070910 00:16:14.791 03:16:49 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:16:14.791 03:16:49 -- target/bdev_io_wait.sh@35 -- # sync 00:16:14.791 03:16:49 -- nvmf/common.sh@521 -- # config=() 00:16:14.791 03:16:49 -- nvmf/common.sh@543 -- # cat 00:16:14.791 03:16:49 -- nvmf/common.sh@521 -- # local subsystem config 00:16:14.791 03:16:49 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:16:14.791 03:16:49 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:16:14.791 { 00:16:14.791 "params": { 00:16:14.791 "name": "Nvme$subsystem", 00:16:14.791 "trtype": "$TEST_TRANSPORT", 00:16:14.791 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:14.791 "adrfam": "ipv4", 00:16:14.791 "trsvcid": "$NVMF_PORT", 00:16:14.791 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:14.791 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:14.791 "hdgst": ${hdgst:-false}, 00:16:14.791 "ddgst": ${ddgst:-false} 00:16:14.791 }, 00:16:14.791 "method": "bdev_nvme_attach_controller" 00:16:14.791 } 00:16:14.791 EOF 00:16:14.791 )") 00:16:14.791 03:16:49 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:16:14.791 03:16:49 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:16:14.791 03:16:49 -- nvmf/common.sh@521 -- # config=() 00:16:14.791 03:16:49 -- nvmf/common.sh@543 -- # cat 00:16:14.791 03:16:49 -- nvmf/common.sh@521 -- # local subsystem config 00:16:14.791 03:16:49 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:16:14.791 03:16:49 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:16:14.791 { 00:16:14.791 "params": { 00:16:14.791 "name": "Nvme$subsystem", 00:16:14.791 "trtype": "$TEST_TRANSPORT", 00:16:14.791 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:14.791 "adrfam": "ipv4", 00:16:14.791 "trsvcid": "$NVMF_PORT", 00:16:14.791 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:14.791 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:14.791 "hdgst": ${hdgst:-false}, 00:16:14.791 "ddgst": ${ddgst:-false} 00:16:14.791 }, 00:16:14.791 "method": "bdev_nvme_attach_controller" 00:16:14.791 } 00:16:14.791 EOF 00:16:14.791 )") 00:16:14.791 03:16:49 -- nvmf/common.sh@543 -- # cat 00:16:14.791 03:16:49 -- target/bdev_io_wait.sh@37 -- # wait 4070903 00:16:14.791 03:16:49 -- nvmf/common.sh@543 -- # cat 00:16:14.791 03:16:49 -- nvmf/common.sh@545 -- # jq . 00:16:14.791 03:16:49 -- nvmf/common.sh@545 -- # jq . 00:16:14.791 03:16:49 -- nvmf/common.sh@545 -- # jq . 00:16:14.791 03:16:49 -- nvmf/common.sh@546 -- # IFS=, 00:16:14.791 03:16:49 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:16:14.791 "params": { 00:16:14.791 "name": "Nvme1", 00:16:14.791 "trtype": "rdma", 00:16:14.791 "traddr": "192.168.100.8", 00:16:14.791 "adrfam": "ipv4", 00:16:14.791 "trsvcid": "4420", 00:16:14.791 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:14.791 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:14.791 "hdgst": false, 00:16:14.791 "ddgst": false 00:16:14.791 }, 00:16:14.791 "method": "bdev_nvme_attach_controller" 00:16:14.791 }' 00:16:14.791 03:16:49 -- nvmf/common.sh@546 -- # IFS=, 00:16:14.791 03:16:49 -- nvmf/common.sh@545 -- # jq . 00:16:14.791 03:16:49 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:16:14.791 "params": { 00:16:14.791 "name": "Nvme1", 00:16:14.791 "trtype": "rdma", 00:16:14.791 "traddr": "192.168.100.8", 00:16:14.791 "adrfam": "ipv4", 00:16:14.791 "trsvcid": "4420", 00:16:14.791 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:14.791 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:14.791 "hdgst": false, 00:16:14.791 "ddgst": false 00:16:14.791 }, 00:16:14.791 "method": "bdev_nvme_attach_controller" 00:16:14.791 }' 00:16:14.791 03:16:49 -- nvmf/common.sh@546 -- # IFS=, 00:16:14.791 03:16:49 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:16:14.791 "params": { 00:16:14.791 "name": "Nvme1", 00:16:14.791 "trtype": "rdma", 00:16:14.791 "traddr": "192.168.100.8", 00:16:14.791 "adrfam": "ipv4", 00:16:14.791 "trsvcid": "4420", 00:16:14.791 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:14.791 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:14.791 "hdgst": false, 00:16:14.791 "ddgst": false 00:16:14.791 }, 00:16:14.791 "method": "bdev_nvme_attach_controller" 00:16:14.791 }' 00:16:14.791 03:16:49 -- nvmf/common.sh@546 -- # IFS=, 00:16:14.791 03:16:49 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:16:14.791 "params": { 00:16:14.791 "name": "Nvme1", 00:16:14.791 "trtype": "rdma", 00:16:14.791 "traddr": "192.168.100.8", 00:16:14.792 "adrfam": "ipv4", 00:16:14.792 "trsvcid": "4420", 00:16:14.792 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:14.792 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:14.792 "hdgst": false, 00:16:14.792 "ddgst": false 00:16:14.792 }, 00:16:14.792 "method": "bdev_nvme_attach_controller" 00:16:14.792 }' 00:16:14.792 [2024-04-25 03:16:49.254252] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:16:14.792 [2024-04-25 03:16:49.254292] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:16:14.792 [2024-04-25 03:16:49.256632] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:16:14.792 [2024-04-25 03:16:49.256682] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:16:14.792 [2024-04-25 03:16:49.256784] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:16:14.792 [2024-04-25 03:16:49.256824] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:16:14.792 [2024-04-25 03:16:49.260803] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:16:14.792 [2024-04-25 03:16:49.260841] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:16:15.051 EAL: No free 2048 kB hugepages reported on node 1 00:16:15.051 EAL: No free 2048 kB hugepages reported on node 1 00:16:15.051 [2024-04-25 03:16:49.400742] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:15.051 EAL: No free 2048 kB hugepages reported on node 1 00:16:15.051 [2024-04-25 03:16:49.470054] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:16:15.051 [2024-04-25 03:16:49.505340] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:15.310 EAL: No free 2048 kB hugepages reported on node 1 00:16:15.310 [2024-04-25 03:16:49.582881] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:15.310 [2024-04-25 03:16:49.601550] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:15.310 [2024-04-25 03:16:49.657488] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:15.310 [2024-04-25 03:16:49.688940] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:16:15.310 [2024-04-25 03:16:49.730140] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:16:15.310 Running I/O for 1 seconds... 00:16:15.310 Running I/O for 1 seconds... 00:16:15.569 Running I/O for 1 seconds... 00:16:15.569 Running I/O for 1 seconds... 00:16:16.506 00:16:16.506 Latency(us) 00:16:16.506 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:16.506 Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:16:16.506 Nvme1n1 : 1.01 17331.64 67.70 0.00 0.00 7363.36 5086.84 22968.81 00:16:16.506 =================================================================================================================== 00:16:16.506 Total : 17331.64 67.70 0.00 0.00 7363.36 5086.84 22968.81 00:16:16.506 00:16:16.506 Latency(us) 00:16:16.506 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:16.506 Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:16:16.506 Nvme1n1 : 1.01 15286.38 59.71 0.00 0.00 8346.26 5461.33 21096.35 00:16:16.506 =================================================================================================================== 00:16:16.506 Total : 15286.38 59.71 0.00 0.00 8346.26 5461.33 21096.35 00:16:16.506 00:16:16.506 Latency(us) 00:16:16.506 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:16.506 Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:16:16.506 Nvme1n1 : 1.00 260022.47 1015.71 0.00 0.00 490.21 199.92 1880.26 00:16:16.506 =================================================================================================================== 00:16:16.506 Total : 260022.47 1015.71 0.00 0.00 490.21 199.92 1880.26 00:16:16.506 00:16:16.506 Latency(us) 00:16:16.506 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:16.506 Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:16:16.506 Nvme1n1 : 1.00 18653.08 72.86 0.00 0.00 6846.89 3510.86 18225.25 00:16:16.506 =================================================================================================================== 00:16:16.506 Total : 18653.08 72.86 0.00 0.00 6846.89 3510.86 18225.25 00:16:16.765 03:16:51 -- target/bdev_io_wait.sh@38 -- # wait 4070905 00:16:16.765 03:16:51 -- target/bdev_io_wait.sh@39 -- # wait 4070907 00:16:16.765 03:16:51 -- target/bdev_io_wait.sh@40 -- # wait 4070910 00:16:16.765 03:16:51 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:16.765 03:16:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:16.765 03:16:51 -- common/autotest_common.sh@10 -- # set +x 00:16:16.765 03:16:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:16.765 03:16:51 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:16:16.765 03:16:51 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:16:16.765 03:16:51 -- nvmf/common.sh@477 -- # nvmfcleanup 00:16:16.765 03:16:51 -- nvmf/common.sh@117 -- # sync 00:16:16.765 03:16:51 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:16:16.765 03:16:51 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:16:16.765 03:16:51 -- nvmf/common.sh@120 -- # set +e 00:16:16.765 03:16:51 -- nvmf/common.sh@121 -- # for i in {1..20} 00:16:16.765 03:16:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:16:16.765 rmmod nvme_rdma 00:16:16.765 rmmod nvme_fabrics 00:16:16.765 03:16:51 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:16:16.765 03:16:51 -- nvmf/common.sh@124 -- # set -e 00:16:16.765 03:16:51 -- nvmf/common.sh@125 -- # return 0 00:16:16.765 03:16:51 -- nvmf/common.sh@478 -- # '[' -n 4070658 ']' 00:16:16.765 03:16:51 -- nvmf/common.sh@479 -- # killprocess 4070658 00:16:16.765 03:16:51 -- common/autotest_common.sh@936 -- # '[' -z 4070658 ']' 00:16:16.765 03:16:51 -- common/autotest_common.sh@940 -- # kill -0 4070658 00:16:16.765 03:16:51 -- common/autotest_common.sh@941 -- # uname 00:16:16.765 03:16:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:16.765 03:16:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4070658 00:16:16.765 03:16:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:17.024 03:16:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:17.024 03:16:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4070658' 00:16:17.024 killing process with pid 4070658 00:16:17.024 03:16:51 -- common/autotest_common.sh@955 -- # kill 4070658 00:16:17.024 03:16:51 -- common/autotest_common.sh@960 -- # wait 4070658 00:16:17.024 [2024-04-25 03:16:51.296089] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:16:17.024 03:16:51 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:16:17.024 03:16:51 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:16:17.024 00:16:17.024 real 0m8.871s 00:16:17.024 user 0m19.812s 00:16:17.024 sys 0m5.431s 00:16:17.024 03:16:51 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:16:17.024 03:16:51 -- common/autotest_common.sh@10 -- # set +x 00:16:17.024 ************************************ 00:16:17.024 END TEST nvmf_bdev_io_wait 00:16:17.024 ************************************ 00:16:17.284 03:16:51 -- nvmf/nvmf.sh@51 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=rdma 00:16:17.284 03:16:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:17.284 03:16:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:17.284 03:16:51 -- common/autotest_common.sh@10 -- # set +x 00:16:17.284 ************************************ 00:16:17.284 START TEST nvmf_queue_depth 00:16:17.284 ************************************ 00:16:17.284 03:16:51 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=rdma 00:16:17.284 * Looking for test storage... 00:16:17.284 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:16:17.284 03:16:51 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:16:17.284 03:16:51 -- nvmf/common.sh@7 -- # uname -s 00:16:17.284 03:16:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:17.284 03:16:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:17.284 03:16:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:17.284 03:16:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:17.284 03:16:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:17.284 03:16:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:17.284 03:16:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:17.284 03:16:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:17.284 03:16:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:17.284 03:16:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:17.284 03:16:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:16:17.284 03:16:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:16:17.284 03:16:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:17.284 03:16:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:17.284 03:16:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:17.284 03:16:51 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:16:17.284 03:16:51 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:16:17.284 03:16:51 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:17.284 03:16:51 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:17.284 03:16:51 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:17.284 03:16:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:17.284 03:16:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:17.284 03:16:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:17.284 03:16:51 -- paths/export.sh@5 -- # export PATH 00:16:17.284 03:16:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:17.284 03:16:51 -- nvmf/common.sh@47 -- # : 0 00:16:17.284 03:16:51 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:16:17.284 03:16:51 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:16:17.284 03:16:51 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:16:17.284 03:16:51 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:17.284 03:16:51 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:17.284 03:16:51 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:16:17.284 03:16:51 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:16:17.284 03:16:51 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:16:17.284 03:16:51 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:16:17.284 03:16:51 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:16:17.284 03:16:51 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:17.284 03:16:51 -- target/queue_depth.sh@19 -- # nvmftestinit 00:16:17.284 03:16:51 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:16:17.284 03:16:51 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:17.284 03:16:51 -- nvmf/common.sh@437 -- # prepare_net_devs 00:16:17.284 03:16:51 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:16:17.284 03:16:51 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:16:17.284 03:16:51 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:17.284 03:16:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:17.284 03:16:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:17.284 03:16:51 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:16:17.284 03:16:51 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:16:17.284 03:16:51 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:17.284 03:16:51 -- common/autotest_common.sh@10 -- # set +x 00:16:22.602 03:16:56 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:22.602 03:16:56 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:22.602 03:16:56 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:22.602 03:16:56 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:22.602 03:16:56 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:22.602 03:16:56 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:22.602 03:16:56 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:22.602 03:16:56 -- nvmf/common.sh@295 -- # net_devs=() 00:16:22.602 03:16:56 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:22.602 03:16:56 -- nvmf/common.sh@296 -- # e810=() 00:16:22.602 03:16:56 -- nvmf/common.sh@296 -- # local -ga e810 00:16:22.602 03:16:56 -- nvmf/common.sh@297 -- # x722=() 00:16:22.602 03:16:56 -- nvmf/common.sh@297 -- # local -ga x722 00:16:22.602 03:16:56 -- nvmf/common.sh@298 -- # mlx=() 00:16:22.602 03:16:56 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:22.602 03:16:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:22.602 03:16:56 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:22.602 03:16:56 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:22.602 03:16:56 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:22.602 03:16:56 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:22.602 03:16:56 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:22.602 03:16:56 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:22.602 03:16:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:22.602 03:16:56 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:22.602 03:16:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:22.602 03:16:56 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:22.602 03:16:56 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:22.602 03:16:56 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:16:22.602 03:16:56 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:16:22.602 03:16:56 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:16:22.602 03:16:56 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:16:22.602 03:16:56 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:16:22.602 03:16:56 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:16:22.602 03:16:56 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:22.602 03:16:56 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:22.602 03:16:56 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:16:22.602 Found 0000:af:00.0 (0x8086 - 0x159b) 00:16:22.602 03:16:56 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:22.602 03:16:56 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:22.602 03:16:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:22.603 03:16:56 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:22.603 03:16:56 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:22.603 03:16:56 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:22.603 03:16:56 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:22.603 03:16:56 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:16:22.603 Found 0000:af:00.1 (0x8086 - 0x159b) 00:16:22.603 03:16:56 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:22.603 03:16:56 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:22.603 03:16:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:22.603 03:16:56 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:22.603 03:16:56 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:22.603 03:16:56 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:22.603 03:16:56 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:22.603 03:16:56 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:16:22.603 03:16:56 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:16:22.603 03:16:56 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:16:22.603 03:16:56 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:16:22.603 03:16:56 -- nvmf/common.sh@377 -- # modinfo irdma 00:16:22.603 03:16:56 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:16:22.603 03:16:56 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:22.603 03:16:56 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:22.603 03:16:56 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:22.603 03:16:56 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:22.603 03:16:56 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:16:22.603 Found net devices under 0000:af:00.0: cvl_0_0 00:16:22.603 03:16:56 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:22.603 03:16:56 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:22.603 03:16:56 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:22.603 03:16:56 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:22.603 03:16:56 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:22.603 03:16:56 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:16:22.603 Found net devices under 0000:af:00.1: cvl_0_1 00:16:22.603 03:16:56 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:22.603 03:16:56 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:22.603 03:16:56 -- nvmf/common.sh@403 -- # is_hw=yes 00:16:22.603 03:16:56 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:16:22.603 03:16:56 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:16:22.603 03:16:56 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:16:22.603 03:16:56 -- nvmf/common.sh@409 -- # rdma_device_init 00:16:22.603 03:16:56 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:16:22.603 03:16:56 -- nvmf/common.sh@58 -- # uname 00:16:22.603 03:16:56 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:16:22.603 03:16:56 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:16:22.603 03:16:56 -- nvmf/common.sh@63 -- # modprobe ib_core 00:16:22.603 03:16:56 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:16:22.603 03:16:56 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:16:22.603 03:16:56 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:16:22.603 03:16:56 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:16:22.603 03:16:56 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:16:22.603 03:16:56 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:16:22.603 03:16:56 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:16:22.603 03:16:56 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:16:22.603 03:16:56 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:22.603 03:16:56 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:22.603 03:16:56 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:22.603 03:16:56 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:22.603 03:16:56 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:22.603 03:16:56 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:22.603 03:16:56 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:22.603 03:16:56 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:16:22.603 03:16:56 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:16:22.603 03:16:56 -- nvmf/common.sh@105 -- # continue 2 00:16:22.603 03:16:56 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:22.603 03:16:56 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:22.603 03:16:56 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:16:22.603 03:16:56 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:22.603 03:16:56 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:16:22.603 03:16:56 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:16:22.603 03:16:56 -- nvmf/common.sh@105 -- # continue 2 00:16:22.603 03:16:56 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:22.603 03:16:56 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:16:22.603 03:16:56 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:16:22.603 03:16:56 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:16:22.603 03:16:56 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:22.603 03:16:56 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:22.603 03:16:56 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:16:22.603 03:16:56 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:16:22.603 03:16:56 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:16:22.603 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:16:22.603 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:16:22.603 altname enp175s0f0np0 00:16:22.603 altname ens801f0np0 00:16:22.603 inet 192.168.100.8/24 scope global cvl_0_0 00:16:22.603 valid_lft forever preferred_lft forever 00:16:22.603 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:16:22.603 valid_lft forever preferred_lft forever 00:16:22.603 03:16:56 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:22.603 03:16:56 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:16:22.603 03:16:56 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:16:22.603 03:16:56 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:16:22.603 03:16:56 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:22.603 03:16:56 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:22.603 03:16:56 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:16:22.603 03:16:56 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:16:22.603 03:16:56 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:16:22.603 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:16:22.603 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:16:22.603 altname enp175s0f1np1 00:16:22.603 altname ens801f1np1 00:16:22.603 inet 192.168.100.9/24 scope global cvl_0_1 00:16:22.603 valid_lft forever preferred_lft forever 00:16:22.603 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:16:22.603 valid_lft forever preferred_lft forever 00:16:22.603 03:16:56 -- nvmf/common.sh@411 -- # return 0 00:16:22.603 03:16:56 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:16:22.603 03:16:56 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:16:22.603 03:16:56 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:16:22.603 03:16:56 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:16:22.603 03:16:56 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:16:22.603 03:16:56 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:22.603 03:16:56 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:22.603 03:16:56 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:22.603 03:16:56 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:22.603 03:16:56 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:22.603 03:16:56 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:22.603 03:16:56 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:22.603 03:16:56 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:16:22.603 03:16:56 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:16:22.603 03:16:56 -- nvmf/common.sh@105 -- # continue 2 00:16:22.603 03:16:56 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:22.603 03:16:56 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:22.603 03:16:56 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:16:22.603 03:16:56 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:22.603 03:16:56 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:16:22.603 03:16:56 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:16:22.603 03:16:56 -- nvmf/common.sh@105 -- # continue 2 00:16:22.603 03:16:56 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:22.603 03:16:56 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:16:22.603 03:16:56 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:16:22.603 03:16:56 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:16:22.603 03:16:56 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:22.603 03:16:56 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:22.603 03:16:56 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:22.603 03:16:56 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:16:22.603 03:16:56 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:16:22.603 03:16:56 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:16:22.603 03:16:56 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:22.603 03:16:56 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:22.603 03:16:56 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:16:22.603 192.168.100.9' 00:16:22.603 03:16:56 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:16:22.603 192.168.100.9' 00:16:22.603 03:16:56 -- nvmf/common.sh@446 -- # head -n 1 00:16:22.603 03:16:56 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:16:22.603 03:16:56 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:16:22.603 192.168.100.9' 00:16:22.603 03:16:56 -- nvmf/common.sh@447 -- # tail -n +2 00:16:22.603 03:16:56 -- nvmf/common.sh@447 -- # head -n 1 00:16:22.603 03:16:56 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:16:22.603 03:16:56 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:16:22.603 03:16:56 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:16:22.603 03:16:56 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:16:22.603 03:16:56 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:16:22.603 03:16:56 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:16:22.603 03:16:56 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:16:22.603 03:16:57 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:22.603 03:16:57 -- common/autotest_common.sh@710 -- # xtrace_disable 00:16:22.603 03:16:57 -- common/autotest_common.sh@10 -- # set +x 00:16:22.603 03:16:57 -- nvmf/common.sh@470 -- # nvmfpid=4074539 00:16:22.603 03:16:57 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:16:22.603 03:16:57 -- nvmf/common.sh@471 -- # waitforlisten 4074539 00:16:22.604 03:16:57 -- common/autotest_common.sh@817 -- # '[' -z 4074539 ']' 00:16:22.604 03:16:57 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:22.604 03:16:57 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:22.604 03:16:57 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:22.604 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:22.604 03:16:57 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:22.604 03:16:57 -- common/autotest_common.sh@10 -- # set +x 00:16:22.604 [2024-04-25 03:16:57.049536] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:16:22.604 [2024-04-25 03:16:57.049577] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:22.604 EAL: No free 2048 kB hugepages reported on node 1 00:16:22.863 [2024-04-25 03:16:57.110752] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:22.863 [2024-04-25 03:16:57.178355] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:22.863 [2024-04-25 03:16:57.178396] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:22.863 [2024-04-25 03:16:57.178403] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:22.863 [2024-04-25 03:16:57.178408] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:22.863 [2024-04-25 03:16:57.178413] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:22.863 [2024-04-25 03:16:57.178429] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:23.429 03:16:57 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:23.429 03:16:57 -- common/autotest_common.sh@850 -- # return 0 00:16:23.429 03:16:57 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:23.429 03:16:57 -- common/autotest_common.sh@716 -- # xtrace_disable 00:16:23.429 03:16:57 -- common/autotest_common.sh@10 -- # set +x 00:16:23.429 03:16:57 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:23.429 03:16:57 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:16:23.429 03:16:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:23.429 03:16:57 -- common/autotest_common.sh@10 -- # set +x 00:16:23.429 [2024-04-25 03:16:57.895838] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x78ffe0/0x78f620) succeed. 00:16:23.429 [2024-04-25 03:16:57.904360] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x791250/0x78fba0) succeed. 00:16:23.429 [2024-04-25 03:16:57.904386] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:16:23.429 03:16:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:23.429 03:16:57 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:23.429 03:16:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:23.429 03:16:57 -- common/autotest_common.sh@10 -- # set +x 00:16:23.688 Malloc0 00:16:23.688 03:16:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:23.688 03:16:57 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:23.688 03:16:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:23.688 03:16:57 -- common/autotest_common.sh@10 -- # set +x 00:16:23.688 03:16:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:23.688 03:16:57 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:23.688 03:16:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:23.688 03:16:57 -- common/autotest_common.sh@10 -- # set +x 00:16:23.688 03:16:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:23.688 03:16:57 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:16:23.688 03:16:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:23.688 03:16:57 -- common/autotest_common.sh@10 -- # set +x 00:16:23.688 [2024-04-25 03:16:57.967966] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:23.688 03:16:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:23.688 03:16:57 -- target/queue_depth.sh@30 -- # bdevperf_pid=4074741 00:16:23.688 03:16:57 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:16:23.688 03:16:57 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:16:23.688 03:16:57 -- target/queue_depth.sh@33 -- # waitforlisten 4074741 /var/tmp/bdevperf.sock 00:16:23.688 03:16:57 -- common/autotest_common.sh@817 -- # '[' -z 4074741 ']' 00:16:23.688 03:16:57 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:23.688 03:16:57 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:23.688 03:16:57 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:23.688 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:23.688 03:16:57 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:23.688 03:16:57 -- common/autotest_common.sh@10 -- # set +x 00:16:23.688 [2024-04-25 03:16:58.015485] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:16:23.688 [2024-04-25 03:16:58.015523] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4074741 ] 00:16:23.688 EAL: No free 2048 kB hugepages reported on node 1 00:16:23.688 [2024-04-25 03:16:58.072108] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:23.688 [2024-04-25 03:16:58.140981] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:24.626 03:16:58 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:24.627 03:16:58 -- common/autotest_common.sh@850 -- # return 0 00:16:24.627 03:16:58 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:16:24.627 03:16:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:24.627 03:16:58 -- common/autotest_common.sh@10 -- # set +x 00:16:24.627 NVMe0n1 00:16:24.627 03:16:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:24.627 03:16:58 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:16:24.627 Running I/O for 10 seconds... 00:16:34.603 00:16:34.603 Latency(us) 00:16:34.603 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:34.603 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:16:34.603 Verification LBA range: start 0x0 length 0x4000 00:16:34.603 NVMe0n1 : 10.04 17752.25 69.34 0.00 0.00 57544.35 21470.84 38697.45 00:16:34.603 =================================================================================================================== 00:16:34.603 Total : 17752.25 69.34 0.00 0.00 57544.35 21470.84 38697.45 00:16:34.603 0 00:16:34.603 03:17:09 -- target/queue_depth.sh@39 -- # killprocess 4074741 00:16:34.603 03:17:09 -- common/autotest_common.sh@936 -- # '[' -z 4074741 ']' 00:16:34.603 03:17:09 -- common/autotest_common.sh@940 -- # kill -0 4074741 00:16:34.603 03:17:09 -- common/autotest_common.sh@941 -- # uname 00:16:34.603 03:17:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:34.603 03:17:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4074741 00:16:34.603 03:17:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:34.603 03:17:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:34.603 03:17:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4074741' 00:16:34.603 killing process with pid 4074741 00:16:34.603 03:17:09 -- common/autotest_common.sh@955 -- # kill 4074741 00:16:34.603 Received shutdown signal, test time was about 10.000000 seconds 00:16:34.603 00:16:34.603 Latency(us) 00:16:34.603 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:34.603 =================================================================================================================== 00:16:34.603 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:34.603 03:17:09 -- common/autotest_common.sh@960 -- # wait 4074741 00:16:34.862 03:17:09 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:16:34.862 03:17:09 -- target/queue_depth.sh@43 -- # nvmftestfini 00:16:34.863 03:17:09 -- nvmf/common.sh@477 -- # nvmfcleanup 00:16:34.863 03:17:09 -- nvmf/common.sh@117 -- # sync 00:16:34.863 03:17:09 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:16:34.863 03:17:09 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:16:34.863 03:17:09 -- nvmf/common.sh@120 -- # set +e 00:16:34.863 03:17:09 -- nvmf/common.sh@121 -- # for i in {1..20} 00:16:34.863 03:17:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:16:34.863 rmmod nvme_rdma 00:16:34.863 rmmod nvme_fabrics 00:16:34.863 03:17:09 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:16:34.863 03:17:09 -- nvmf/common.sh@124 -- # set -e 00:16:34.863 03:17:09 -- nvmf/common.sh@125 -- # return 0 00:16:34.863 03:17:09 -- nvmf/common.sh@478 -- # '[' -n 4074539 ']' 00:16:34.863 03:17:09 -- nvmf/common.sh@479 -- # killprocess 4074539 00:16:34.863 03:17:09 -- common/autotest_common.sh@936 -- # '[' -z 4074539 ']' 00:16:34.863 03:17:09 -- common/autotest_common.sh@940 -- # kill -0 4074539 00:16:34.863 03:17:09 -- common/autotest_common.sh@941 -- # uname 00:16:34.863 03:17:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:34.863 03:17:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4074539 00:16:35.122 03:17:09 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:35.122 03:17:09 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:35.122 03:17:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4074539' 00:16:35.122 killing process with pid 4074539 00:16:35.122 03:17:09 -- common/autotest_common.sh@955 -- # kill 4074539 00:16:35.122 03:17:09 -- common/autotest_common.sh@960 -- # wait 4074539 00:16:35.122 [2024-04-25 03:17:09.428188] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:16:35.381 03:17:09 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:16:35.381 03:17:09 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:16:35.381 00:16:35.381 real 0m18.008s 00:16:35.381 user 0m25.585s 00:16:35.381 sys 0m4.532s 00:16:35.381 03:17:09 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:16:35.381 03:17:09 -- common/autotest_common.sh@10 -- # set +x 00:16:35.381 ************************************ 00:16:35.381 END TEST nvmf_queue_depth 00:16:35.381 ************************************ 00:16:35.381 03:17:09 -- nvmf/nvmf.sh@52 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=rdma 00:16:35.381 03:17:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:35.381 03:17:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:35.381 03:17:09 -- common/autotest_common.sh@10 -- # set +x 00:16:35.381 ************************************ 00:16:35.381 START TEST nvmf_multipath 00:16:35.381 ************************************ 00:16:35.381 03:17:09 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=rdma 00:16:35.640 * Looking for test storage... 00:16:35.640 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:16:35.641 03:17:09 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:16:35.641 03:17:09 -- nvmf/common.sh@7 -- # uname -s 00:16:35.641 03:17:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:35.641 03:17:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:35.641 03:17:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:35.641 03:17:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:35.641 03:17:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:35.641 03:17:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:35.641 03:17:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:35.641 03:17:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:35.641 03:17:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:35.641 03:17:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:35.641 03:17:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:16:35.641 03:17:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:16:35.641 03:17:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:35.641 03:17:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:35.641 03:17:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:35.641 03:17:09 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:16:35.641 03:17:09 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:16:35.641 03:17:09 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:35.641 03:17:09 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:35.641 03:17:09 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:35.641 03:17:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:35.641 03:17:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:35.641 03:17:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:35.641 03:17:09 -- paths/export.sh@5 -- # export PATH 00:16:35.641 03:17:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:35.641 03:17:09 -- nvmf/common.sh@47 -- # : 0 00:16:35.641 03:17:09 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:16:35.641 03:17:09 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:16:35.641 03:17:09 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:16:35.641 03:17:09 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:35.641 03:17:09 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:35.641 03:17:09 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:16:35.641 03:17:09 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:16:35.641 03:17:09 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:16:35.641 03:17:09 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:35.641 03:17:09 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:35.641 03:17:09 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:16:35.641 03:17:09 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:16:35.641 03:17:09 -- target/multipath.sh@43 -- # nvmftestinit 00:16:35.641 03:17:09 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:16:35.641 03:17:09 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:35.641 03:17:09 -- nvmf/common.sh@437 -- # prepare_net_devs 00:16:35.641 03:17:09 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:16:35.641 03:17:09 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:16:35.641 03:17:09 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:35.641 03:17:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:35.641 03:17:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:35.641 03:17:09 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:16:35.641 03:17:09 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:16:35.641 03:17:09 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:35.641 03:17:09 -- common/autotest_common.sh@10 -- # set +x 00:16:40.913 03:17:15 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:40.913 03:17:15 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:40.913 03:17:15 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:40.913 03:17:15 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:40.913 03:17:15 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:40.913 03:17:15 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:40.913 03:17:15 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:40.913 03:17:15 -- nvmf/common.sh@295 -- # net_devs=() 00:16:40.913 03:17:15 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:40.913 03:17:15 -- nvmf/common.sh@296 -- # e810=() 00:16:40.913 03:17:15 -- nvmf/common.sh@296 -- # local -ga e810 00:16:40.913 03:17:15 -- nvmf/common.sh@297 -- # x722=() 00:16:40.913 03:17:15 -- nvmf/common.sh@297 -- # local -ga x722 00:16:40.913 03:17:15 -- nvmf/common.sh@298 -- # mlx=() 00:16:40.913 03:17:15 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:40.913 03:17:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:40.913 03:17:15 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:40.913 03:17:15 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:40.913 03:17:15 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:40.913 03:17:15 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:40.913 03:17:15 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:40.913 03:17:15 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:40.913 03:17:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:40.913 03:17:15 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:40.913 03:17:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:40.913 03:17:15 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:40.913 03:17:15 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:40.913 03:17:15 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:16:40.913 03:17:15 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:16:40.913 03:17:15 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:16:40.913 03:17:15 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:16:40.913 03:17:15 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:16:40.913 03:17:15 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:16:40.913 03:17:15 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:40.913 03:17:15 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:40.913 03:17:15 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:16:40.913 Found 0000:af:00.0 (0x8086 - 0x159b) 00:16:40.914 03:17:15 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:40.914 03:17:15 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:40.914 03:17:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:40.914 03:17:15 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:40.914 03:17:15 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:40.914 03:17:15 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:40.914 03:17:15 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:40.914 03:17:15 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:16:40.914 Found 0000:af:00.1 (0x8086 - 0x159b) 00:16:40.914 03:17:15 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:40.914 03:17:15 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:40.914 03:17:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:40.914 03:17:15 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:40.914 03:17:15 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:40.914 03:17:15 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:40.914 03:17:15 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:40.914 03:17:15 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:16:40.914 03:17:15 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:16:40.914 03:17:15 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:16:40.914 03:17:15 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:16:40.914 03:17:15 -- nvmf/common.sh@377 -- # modinfo irdma 00:16:40.914 03:17:15 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:16:40.914 03:17:15 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:40.914 03:17:15 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:40.914 03:17:15 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:40.914 03:17:15 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:40.914 03:17:15 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:16:40.914 Found net devices under 0000:af:00.0: cvl_0_0 00:16:40.914 03:17:15 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:40.914 03:17:15 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:40.914 03:17:15 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:40.914 03:17:15 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:40.914 03:17:15 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:40.914 03:17:15 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:16:40.914 Found net devices under 0000:af:00.1: cvl_0_1 00:16:40.914 03:17:15 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:40.914 03:17:15 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:40.914 03:17:15 -- nvmf/common.sh@403 -- # is_hw=yes 00:16:40.914 03:17:15 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:16:40.914 03:17:15 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:16:40.914 03:17:15 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:16:40.914 03:17:15 -- nvmf/common.sh@409 -- # rdma_device_init 00:16:40.914 03:17:15 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:16:40.914 03:17:15 -- nvmf/common.sh@58 -- # uname 00:16:40.914 03:17:15 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:16:40.914 03:17:15 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:16:40.914 03:17:15 -- nvmf/common.sh@63 -- # modprobe ib_core 00:16:40.914 03:17:15 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:16:40.914 03:17:15 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:16:40.914 03:17:15 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:16:40.914 03:17:15 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:16:40.914 03:17:15 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:16:40.914 03:17:15 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:16:40.914 03:17:15 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:16:40.914 03:17:15 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:16:40.914 03:17:15 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:40.914 03:17:15 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:40.914 03:17:15 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:40.914 03:17:15 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:40.914 03:17:15 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:40.914 03:17:15 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:40.914 03:17:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:40.914 03:17:15 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:16:40.914 03:17:15 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:16:40.914 03:17:15 -- nvmf/common.sh@105 -- # continue 2 00:16:40.914 03:17:15 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:40.914 03:17:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:40.914 03:17:15 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:16:40.914 03:17:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:40.914 03:17:15 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:16:40.914 03:17:15 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:16:40.914 03:17:15 -- nvmf/common.sh@105 -- # continue 2 00:16:40.914 03:17:15 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:40.914 03:17:15 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:16:40.914 03:17:15 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:16:40.914 03:17:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:16:40.914 03:17:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:40.914 03:17:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:40.914 03:17:15 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:16:40.914 03:17:15 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:16:40.914 03:17:15 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:16:40.914 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:16:40.914 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:16:40.914 altname enp175s0f0np0 00:16:40.914 altname ens801f0np0 00:16:40.914 inet 192.168.100.8/24 scope global cvl_0_0 00:16:40.914 valid_lft forever preferred_lft forever 00:16:40.914 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:16:40.914 valid_lft forever preferred_lft forever 00:16:40.914 03:17:15 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:40.914 03:17:15 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:16:40.914 03:17:15 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:16:40.914 03:17:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:16:40.914 03:17:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:40.914 03:17:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:40.914 03:17:15 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:16:40.914 03:17:15 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:16:40.914 03:17:15 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:16:40.914 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:16:40.914 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:16:40.914 altname enp175s0f1np1 00:16:40.914 altname ens801f1np1 00:16:40.914 inet 192.168.100.9/24 scope global cvl_0_1 00:16:40.914 valid_lft forever preferred_lft forever 00:16:40.914 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:16:40.914 valid_lft forever preferred_lft forever 00:16:40.914 03:17:15 -- nvmf/common.sh@411 -- # return 0 00:16:40.914 03:17:15 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:16:40.914 03:17:15 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:16:40.914 03:17:15 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:16:40.914 03:17:15 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:16:40.914 03:17:15 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:16:40.914 03:17:15 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:40.914 03:17:15 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:40.914 03:17:15 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:40.914 03:17:15 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:40.914 03:17:15 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:40.914 03:17:15 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:40.914 03:17:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:40.914 03:17:15 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:16:40.914 03:17:15 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:16:40.914 03:17:15 -- nvmf/common.sh@105 -- # continue 2 00:16:40.914 03:17:15 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:40.914 03:17:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:40.914 03:17:15 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:16:40.914 03:17:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:40.914 03:17:15 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:16:40.914 03:17:15 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:16:40.914 03:17:15 -- nvmf/common.sh@105 -- # continue 2 00:16:40.914 03:17:15 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:41.174 03:17:15 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:16:41.174 03:17:15 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:16:41.174 03:17:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:16:41.174 03:17:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:41.174 03:17:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:41.174 03:17:15 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:41.174 03:17:15 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:16:41.174 03:17:15 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:16:41.174 03:17:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:16:41.174 03:17:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:41.174 03:17:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:41.174 03:17:15 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:16:41.174 192.168.100.9' 00:16:41.174 03:17:15 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:16:41.174 192.168.100.9' 00:16:41.174 03:17:15 -- nvmf/common.sh@446 -- # head -n 1 00:16:41.174 03:17:15 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:16:41.174 03:17:15 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:16:41.174 192.168.100.9' 00:16:41.174 03:17:15 -- nvmf/common.sh@447 -- # tail -n +2 00:16:41.174 03:17:15 -- nvmf/common.sh@447 -- # head -n 1 00:16:41.174 03:17:15 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:16:41.174 03:17:15 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:16:41.174 03:17:15 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:16:41.174 03:17:15 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:16:41.174 03:17:15 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:16:41.174 03:17:15 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:16:41.174 03:17:15 -- target/multipath.sh@45 -- # '[' -z 192.168.100.9 ']' 00:16:41.174 03:17:15 -- target/multipath.sh@51 -- # '[' rdma '!=' tcp ']' 00:16:41.174 03:17:15 -- target/multipath.sh@52 -- # echo 'run this test only with TCP transport for now' 00:16:41.174 run this test only with TCP transport for now 00:16:41.174 03:17:15 -- target/multipath.sh@53 -- # nvmftestfini 00:16:41.174 03:17:15 -- nvmf/common.sh@477 -- # nvmfcleanup 00:16:41.174 03:17:15 -- nvmf/common.sh@117 -- # sync 00:16:41.174 03:17:15 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:16:41.174 03:17:15 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:16:41.174 03:17:15 -- nvmf/common.sh@120 -- # set +e 00:16:41.174 03:17:15 -- nvmf/common.sh@121 -- # for i in {1..20} 00:16:41.174 03:17:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:16:41.174 rmmod nvme_rdma 00:16:41.174 rmmod nvme_fabrics 00:16:41.174 03:17:15 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:16:41.174 03:17:15 -- nvmf/common.sh@124 -- # set -e 00:16:41.174 03:17:15 -- nvmf/common.sh@125 -- # return 0 00:16:41.174 03:17:15 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:16:41.174 03:17:15 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:16:41.174 03:17:15 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:16:41.174 03:17:15 -- target/multipath.sh@54 -- # exit 0 00:16:41.174 03:17:15 -- target/multipath.sh@1 -- # nvmftestfini 00:16:41.174 03:17:15 -- nvmf/common.sh@477 -- # nvmfcleanup 00:16:41.174 03:17:15 -- nvmf/common.sh@117 -- # sync 00:16:41.174 03:17:15 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:16:41.174 03:17:15 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:16:41.174 03:17:15 -- nvmf/common.sh@120 -- # set +e 00:16:41.174 03:17:15 -- nvmf/common.sh@121 -- # for i in {1..20} 00:16:41.174 03:17:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:16:41.174 03:17:15 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:16:41.174 03:17:15 -- nvmf/common.sh@124 -- # set -e 00:16:41.174 03:17:15 -- nvmf/common.sh@125 -- # return 0 00:16:41.174 03:17:15 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:16:41.174 03:17:15 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:16:41.174 03:17:15 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:16:41.174 00:16:41.174 real 0m5.716s 00:16:41.174 user 0m1.547s 00:16:41.174 sys 0m4.208s 00:16:41.175 03:17:15 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:16:41.175 03:17:15 -- common/autotest_common.sh@10 -- # set +x 00:16:41.175 ************************************ 00:16:41.175 END TEST nvmf_multipath 00:16:41.175 ************************************ 00:16:41.175 03:17:15 -- nvmf/nvmf.sh@53 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=rdma 00:16:41.175 03:17:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:41.175 03:17:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:41.175 03:17:15 -- common/autotest_common.sh@10 -- # set +x 00:16:41.434 ************************************ 00:16:41.434 START TEST nvmf_zcopy 00:16:41.434 ************************************ 00:16:41.434 03:17:15 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=rdma 00:16:41.434 * Looking for test storage... 00:16:41.434 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:16:41.434 03:17:15 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:16:41.434 03:17:15 -- nvmf/common.sh@7 -- # uname -s 00:16:41.434 03:17:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:41.434 03:17:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:41.434 03:17:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:41.434 03:17:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:41.434 03:17:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:41.434 03:17:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:41.434 03:17:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:41.434 03:17:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:41.434 03:17:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:41.434 03:17:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:41.434 03:17:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:16:41.434 03:17:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:16:41.434 03:17:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:41.434 03:17:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:41.434 03:17:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:41.434 03:17:15 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:16:41.434 03:17:15 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:16:41.434 03:17:15 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:41.434 03:17:15 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:41.434 03:17:15 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:41.434 03:17:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.434 03:17:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.434 03:17:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.434 03:17:15 -- paths/export.sh@5 -- # export PATH 00:16:41.434 03:17:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.434 03:17:15 -- nvmf/common.sh@47 -- # : 0 00:16:41.434 03:17:15 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:16:41.434 03:17:15 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:16:41.434 03:17:15 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:16:41.434 03:17:15 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:41.434 03:17:15 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:41.434 03:17:15 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:16:41.434 03:17:15 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:16:41.434 03:17:15 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:16:41.434 03:17:15 -- target/zcopy.sh@12 -- # nvmftestinit 00:16:41.434 03:17:15 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:16:41.434 03:17:15 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:41.434 03:17:15 -- nvmf/common.sh@437 -- # prepare_net_devs 00:16:41.434 03:17:15 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:16:41.434 03:17:15 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:16:41.434 03:17:15 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:41.434 03:17:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:41.434 03:17:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:41.434 03:17:15 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:16:41.434 03:17:15 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:16:41.434 03:17:15 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:41.434 03:17:15 -- common/autotest_common.sh@10 -- # set +x 00:16:46.710 03:17:21 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:46.710 03:17:21 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:46.710 03:17:21 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:46.710 03:17:21 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:46.710 03:17:21 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:46.710 03:17:21 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:46.710 03:17:21 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:46.710 03:17:21 -- nvmf/common.sh@295 -- # net_devs=() 00:16:46.710 03:17:21 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:46.710 03:17:21 -- nvmf/common.sh@296 -- # e810=() 00:16:46.710 03:17:21 -- nvmf/common.sh@296 -- # local -ga e810 00:16:46.710 03:17:21 -- nvmf/common.sh@297 -- # x722=() 00:16:46.710 03:17:21 -- nvmf/common.sh@297 -- # local -ga x722 00:16:46.710 03:17:21 -- nvmf/common.sh@298 -- # mlx=() 00:16:46.710 03:17:21 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:46.710 03:17:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:46.710 03:17:21 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:46.710 03:17:21 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:46.710 03:17:21 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:46.710 03:17:21 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:46.710 03:17:21 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:46.710 03:17:21 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:46.710 03:17:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:46.710 03:17:21 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:46.710 03:17:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:46.710 03:17:21 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:46.710 03:17:21 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:46.710 03:17:21 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:16:46.710 03:17:21 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:16:46.710 03:17:21 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:16:46.710 03:17:21 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:16:46.710 03:17:21 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:16:46.710 03:17:21 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:16:46.710 03:17:21 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:46.710 03:17:21 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:46.710 03:17:21 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:16:46.710 Found 0000:af:00.0 (0x8086 - 0x159b) 00:16:46.710 03:17:21 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:46.710 03:17:21 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:46.710 03:17:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:46.710 03:17:21 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:46.710 03:17:21 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:46.710 03:17:21 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:46.710 03:17:21 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:46.710 03:17:21 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:16:46.710 Found 0000:af:00.1 (0x8086 - 0x159b) 00:16:46.710 03:17:21 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:46.710 03:17:21 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:46.710 03:17:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:46.710 03:17:21 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:46.710 03:17:21 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:46.710 03:17:21 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:46.710 03:17:21 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:46.710 03:17:21 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:16:46.710 03:17:21 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:16:46.710 03:17:21 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:16:46.710 03:17:21 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:16:46.710 03:17:21 -- nvmf/common.sh@377 -- # modinfo irdma 00:16:46.710 03:17:21 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:16:46.710 03:17:21 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:46.710 03:17:21 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:46.710 03:17:21 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:46.710 03:17:21 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:46.710 03:17:21 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:16:46.710 Found net devices under 0000:af:00.0: cvl_0_0 00:16:46.710 03:17:21 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:46.710 03:17:21 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:46.710 03:17:21 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:46.710 03:17:21 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:46.710 03:17:21 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:46.710 03:17:21 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:16:46.710 Found net devices under 0000:af:00.1: cvl_0_1 00:16:46.710 03:17:21 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:46.710 03:17:21 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:46.710 03:17:21 -- nvmf/common.sh@403 -- # is_hw=yes 00:16:46.710 03:17:21 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:16:46.710 03:17:21 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:16:46.710 03:17:21 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:16:46.710 03:17:21 -- nvmf/common.sh@409 -- # rdma_device_init 00:16:46.710 03:17:21 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:16:46.710 03:17:21 -- nvmf/common.sh@58 -- # uname 00:16:46.710 03:17:21 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:16:46.710 03:17:21 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:16:46.710 03:17:21 -- nvmf/common.sh@63 -- # modprobe ib_core 00:16:46.710 03:17:21 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:16:46.710 03:17:21 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:16:46.710 03:17:21 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:16:46.710 03:17:21 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:16:46.710 03:17:21 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:16:46.710 03:17:21 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:16:46.710 03:17:21 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:16:46.710 03:17:21 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:16:46.710 03:17:21 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:46.710 03:17:21 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:46.710 03:17:21 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:46.710 03:17:21 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:46.710 03:17:21 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:46.710 03:17:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:46.710 03:17:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:46.710 03:17:21 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:16:46.710 03:17:21 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:16:46.710 03:17:21 -- nvmf/common.sh@105 -- # continue 2 00:16:46.710 03:17:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:46.710 03:17:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:46.710 03:17:21 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:16:46.710 03:17:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:46.710 03:17:21 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:16:46.710 03:17:21 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:16:46.710 03:17:21 -- nvmf/common.sh@105 -- # continue 2 00:16:46.710 03:17:21 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:46.710 03:17:21 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:16:46.710 03:17:21 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:16:46.710 03:17:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:16:46.710 03:17:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:46.710 03:17:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:46.710 03:17:21 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:16:46.710 03:17:21 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:16:46.710 03:17:21 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:16:46.710 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:16:46.710 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:16:46.710 altname enp175s0f0np0 00:16:46.710 altname ens801f0np0 00:16:46.710 inet 192.168.100.8/24 scope global cvl_0_0 00:16:46.710 valid_lft forever preferred_lft forever 00:16:46.710 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:16:46.710 valid_lft forever preferred_lft forever 00:16:46.710 03:17:21 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:46.710 03:17:21 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:16:46.710 03:17:21 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:16:46.710 03:17:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:16:46.710 03:17:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:46.710 03:17:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:46.710 03:17:21 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:16:46.710 03:17:21 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:16:46.710 03:17:21 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:16:46.710 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:16:46.710 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:16:46.710 altname enp175s0f1np1 00:16:46.710 altname ens801f1np1 00:16:46.710 inet 192.168.100.9/24 scope global cvl_0_1 00:16:46.710 valid_lft forever preferred_lft forever 00:16:46.710 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:16:46.710 valid_lft forever preferred_lft forever 00:16:46.710 03:17:21 -- nvmf/common.sh@411 -- # return 0 00:16:46.710 03:17:21 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:16:46.710 03:17:21 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:16:46.710 03:17:21 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:16:46.710 03:17:21 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:16:46.710 03:17:21 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:16:46.710 03:17:21 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:46.710 03:17:21 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:46.710 03:17:21 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:46.711 03:17:21 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:46.711 03:17:21 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:46.711 03:17:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:46.711 03:17:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:46.711 03:17:21 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:16:46.711 03:17:21 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:16:46.711 03:17:21 -- nvmf/common.sh@105 -- # continue 2 00:16:46.711 03:17:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:46.711 03:17:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:46.711 03:17:21 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:16:46.711 03:17:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:46.711 03:17:21 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:16:46.711 03:17:21 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:16:46.711 03:17:21 -- nvmf/common.sh@105 -- # continue 2 00:16:46.711 03:17:21 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:46.711 03:17:21 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:16:46.711 03:17:21 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:16:46.711 03:17:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:16:46.711 03:17:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:46.711 03:17:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:46.711 03:17:21 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:46.711 03:17:21 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:16:46.711 03:17:21 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:16:46.711 03:17:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:16:46.711 03:17:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:46.711 03:17:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:46.711 03:17:21 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:16:46.711 192.168.100.9' 00:16:46.711 03:17:21 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:16:46.711 192.168.100.9' 00:16:46.711 03:17:21 -- nvmf/common.sh@446 -- # head -n 1 00:16:46.711 03:17:21 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:16:46.711 03:17:21 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:16:46.711 192.168.100.9' 00:16:46.711 03:17:21 -- nvmf/common.sh@447 -- # tail -n +2 00:16:46.711 03:17:21 -- nvmf/common.sh@447 -- # head -n 1 00:16:46.711 03:17:21 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:16:46.711 03:17:21 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:16:46.711 03:17:21 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:16:46.711 03:17:21 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:16:46.711 03:17:21 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:16:46.711 03:17:21 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:16:46.711 03:17:21 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:16:46.711 03:17:21 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:46.711 03:17:21 -- common/autotest_common.sh@710 -- # xtrace_disable 00:16:46.711 03:17:21 -- common/autotest_common.sh@10 -- # set +x 00:16:46.969 03:17:21 -- nvmf/common.sh@470 -- # nvmfpid=4083411 00:16:46.969 03:17:21 -- nvmf/common.sh@471 -- # waitforlisten 4083411 00:16:46.969 03:17:21 -- common/autotest_common.sh@817 -- # '[' -z 4083411 ']' 00:16:46.969 03:17:21 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:46.969 03:17:21 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:46.969 03:17:21 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:46.969 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:46.969 03:17:21 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:16:46.969 03:17:21 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:46.969 03:17:21 -- common/autotest_common.sh@10 -- # set +x 00:16:46.969 [2024-04-25 03:17:21.256697] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:16:46.969 [2024-04-25 03:17:21.256740] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:46.969 EAL: No free 2048 kB hugepages reported on node 1 00:16:46.969 [2024-04-25 03:17:21.315873] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:46.969 [2024-04-25 03:17:21.390554] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:46.969 [2024-04-25 03:17:21.390586] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:46.969 [2024-04-25 03:17:21.390592] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:46.969 [2024-04-25 03:17:21.390598] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:46.970 [2024-04-25 03:17:21.390603] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:46.970 [2024-04-25 03:17:21.390617] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:47.914 03:17:22 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:47.914 03:17:22 -- common/autotest_common.sh@850 -- # return 0 00:16:47.914 03:17:22 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:47.914 03:17:22 -- common/autotest_common.sh@716 -- # xtrace_disable 00:16:47.914 03:17:22 -- common/autotest_common.sh@10 -- # set +x 00:16:47.914 03:17:22 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:47.914 03:17:22 -- target/zcopy.sh@15 -- # '[' rdma '!=' tcp ']' 00:16:47.915 03:17:22 -- target/zcopy.sh@16 -- # echo 'Unsupported transport: rdma' 00:16:47.915 Unsupported transport: rdma 00:16:47.915 03:17:22 -- target/zcopy.sh@17 -- # exit 0 00:16:47.915 03:17:22 -- target/zcopy.sh@1 -- # process_shm --id 0 00:16:47.915 03:17:22 -- common/autotest_common.sh@794 -- # type=--id 00:16:47.915 03:17:22 -- common/autotest_common.sh@795 -- # id=0 00:16:47.915 03:17:22 -- common/autotest_common.sh@796 -- # '[' --id = --pid ']' 00:16:47.915 03:17:22 -- common/autotest_common.sh@800 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:16:47.915 03:17:22 -- common/autotest_common.sh@800 -- # shm_files=nvmf_trace.0 00:16:47.915 03:17:22 -- common/autotest_common.sh@802 -- # [[ -z nvmf_trace.0 ]] 00:16:47.915 03:17:22 -- common/autotest_common.sh@806 -- # for n in $shm_files 00:16:47.915 03:17:22 -- common/autotest_common.sh@807 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:16:47.915 nvmf_trace.0 00:16:47.915 03:17:22 -- common/autotest_common.sh@809 -- # return 0 00:16:47.915 03:17:22 -- target/zcopy.sh@1 -- # nvmftestfini 00:16:47.915 03:17:22 -- nvmf/common.sh@477 -- # nvmfcleanup 00:16:47.915 03:17:22 -- nvmf/common.sh@117 -- # sync 00:16:47.915 03:17:22 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:16:47.915 03:17:22 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:16:47.915 03:17:22 -- nvmf/common.sh@120 -- # set +e 00:16:47.915 03:17:22 -- nvmf/common.sh@121 -- # for i in {1..20} 00:16:47.915 03:17:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:16:47.915 rmmod nvme_rdma 00:16:47.915 rmmod nvme_fabrics 00:16:47.915 03:17:22 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:16:47.915 03:17:22 -- nvmf/common.sh@124 -- # set -e 00:16:47.915 03:17:22 -- nvmf/common.sh@125 -- # return 0 00:16:47.915 03:17:22 -- nvmf/common.sh@478 -- # '[' -n 4083411 ']' 00:16:47.915 03:17:22 -- nvmf/common.sh@479 -- # killprocess 4083411 00:16:47.915 03:17:22 -- common/autotest_common.sh@936 -- # '[' -z 4083411 ']' 00:16:47.915 03:17:22 -- common/autotest_common.sh@940 -- # kill -0 4083411 00:16:47.915 03:17:22 -- common/autotest_common.sh@941 -- # uname 00:16:47.915 03:17:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:47.915 03:17:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4083411 00:16:47.915 03:17:22 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:47.915 03:17:22 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:47.915 03:17:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4083411' 00:16:47.915 killing process with pid 4083411 00:16:47.915 03:17:22 -- common/autotest_common.sh@955 -- # kill 4083411 00:16:47.915 03:17:22 -- common/autotest_common.sh@960 -- # wait 4083411 00:16:47.915 03:17:22 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:16:47.915 03:17:22 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:16:47.915 00:16:47.915 real 0m6.654s 00:16:47.915 user 0m2.774s 00:16:47.915 sys 0m4.292s 00:16:47.915 03:17:22 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:16:47.915 03:17:22 -- common/autotest_common.sh@10 -- # set +x 00:16:47.915 ************************************ 00:16:47.915 END TEST nvmf_zcopy 00:16:47.915 ************************************ 00:16:47.915 03:17:22 -- nvmf/nvmf.sh@54 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=rdma 00:16:47.915 03:17:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:47.915 03:17:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:47.915 03:17:22 -- common/autotest_common.sh@10 -- # set +x 00:16:48.174 ************************************ 00:16:48.174 START TEST nvmf_nmic 00:16:48.174 ************************************ 00:16:48.174 03:17:22 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=rdma 00:16:48.174 * Looking for test storage... 00:16:48.174 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:16:48.174 03:17:22 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:16:48.174 03:17:22 -- nvmf/common.sh@7 -- # uname -s 00:16:48.174 03:17:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:48.174 03:17:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:48.174 03:17:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:48.174 03:17:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:48.174 03:17:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:48.174 03:17:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:48.174 03:17:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:48.174 03:17:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:48.174 03:17:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:48.174 03:17:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:48.174 03:17:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:16:48.174 03:17:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:16:48.174 03:17:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:48.174 03:17:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:48.174 03:17:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:48.174 03:17:22 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:16:48.174 03:17:22 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:16:48.174 03:17:22 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:48.174 03:17:22 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:48.174 03:17:22 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:48.174 03:17:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:48.174 03:17:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:48.174 03:17:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:48.174 03:17:22 -- paths/export.sh@5 -- # export PATH 00:16:48.174 03:17:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:48.174 03:17:22 -- nvmf/common.sh@47 -- # : 0 00:16:48.174 03:17:22 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:16:48.174 03:17:22 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:16:48.174 03:17:22 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:16:48.174 03:17:22 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:48.174 03:17:22 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:48.174 03:17:22 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:16:48.174 03:17:22 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:16:48.174 03:17:22 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:16:48.174 03:17:22 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:48.174 03:17:22 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:48.174 03:17:22 -- target/nmic.sh@14 -- # nvmftestinit 00:16:48.174 03:17:22 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:16:48.174 03:17:22 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:48.174 03:17:22 -- nvmf/common.sh@437 -- # prepare_net_devs 00:16:48.174 03:17:22 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:16:48.174 03:17:22 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:16:48.174 03:17:22 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:48.174 03:17:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:48.174 03:17:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:48.174 03:17:22 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:16:48.174 03:17:22 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:16:48.174 03:17:22 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:48.174 03:17:22 -- common/autotest_common.sh@10 -- # set +x 00:16:54.823 03:17:28 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:54.823 03:17:28 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:54.823 03:17:28 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:54.823 03:17:28 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:54.823 03:17:28 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:54.823 03:17:28 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:54.823 03:17:28 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:54.823 03:17:28 -- nvmf/common.sh@295 -- # net_devs=() 00:16:54.823 03:17:28 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:54.823 03:17:28 -- nvmf/common.sh@296 -- # e810=() 00:16:54.823 03:17:28 -- nvmf/common.sh@296 -- # local -ga e810 00:16:54.823 03:17:28 -- nvmf/common.sh@297 -- # x722=() 00:16:54.823 03:17:28 -- nvmf/common.sh@297 -- # local -ga x722 00:16:54.824 03:17:28 -- nvmf/common.sh@298 -- # mlx=() 00:16:54.824 03:17:28 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:54.824 03:17:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:54.824 03:17:28 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:54.824 03:17:28 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:54.824 03:17:28 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:54.824 03:17:28 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:54.824 03:17:28 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:54.824 03:17:28 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:54.824 03:17:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:54.824 03:17:28 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:54.824 03:17:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:54.824 03:17:28 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:54.824 03:17:28 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:54.824 03:17:28 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:16:54.824 03:17:28 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:16:54.824 03:17:28 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:16:54.824 03:17:28 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:16:54.824 03:17:28 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:16:54.824 03:17:28 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:16:54.824 03:17:28 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:54.824 03:17:28 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:54.824 03:17:28 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:16:54.824 Found 0000:af:00.0 (0x8086 - 0x159b) 00:16:54.824 03:17:28 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:54.824 03:17:28 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:54.824 03:17:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:54.824 03:17:28 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:54.824 03:17:28 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:54.824 03:17:28 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:54.824 03:17:28 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:54.824 03:17:28 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:16:54.824 Found 0000:af:00.1 (0x8086 - 0x159b) 00:16:54.824 03:17:28 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:54.824 03:17:28 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:54.824 03:17:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:54.824 03:17:28 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:54.824 03:17:28 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:54.824 03:17:28 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:54.824 03:17:28 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:54.824 03:17:28 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:16:54.824 03:17:28 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:16:54.824 03:17:28 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:16:54.824 03:17:28 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:16:54.824 03:17:28 -- nvmf/common.sh@377 -- # modinfo irdma 00:16:54.824 03:17:28 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:16:54.824 03:17:28 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:54.824 03:17:28 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:54.824 03:17:28 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:54.824 03:17:28 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:54.824 03:17:28 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:16:54.824 Found net devices under 0000:af:00.0: cvl_0_0 00:16:54.824 03:17:28 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:54.824 03:17:28 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:54.824 03:17:28 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:54.824 03:17:28 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:54.824 03:17:28 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:54.824 03:17:28 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:16:54.824 Found net devices under 0000:af:00.1: cvl_0_1 00:16:54.824 03:17:28 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:54.824 03:17:28 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:54.824 03:17:28 -- nvmf/common.sh@403 -- # is_hw=yes 00:16:54.824 03:17:28 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:16:54.824 03:17:28 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:16:54.824 03:17:28 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:16:54.824 03:17:28 -- nvmf/common.sh@409 -- # rdma_device_init 00:16:54.824 03:17:28 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:16:54.824 03:17:28 -- nvmf/common.sh@58 -- # uname 00:16:54.824 03:17:28 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:16:54.824 03:17:28 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:16:54.824 03:17:28 -- nvmf/common.sh@63 -- # modprobe ib_core 00:16:54.824 03:17:28 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:16:54.824 03:17:28 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:16:54.824 03:17:28 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:16:54.824 03:17:28 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:16:54.824 03:17:28 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:16:54.824 03:17:28 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:16:54.824 03:17:28 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:16:54.824 03:17:28 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:16:54.824 03:17:28 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:54.824 03:17:28 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:54.824 03:17:28 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:54.824 03:17:28 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:54.824 03:17:28 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:54.824 03:17:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:54.824 03:17:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:54.824 03:17:28 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:16:54.824 03:17:28 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:16:54.824 03:17:28 -- nvmf/common.sh@105 -- # continue 2 00:16:54.824 03:17:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:54.824 03:17:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:54.824 03:17:28 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:16:54.824 03:17:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:54.824 03:17:28 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:16:54.824 03:17:28 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:16:54.824 03:17:28 -- nvmf/common.sh@105 -- # continue 2 00:16:54.824 03:17:28 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:54.824 03:17:28 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:16:54.824 03:17:28 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:16:54.824 03:17:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:16:54.824 03:17:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:54.824 03:17:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:54.824 03:17:28 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:16:54.824 03:17:28 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:16:54.824 03:17:28 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:16:54.824 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:16:54.824 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:16:54.824 altname enp175s0f0np0 00:16:54.824 altname ens801f0np0 00:16:54.824 inet 192.168.100.8/24 scope global cvl_0_0 00:16:54.824 valid_lft forever preferred_lft forever 00:16:54.824 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:16:54.824 valid_lft forever preferred_lft forever 00:16:54.824 03:17:28 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:54.824 03:17:28 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:16:54.824 03:17:28 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:16:54.824 03:17:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:16:54.824 03:17:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:54.824 03:17:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:54.824 03:17:28 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:16:54.824 03:17:28 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:16:54.824 03:17:28 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:16:54.824 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:16:54.824 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:16:54.824 altname enp175s0f1np1 00:16:54.824 altname ens801f1np1 00:16:54.824 inet 192.168.100.9/24 scope global cvl_0_1 00:16:54.824 valid_lft forever preferred_lft forever 00:16:54.824 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:16:54.824 valid_lft forever preferred_lft forever 00:16:54.824 03:17:28 -- nvmf/common.sh@411 -- # return 0 00:16:54.824 03:17:28 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:16:54.824 03:17:28 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:16:54.824 03:17:28 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:16:54.824 03:17:28 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:16:54.824 03:17:28 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:16:54.824 03:17:28 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:54.824 03:17:28 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:54.824 03:17:28 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:54.824 03:17:28 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:54.824 03:17:28 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:54.824 03:17:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:54.824 03:17:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:54.824 03:17:28 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:16:54.824 03:17:28 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:16:54.824 03:17:28 -- nvmf/common.sh@105 -- # continue 2 00:16:54.824 03:17:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:54.824 03:17:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:54.824 03:17:28 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:16:54.824 03:17:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:54.824 03:17:28 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:16:54.824 03:17:28 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:16:54.824 03:17:28 -- nvmf/common.sh@105 -- # continue 2 00:16:54.824 03:17:28 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:54.824 03:17:28 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:16:54.824 03:17:28 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:16:54.824 03:17:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:16:54.824 03:17:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:54.824 03:17:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:54.825 03:17:28 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:54.825 03:17:28 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:16:54.825 03:17:28 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:16:54.825 03:17:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:16:54.825 03:17:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:54.825 03:17:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:54.825 03:17:28 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:16:54.825 192.168.100.9' 00:16:54.825 03:17:28 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:16:54.825 192.168.100.9' 00:16:54.825 03:17:28 -- nvmf/common.sh@446 -- # head -n 1 00:16:54.825 03:17:28 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:16:54.825 03:17:28 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:16:54.825 192.168.100.9' 00:16:54.825 03:17:28 -- nvmf/common.sh@447 -- # tail -n +2 00:16:54.825 03:17:28 -- nvmf/common.sh@447 -- # head -n 1 00:16:54.825 03:17:28 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:16:54.825 03:17:28 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:16:54.825 03:17:28 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:16:54.825 03:17:28 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:16:54.825 03:17:28 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:16:54.825 03:17:28 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:16:54.825 03:17:28 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:16:54.825 03:17:28 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:54.825 03:17:28 -- common/autotest_common.sh@710 -- # xtrace_disable 00:16:54.825 03:17:28 -- common/autotest_common.sh@10 -- # set +x 00:16:54.825 03:17:28 -- nvmf/common.sh@470 -- # nvmfpid=4086987 00:16:54.825 03:17:28 -- nvmf/common.sh@471 -- # waitforlisten 4086987 00:16:54.825 03:17:28 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:54.825 03:17:28 -- common/autotest_common.sh@817 -- # '[' -z 4086987 ']' 00:16:54.825 03:17:28 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:54.825 03:17:28 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:54.825 03:17:28 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:54.825 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:54.825 03:17:28 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:54.825 03:17:28 -- common/autotest_common.sh@10 -- # set +x 00:16:54.825 [2024-04-25 03:17:28.501140] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:16:54.825 [2024-04-25 03:17:28.501188] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:54.825 EAL: No free 2048 kB hugepages reported on node 1 00:16:54.825 [2024-04-25 03:17:28.564224] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:54.825 [2024-04-25 03:17:28.638489] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:54.825 [2024-04-25 03:17:28.638530] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:54.825 [2024-04-25 03:17:28.638537] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:54.825 [2024-04-25 03:17:28.638543] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:54.825 [2024-04-25 03:17:28.638548] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:54.825 [2024-04-25 03:17:28.638605] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:54.825 [2024-04-25 03:17:28.638701] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:54.825 [2024-04-25 03:17:28.638792] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:54.825 [2024-04-25 03:17:28.638793] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:54.825 03:17:29 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:54.825 03:17:29 -- common/autotest_common.sh@850 -- # return 0 00:16:54.825 03:17:29 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:54.825 03:17:29 -- common/autotest_common.sh@716 -- # xtrace_disable 00:16:54.825 03:17:29 -- common/autotest_common.sh@10 -- # set +x 00:16:55.084 03:17:29 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:55.084 03:17:29 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:16:55.084 03:17:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:55.084 03:17:29 -- common/autotest_common.sh@10 -- # set +x 00:16:55.084 [2024-04-25 03:17:29.373346] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x130fea0/0x130f4e0) succeed. 00:16:55.084 [2024-04-25 03:17:29.383307] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x1311210/0x130fa60) succeed. 00:16:55.084 [2024-04-25 03:17:29.383330] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:16:55.084 03:17:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:55.084 03:17:29 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:55.084 03:17:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:55.084 03:17:29 -- common/autotest_common.sh@10 -- # set +x 00:16:55.084 Malloc0 00:16:55.084 03:17:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:55.084 03:17:29 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:55.084 03:17:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:55.084 03:17:29 -- common/autotest_common.sh@10 -- # set +x 00:16:55.084 03:17:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:55.084 03:17:29 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:55.084 03:17:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:55.084 03:17:29 -- common/autotest_common.sh@10 -- # set +x 00:16:55.084 03:17:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:55.084 03:17:29 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:16:55.084 03:17:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:55.084 03:17:29 -- common/autotest_common.sh@10 -- # set +x 00:16:55.084 [2024-04-25 03:17:29.438336] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:55.084 03:17:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:55.084 03:17:29 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:16:55.084 test case1: single bdev can't be used in multiple subsystems 00:16:55.084 03:17:29 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:16:55.084 03:17:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:55.084 03:17:29 -- common/autotest_common.sh@10 -- # set +x 00:16:55.084 03:17:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:55.084 03:17:29 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:16:55.084 03:17:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:55.084 03:17:29 -- common/autotest_common.sh@10 -- # set +x 00:16:55.084 03:17:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:55.084 03:17:29 -- target/nmic.sh@28 -- # nmic_status=0 00:16:55.084 03:17:29 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:16:55.084 03:17:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:55.084 03:17:29 -- common/autotest_common.sh@10 -- # set +x 00:16:55.084 [2024-04-25 03:17:29.462372] bdev.c:7988:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:16:55.084 [2024-04-25 03:17:29.462389] subsystem.c:1934:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:16:55.084 [2024-04-25 03:17:29.462396] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:55.084 request: 00:16:55.084 { 00:16:55.084 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:16:55.084 "namespace": { 00:16:55.084 "bdev_name": "Malloc0", 00:16:55.084 "no_auto_visible": false 00:16:55.084 }, 00:16:55.084 "method": "nvmf_subsystem_add_ns", 00:16:55.084 "req_id": 1 00:16:55.084 } 00:16:55.084 Got JSON-RPC error response 00:16:55.084 response: 00:16:55.084 { 00:16:55.084 "code": -32602, 00:16:55.084 "message": "Invalid parameters" 00:16:55.084 } 00:16:55.084 03:17:29 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:16:55.084 03:17:29 -- target/nmic.sh@29 -- # nmic_status=1 00:16:55.084 03:17:29 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:16:55.084 03:17:29 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:16:55.084 Adding namespace failed - expected result. 00:16:55.084 03:17:29 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:16:55.084 test case2: host connect to nvmf target in multiple paths 00:16:55.084 03:17:29 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:16:55.084 03:17:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:55.084 03:17:29 -- common/autotest_common.sh@10 -- # set +x 00:16:55.084 [2024-04-25 03:17:29.474415] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:16:55.084 03:17:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:55.085 03:17:29 -- target/nmic.sh@41 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:16:55.343 03:17:29 -- target/nmic.sh@42 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4421 00:16:55.602 03:17:29 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:16:55.602 03:17:29 -- common/autotest_common.sh@1184 -- # local i=0 00:16:55.602 03:17:29 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:16:55.602 03:17:29 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:16:55.602 03:17:29 -- common/autotest_common.sh@1191 -- # sleep 2 00:16:57.505 03:17:31 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:16:57.505 03:17:31 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:16:57.505 03:17:31 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:16:57.505 03:17:31 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:16:57.505 03:17:31 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:16:57.505 03:17:31 -- common/autotest_common.sh@1194 -- # return 0 00:16:57.505 03:17:31 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:57.505 [global] 00:16:57.505 thread=1 00:16:57.505 invalidate=1 00:16:57.505 rw=write 00:16:57.505 time_based=1 00:16:57.505 runtime=1 00:16:57.505 ioengine=libaio 00:16:57.505 direct=1 00:16:57.505 bs=4096 00:16:57.505 iodepth=1 00:16:57.505 norandommap=0 00:16:57.505 numjobs=1 00:16:57.505 00:16:57.505 verify_dump=1 00:16:57.505 verify_backlog=512 00:16:57.505 verify_state_save=0 00:16:57.505 do_verify=1 00:16:57.505 verify=crc32c-intel 00:16:57.505 [job0] 00:16:57.505 filename=/dev/nvme0n1 00:16:57.505 Could not set queue depth (nvme0n1) 00:16:57.762 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:57.762 fio-3.35 00:16:57.762 Starting 1 thread 00:16:59.247 00:16:59.247 job0: (groupid=0, jobs=1): err= 0: pid=4087802: Thu Apr 25 03:17:33 2024 00:16:59.247 read: IOPS=6649, BW=26.0MiB/s (27.2MB/s)(26.0MiB/1001msec) 00:16:59.247 slat (nsec): min=5723, max=34148, avg=6960.86, stdev=952.54 00:16:59.247 clat (nsec): min=41886, max=88078, avg=63214.36, stdev=3600.71 00:16:59.247 lat (nsec): min=60664, max=97826, avg=70175.22, stdev=3681.83 00:16:59.247 clat percentiles (nsec): 00:16:59.247 | 1.00th=[56064], 5.00th=[57600], 10.00th=[58624], 20.00th=[60160], 00:16:59.247 | 30.00th=[61184], 40.00th=[62208], 50.00th=[63232], 60.00th=[63744], 00:16:59.247 | 70.00th=[64768], 80.00th=[66048], 90.00th=[68096], 95.00th=[69120], 00:16:59.247 | 99.00th=[72192], 99.50th=[73216], 99.90th=[79360], 99.95th=[80384], 00:16:59.247 | 99.99th=[88576] 00:16:59.247 write: IOPS=7084, BW=27.7MiB/s (29.0MB/s)(27.7MiB/1001msec); 0 zone resets 00:16:59.247 slat (nsec): min=8218, max=46495, avg=9204.03, stdev=1118.62 00:16:59.247 clat (usec): min=44, max=187, avg=61.88, stdev= 3.93 00:16:59.247 lat (usec): min=61, max=196, avg=71.09, stdev= 4.13 00:16:59.247 clat percentiles (usec): 00:16:59.247 | 1.00th=[ 55], 5.00th=[ 57], 10.00th=[ 58], 20.00th=[ 59], 00:16:59.247 | 30.00th=[ 60], 40.00th=[ 61], 50.00th=[ 62], 60.00th=[ 63], 00:16:59.247 | 70.00th=[ 64], 80.00th=[ 65], 90.00th=[ 68], 95.00th=[ 69], 00:16:59.247 | 99.00th=[ 72], 99.50th=[ 74], 99.90th=[ 80], 99.95th=[ 86], 00:16:59.247 | 99.99th=[ 188] 00:16:59.247 bw ( KiB/s): min=28672, max=28672, per=100.00%, avg=28672.00, stdev= 0.00, samples=1 00:16:59.247 iops : min= 7168, max= 7168, avg=7168.00, stdev= 0.00, samples=1 00:16:59.247 lat (usec) : 50=0.04%, 100=99.96%, 250=0.01% 00:16:59.247 cpu : usr=6.50%, sys=14.50%, ctx=13748, majf=0, minf=2 00:16:59.247 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:59.247 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:59.247 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:59.247 issued rwts: total=6656,7092,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:59.247 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:59.247 00:16:59.247 Run status group 0 (all jobs): 00:16:59.247 READ: bw=26.0MiB/s (27.2MB/s), 26.0MiB/s-26.0MiB/s (27.2MB/s-27.2MB/s), io=26.0MiB (27.3MB), run=1001-1001msec 00:16:59.247 WRITE: bw=27.7MiB/s (29.0MB/s), 27.7MiB/s-27.7MiB/s (29.0MB/s-29.0MB/s), io=27.7MiB (29.0MB), run=1001-1001msec 00:16:59.247 00:16:59.247 Disk stats (read/write): 00:16:59.247 nvme0n1: ios=6194/6221, merge=0/0, ticks=356/358, in_queue=714, util=90.78% 00:16:59.247 03:17:33 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:17:01.149 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:17:01.149 03:17:35 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:17:01.149 03:17:35 -- common/autotest_common.sh@1205 -- # local i=0 00:17:01.149 03:17:35 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:17:01.149 03:17:35 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:17:01.149 03:17:35 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:17:01.149 03:17:35 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:17:01.149 03:17:35 -- common/autotest_common.sh@1217 -- # return 0 00:17:01.149 03:17:35 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:17:01.149 03:17:35 -- target/nmic.sh@53 -- # nvmftestfini 00:17:01.149 03:17:35 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:01.149 03:17:35 -- nvmf/common.sh@117 -- # sync 00:17:01.149 03:17:35 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:17:01.149 03:17:35 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:17:01.149 03:17:35 -- nvmf/common.sh@120 -- # set +e 00:17:01.149 03:17:35 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:01.149 03:17:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:17:01.149 rmmod nvme_rdma 00:17:01.149 rmmod nvme_fabrics 00:17:01.149 03:17:35 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:01.149 03:17:35 -- nvmf/common.sh@124 -- # set -e 00:17:01.149 03:17:35 -- nvmf/common.sh@125 -- # return 0 00:17:01.149 03:17:35 -- nvmf/common.sh@478 -- # '[' -n 4086987 ']' 00:17:01.149 03:17:35 -- nvmf/common.sh@479 -- # killprocess 4086987 00:17:01.149 03:17:35 -- common/autotest_common.sh@936 -- # '[' -z 4086987 ']' 00:17:01.149 03:17:35 -- common/autotest_common.sh@940 -- # kill -0 4086987 00:17:01.150 03:17:35 -- common/autotest_common.sh@941 -- # uname 00:17:01.150 03:17:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:01.150 03:17:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4086987 00:17:01.150 03:17:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:01.150 03:17:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:01.150 03:17:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4086987' 00:17:01.150 killing process with pid 4086987 00:17:01.150 03:17:35 -- common/autotest_common.sh@955 -- # kill 4086987 00:17:01.150 03:17:35 -- common/autotest_common.sh@960 -- # wait 4086987 00:17:01.150 [2024-04-25 03:17:35.327141] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:17:01.150 03:17:35 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:01.150 03:17:35 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:17:01.150 00:17:01.150 real 0m13.014s 00:17:01.150 user 0m34.922s 00:17:01.150 sys 0m5.285s 00:17:01.150 03:17:35 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:01.150 03:17:35 -- common/autotest_common.sh@10 -- # set +x 00:17:01.150 ************************************ 00:17:01.150 END TEST nvmf_nmic 00:17:01.150 ************************************ 00:17:01.150 03:17:35 -- nvmf/nvmf.sh@55 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=rdma 00:17:01.150 03:17:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:01.150 03:17:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:01.150 03:17:35 -- common/autotest_common.sh@10 -- # set +x 00:17:01.409 ************************************ 00:17:01.409 START TEST nvmf_fio_target 00:17:01.409 ************************************ 00:17:01.409 03:17:35 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=rdma 00:17:01.409 * Looking for test storage... 00:17:01.409 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:17:01.409 03:17:35 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:17:01.409 03:17:35 -- nvmf/common.sh@7 -- # uname -s 00:17:01.409 03:17:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:01.409 03:17:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:01.409 03:17:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:01.409 03:17:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:01.409 03:17:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:01.409 03:17:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:01.409 03:17:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:01.409 03:17:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:01.409 03:17:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:01.409 03:17:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:01.409 03:17:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:17:01.409 03:17:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:17:01.409 03:17:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:01.409 03:17:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:01.409 03:17:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:01.409 03:17:35 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:01.409 03:17:35 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:17:01.409 03:17:35 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:01.409 03:17:35 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:01.409 03:17:35 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:01.409 03:17:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:01.410 03:17:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:01.410 03:17:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:01.410 03:17:35 -- paths/export.sh@5 -- # export PATH 00:17:01.410 03:17:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:01.410 03:17:35 -- nvmf/common.sh@47 -- # : 0 00:17:01.410 03:17:35 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:17:01.410 03:17:35 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:17:01.410 03:17:35 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:01.410 03:17:35 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:01.410 03:17:35 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:01.410 03:17:35 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:17:01.410 03:17:35 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:17:01.410 03:17:35 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:17:01.410 03:17:35 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:01.410 03:17:35 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:01.410 03:17:35 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:17:01.410 03:17:35 -- target/fio.sh@16 -- # nvmftestinit 00:17:01.410 03:17:35 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:17:01.410 03:17:35 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:01.410 03:17:35 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:01.410 03:17:35 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:01.410 03:17:35 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:01.410 03:17:35 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:01.410 03:17:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:01.410 03:17:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:01.410 03:17:35 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:01.410 03:17:35 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:01.410 03:17:35 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:01.410 03:17:35 -- common/autotest_common.sh@10 -- # set +x 00:17:07.974 03:17:41 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:07.974 03:17:41 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:07.974 03:17:41 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:07.974 03:17:41 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:07.974 03:17:41 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:07.974 03:17:41 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:07.974 03:17:41 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:07.974 03:17:41 -- nvmf/common.sh@295 -- # net_devs=() 00:17:07.974 03:17:41 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:07.974 03:17:41 -- nvmf/common.sh@296 -- # e810=() 00:17:07.974 03:17:41 -- nvmf/common.sh@296 -- # local -ga e810 00:17:07.974 03:17:41 -- nvmf/common.sh@297 -- # x722=() 00:17:07.974 03:17:41 -- nvmf/common.sh@297 -- # local -ga x722 00:17:07.974 03:17:41 -- nvmf/common.sh@298 -- # mlx=() 00:17:07.974 03:17:41 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:07.974 03:17:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:07.974 03:17:41 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:07.974 03:17:41 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:07.974 03:17:41 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:07.974 03:17:41 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:07.974 03:17:41 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:07.974 03:17:41 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:07.974 03:17:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:07.974 03:17:41 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:07.974 03:17:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:07.974 03:17:41 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:07.974 03:17:41 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:07.974 03:17:41 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:17:07.974 03:17:41 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:17:07.974 03:17:41 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:17:07.974 03:17:41 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:17:07.974 03:17:41 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:17:07.974 03:17:41 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:17:07.974 03:17:41 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:07.974 03:17:41 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:07.974 03:17:41 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:17:07.974 Found 0000:af:00.0 (0x8086 - 0x159b) 00:17:07.974 03:17:41 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:07.974 03:17:41 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:07.974 03:17:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:07.974 03:17:41 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:07.974 03:17:41 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:07.974 03:17:41 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:07.974 03:17:41 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:07.974 03:17:41 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:17:07.974 Found 0000:af:00.1 (0x8086 - 0x159b) 00:17:07.974 03:17:41 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:07.974 03:17:41 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:07.974 03:17:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:07.974 03:17:41 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:07.974 03:17:41 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:07.974 03:17:41 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:07.974 03:17:41 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:07.974 03:17:41 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:17:07.974 03:17:41 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:17:07.974 03:17:41 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:17:07.974 03:17:41 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:17:07.974 03:17:41 -- nvmf/common.sh@377 -- # modinfo irdma 00:17:07.974 03:17:41 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:17:07.974 03:17:41 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:07.974 03:17:41 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:07.974 03:17:41 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:07.974 03:17:41 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:07.974 03:17:41 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:17:07.974 Found net devices under 0000:af:00.0: cvl_0_0 00:17:07.974 03:17:41 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:07.974 03:17:41 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:07.974 03:17:41 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:07.974 03:17:41 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:07.974 03:17:41 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:07.974 03:17:41 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:17:07.974 Found net devices under 0000:af:00.1: cvl_0_1 00:17:07.974 03:17:41 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:07.974 03:17:41 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:07.974 03:17:41 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:07.974 03:17:41 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:07.974 03:17:41 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:17:07.974 03:17:41 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:17:07.974 03:17:41 -- nvmf/common.sh@409 -- # rdma_device_init 00:17:07.974 03:17:41 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:17:07.974 03:17:41 -- nvmf/common.sh@58 -- # uname 00:17:07.974 03:17:41 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:17:07.974 03:17:41 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:17:07.974 03:17:41 -- nvmf/common.sh@63 -- # modprobe ib_core 00:17:07.974 03:17:41 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:17:07.974 03:17:41 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:17:07.974 03:17:41 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:17:07.974 03:17:41 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:17:07.974 03:17:41 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:17:07.974 03:17:41 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:17:07.974 03:17:41 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:17:07.974 03:17:41 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:17:07.974 03:17:41 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:07.974 03:17:41 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:07.974 03:17:41 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:07.974 03:17:41 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:07.974 03:17:41 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:07.974 03:17:41 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:07.974 03:17:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:07.974 03:17:41 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:17:07.974 03:17:41 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:17:07.974 03:17:41 -- nvmf/common.sh@105 -- # continue 2 00:17:07.974 03:17:41 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:07.974 03:17:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:07.974 03:17:41 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:17:07.974 03:17:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:07.974 03:17:41 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:17:07.974 03:17:41 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:17:07.974 03:17:41 -- nvmf/common.sh@105 -- # continue 2 00:17:07.974 03:17:41 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:07.974 03:17:41 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:17:07.974 03:17:41 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:17:07.974 03:17:41 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:17:07.974 03:17:41 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:07.974 03:17:41 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:07.974 03:17:41 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:17:07.974 03:17:41 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:17:07.974 03:17:41 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:17:07.974 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:17:07.974 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:17:07.974 altname enp175s0f0np0 00:17:07.974 altname ens801f0np0 00:17:07.974 inet 192.168.100.8/24 scope global cvl_0_0 00:17:07.974 valid_lft forever preferred_lft forever 00:17:07.974 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:17:07.974 valid_lft forever preferred_lft forever 00:17:07.974 03:17:41 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:07.974 03:17:41 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:17:07.974 03:17:41 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:17:07.974 03:17:41 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:17:07.974 03:17:41 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:07.974 03:17:41 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:07.974 03:17:41 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:17:07.974 03:17:41 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:17:07.974 03:17:41 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:17:07.974 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:17:07.974 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:17:07.974 altname enp175s0f1np1 00:17:07.974 altname ens801f1np1 00:17:07.974 inet 192.168.100.9/24 scope global cvl_0_1 00:17:07.974 valid_lft forever preferred_lft forever 00:17:07.974 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:17:07.974 valid_lft forever preferred_lft forever 00:17:07.974 03:17:41 -- nvmf/common.sh@411 -- # return 0 00:17:07.974 03:17:41 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:07.974 03:17:41 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:17:07.974 03:17:41 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:17:07.974 03:17:41 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:17:07.974 03:17:41 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:17:07.974 03:17:41 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:07.975 03:17:41 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:07.975 03:17:41 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:07.975 03:17:41 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:07.975 03:17:41 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:07.975 03:17:41 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:07.975 03:17:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:07.975 03:17:41 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:17:07.975 03:17:41 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:17:07.975 03:17:41 -- nvmf/common.sh@105 -- # continue 2 00:17:07.975 03:17:41 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:07.975 03:17:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:07.975 03:17:41 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:17:07.975 03:17:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:07.975 03:17:41 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:17:07.975 03:17:41 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:17:07.975 03:17:41 -- nvmf/common.sh@105 -- # continue 2 00:17:07.975 03:17:41 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:07.975 03:17:41 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:17:07.975 03:17:41 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:17:07.975 03:17:41 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:17:07.975 03:17:41 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:07.975 03:17:41 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:07.975 03:17:41 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:07.975 03:17:41 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:17:07.975 03:17:41 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:17:07.975 03:17:41 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:17:07.975 03:17:41 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:07.975 03:17:41 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:07.975 03:17:41 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:17:07.975 192.168.100.9' 00:17:07.975 03:17:41 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:17:07.975 192.168.100.9' 00:17:07.975 03:17:41 -- nvmf/common.sh@446 -- # head -n 1 00:17:07.975 03:17:41 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:17:07.975 03:17:41 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:17:07.975 192.168.100.9' 00:17:07.975 03:17:41 -- nvmf/common.sh@447 -- # tail -n +2 00:17:07.975 03:17:41 -- nvmf/common.sh@447 -- # head -n 1 00:17:07.975 03:17:41 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:17:07.975 03:17:41 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:17:07.975 03:17:41 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:17:07.975 03:17:41 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:17:07.975 03:17:41 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:17:07.975 03:17:41 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:17:07.975 03:17:41 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:17:07.975 03:17:41 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:07.975 03:17:41 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:07.975 03:17:41 -- common/autotest_common.sh@10 -- # set +x 00:17:07.975 03:17:41 -- nvmf/common.sh@470 -- # nvmfpid=4091766 00:17:07.975 03:17:41 -- nvmf/common.sh@471 -- # waitforlisten 4091766 00:17:07.975 03:17:41 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:17:07.975 03:17:41 -- common/autotest_common.sh@817 -- # '[' -z 4091766 ']' 00:17:07.975 03:17:41 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:07.975 03:17:41 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:07.975 03:17:41 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:07.975 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:07.975 03:17:41 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:07.975 03:17:41 -- common/autotest_common.sh@10 -- # set +x 00:17:07.975 [2024-04-25 03:17:41.986477] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:17:07.975 [2024-04-25 03:17:41.986523] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:07.975 EAL: No free 2048 kB hugepages reported on node 1 00:17:07.975 [2024-04-25 03:17:42.046422] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:07.975 [2024-04-25 03:17:42.115330] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:07.975 [2024-04-25 03:17:42.115374] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:07.975 [2024-04-25 03:17:42.115382] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:07.975 [2024-04-25 03:17:42.115388] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:07.975 [2024-04-25 03:17:42.115397] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:07.975 [2024-04-25 03:17:42.115488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:07.975 [2024-04-25 03:17:42.115604] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:07.975 [2024-04-25 03:17:42.115698] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:07.975 [2024-04-25 03:17:42.115700] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:08.543 03:17:42 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:08.543 03:17:42 -- common/autotest_common.sh@850 -- # return 0 00:17:08.543 03:17:42 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:08.543 03:17:42 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:08.543 03:17:42 -- common/autotest_common.sh@10 -- # set +x 00:17:08.543 03:17:42 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:08.543 03:17:42 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:17:08.543 [2024-04-25 03:17:42.984616] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x1352ea0/0x13524e0) succeed. 00:17:08.543 [2024-04-25 03:17:42.994570] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x1354210/0x1352a60) succeed. 00:17:08.543 [2024-04-25 03:17:42.994592] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:17:08.543 03:17:43 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:08.801 03:17:43 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:17:08.801 03:17:43 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:09.058 03:17:43 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:17:09.058 03:17:43 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:09.316 03:17:43 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:17:09.316 03:17:43 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:09.316 03:17:43 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:17:09.316 03:17:43 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:17:09.575 03:17:43 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:09.833 03:17:44 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:17:09.833 03:17:44 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:10.092 03:17:44 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:17:10.092 03:17:44 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:10.092 03:17:44 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:17:10.092 03:17:44 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:17:10.350 03:17:44 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:17:10.609 03:17:44 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:17:10.609 03:17:44 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:10.609 03:17:45 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:17:10.609 03:17:45 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:17:10.868 03:17:45 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:17:11.126 [2024-04-25 03:17:45.402900] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:17:11.126 03:17:45 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:17:11.126 03:17:45 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:17:11.385 03:17:45 -- target/fio.sh@46 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:17:11.644 03:17:45 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:17:11.644 03:17:45 -- common/autotest_common.sh@1184 -- # local i=0 00:17:11.644 03:17:45 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:17:11.644 03:17:45 -- common/autotest_common.sh@1186 -- # [[ -n 4 ]] 00:17:11.644 03:17:45 -- common/autotest_common.sh@1187 -- # nvme_device_counter=4 00:17:11.644 03:17:45 -- common/autotest_common.sh@1191 -- # sleep 2 00:17:13.550 03:17:47 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:17:13.550 03:17:47 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:17:13.550 03:17:47 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:17:13.550 03:17:48 -- common/autotest_common.sh@1193 -- # nvme_devices=4 00:17:13.550 03:17:48 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:17:13.550 03:17:48 -- common/autotest_common.sh@1194 -- # return 0 00:17:13.550 03:17:48 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:17:13.550 [global] 00:17:13.550 thread=1 00:17:13.550 invalidate=1 00:17:13.550 rw=write 00:17:13.550 time_based=1 00:17:13.550 runtime=1 00:17:13.550 ioengine=libaio 00:17:13.550 direct=1 00:17:13.550 bs=4096 00:17:13.550 iodepth=1 00:17:13.550 norandommap=0 00:17:13.550 numjobs=1 00:17:13.550 00:17:13.550 verify_dump=1 00:17:13.550 verify_backlog=512 00:17:13.550 verify_state_save=0 00:17:13.550 do_verify=1 00:17:13.550 verify=crc32c-intel 00:17:13.550 [job0] 00:17:13.550 filename=/dev/nvme0n1 00:17:13.550 [job1] 00:17:13.550 filename=/dev/nvme0n2 00:17:13.550 [job2] 00:17:13.550 filename=/dev/nvme0n3 00:17:13.550 [job3] 00:17:13.550 filename=/dev/nvme0n4 00:17:13.815 Could not set queue depth (nvme0n1) 00:17:13.815 Could not set queue depth (nvme0n2) 00:17:13.815 Could not set queue depth (nvme0n3) 00:17:13.815 Could not set queue depth (nvme0n4) 00:17:14.072 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:14.072 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:14.072 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:14.072 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:14.072 fio-3.35 00:17:14.072 Starting 4 threads 00:17:15.441 00:17:15.441 job0: (groupid=0, jobs=1): err= 0: pid=4092948: Thu Apr 25 03:17:49 2024 00:17:15.441 read: IOPS=5114, BW=20.0MiB/s (20.9MB/s)(20.0MiB/1001msec) 00:17:15.441 slat (nsec): min=6206, max=24605, avg=7274.00, stdev=735.98 00:17:15.441 clat (usec): min=65, max=165, avg=84.89, stdev= 6.12 00:17:15.441 lat (usec): min=74, max=173, avg=92.17, stdev= 6.13 00:17:15.441 clat percentiles (usec): 00:17:15.441 | 1.00th=[ 73], 5.00th=[ 76], 10.00th=[ 78], 20.00th=[ 80], 00:17:15.441 | 30.00th=[ 82], 40.00th=[ 84], 50.00th=[ 85], 60.00th=[ 87], 00:17:15.441 | 70.00th=[ 88], 80.00th=[ 90], 90.00th=[ 93], 95.00th=[ 95], 00:17:15.441 | 99.00th=[ 100], 99.50th=[ 102], 99.90th=[ 111], 99.95th=[ 119], 00:17:15.441 | 99.99th=[ 165] 00:17:15.441 write: IOPS=5562, BW=21.7MiB/s (22.8MB/s)(21.8MiB/1001msec); 0 zone resets 00:17:15.441 slat (nsec): min=8298, max=85879, avg=9298.63, stdev=1405.52 00:17:15.441 clat (usec): min=65, max=252, avg=81.75, stdev= 6.24 00:17:15.441 lat (usec): min=74, max=262, avg=91.05, stdev= 6.43 00:17:15.441 clat percentiles (usec): 00:17:15.441 | 1.00th=[ 71], 5.00th=[ 74], 10.00th=[ 75], 20.00th=[ 78], 00:17:15.441 | 30.00th=[ 79], 40.00th=[ 81], 50.00th=[ 82], 60.00th=[ 83], 00:17:15.441 | 70.00th=[ 85], 80.00th=[ 87], 90.00th=[ 89], 95.00th=[ 92], 00:17:15.441 | 99.00th=[ 97], 99.50th=[ 99], 99.90th=[ 113], 99.95th=[ 128], 00:17:15.441 | 99.99th=[ 253] 00:17:15.441 bw ( KiB/s): min=22832, max=22832, per=35.98%, avg=22832.00, stdev= 0.00, samples=1 00:17:15.441 iops : min= 5708, max= 5708, avg=5708.00, stdev= 0.00, samples=1 00:17:15.441 lat (usec) : 100=99.27%, 250=0.72%, 500=0.01% 00:17:15.441 cpu : usr=7.00%, sys=10.70%, ctx=10689, majf=0, minf=2 00:17:15.441 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:15.441 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:15.441 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:15.441 issued rwts: total=5120,5568,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:15.441 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:15.441 job1: (groupid=0, jobs=1): err= 0: pid=4092949: Thu Apr 25 03:17:49 2024 00:17:15.441 read: IOPS=3068, BW=12.0MiB/s (12.6MB/s)(12.0MiB/1001msec) 00:17:15.441 slat (nsec): min=6339, max=27807, avg=7412.08, stdev=796.96 00:17:15.441 clat (usec): min=71, max=215, avg=148.37, stdev=21.70 00:17:15.441 lat (usec): min=78, max=222, avg=155.78, stdev=21.71 00:17:15.441 clat percentiles (usec): 00:17:15.441 | 1.00th=[ 79], 5.00th=[ 92], 10.00th=[ 133], 20.00th=[ 141], 00:17:15.441 | 30.00th=[ 143], 40.00th=[ 147], 50.00th=[ 149], 60.00th=[ 153], 00:17:15.441 | 70.00th=[ 155], 80.00th=[ 161], 90.00th=[ 174], 95.00th=[ 182], 00:17:15.441 | 99.00th=[ 204], 99.50th=[ 208], 99.90th=[ 210], 99.95th=[ 215], 00:17:15.441 | 99.99th=[ 217] 00:17:15.441 write: IOPS=3436, BW=13.4MiB/s (14.1MB/s)(13.4MiB/1001msec); 0 zone resets 00:17:15.441 slat (nsec): min=8147, max=41002, avg=9431.13, stdev=1117.53 00:17:15.441 clat (usec): min=67, max=209, avg=138.03, stdev=21.83 00:17:15.441 lat (usec): min=76, max=218, avg=147.47, stdev=21.94 00:17:15.441 clat percentiles (usec): 00:17:15.441 | 1.00th=[ 74], 5.00th=[ 83], 10.00th=[ 120], 20.00th=[ 129], 00:17:15.441 | 30.00th=[ 133], 40.00th=[ 137], 50.00th=[ 139], 60.00th=[ 141], 00:17:15.441 | 70.00th=[ 145], 80.00th=[ 153], 90.00th=[ 163], 95.00th=[ 172], 00:17:15.441 | 99.00th=[ 188], 99.50th=[ 194], 99.90th=[ 198], 99.95th=[ 202], 00:17:15.441 | 99.99th=[ 210] 00:17:15.441 bw ( KiB/s): min=13672, max=13672, per=21.55%, avg=13672.00, stdev= 0.00, samples=1 00:17:15.441 iops : min= 3418, max= 3418, avg=3418.00, stdev= 0.00, samples=1 00:17:15.441 lat (usec) : 100=6.62%, 250=93.38% 00:17:15.441 cpu : usr=4.30%, sys=6.90%, ctx=6512, majf=0, minf=1 00:17:15.441 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:15.441 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:15.442 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:15.442 issued rwts: total=3072,3440,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:15.442 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:15.442 job2: (groupid=0, jobs=1): err= 0: pid=4092950: Thu Apr 25 03:17:49 2024 00:17:15.442 read: IOPS=3068, BW=12.0MiB/s (12.6MB/s)(12.0MiB/1001msec) 00:17:15.442 slat (nsec): min=6393, max=26977, avg=7408.32, stdev=719.59 00:17:15.442 clat (usec): min=76, max=217, avg=148.36, stdev=20.35 00:17:15.442 lat (usec): min=82, max=226, avg=155.76, stdev=20.36 00:17:15.442 clat percentiles (usec): 00:17:15.442 | 1.00th=[ 84], 5.00th=[ 98], 10.00th=[ 133], 20.00th=[ 141], 00:17:15.442 | 30.00th=[ 143], 40.00th=[ 147], 50.00th=[ 149], 60.00th=[ 151], 00:17:15.442 | 70.00th=[ 155], 80.00th=[ 161], 90.00th=[ 172], 95.00th=[ 182], 00:17:15.442 | 99.00th=[ 202], 99.50th=[ 204], 99.90th=[ 212], 99.95th=[ 217], 00:17:15.442 | 99.99th=[ 219] 00:17:15.442 write: IOPS=3439, BW=13.4MiB/s (14.1MB/s)(13.4MiB/1001msec); 0 zone resets 00:17:15.442 slat (nsec): min=8248, max=40934, avg=9517.86, stdev=1097.65 00:17:15.442 clat (usec): min=71, max=206, avg=137.94, stdev=20.01 00:17:15.442 lat (usec): min=81, max=216, avg=147.46, stdev=20.10 00:17:15.442 clat percentiles (usec): 00:17:15.442 | 1.00th=[ 79], 5.00th=[ 90], 10.00th=[ 122], 20.00th=[ 129], 00:17:15.442 | 30.00th=[ 133], 40.00th=[ 137], 50.00th=[ 139], 60.00th=[ 141], 00:17:15.442 | 70.00th=[ 145], 80.00th=[ 151], 90.00th=[ 161], 95.00th=[ 169], 00:17:15.442 | 99.00th=[ 188], 99.50th=[ 192], 99.90th=[ 198], 99.95th=[ 204], 00:17:15.442 | 99.99th=[ 206] 00:17:15.442 bw ( KiB/s): min=13672, max=13672, per=21.55%, avg=13672.00, stdev= 0.00, samples=1 00:17:15.442 iops : min= 3418, max= 3418, avg=3418.00, stdev= 0.00, samples=1 00:17:15.442 lat (usec) : 100=6.42%, 250=93.58% 00:17:15.442 cpu : usr=4.10%, sys=7.10%, ctx=6515, majf=0, minf=1 00:17:15.442 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:15.442 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:15.442 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:15.442 issued rwts: total=3072,3443,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:15.442 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:15.442 job3: (groupid=0, jobs=1): err= 0: pid=4092951: Thu Apr 25 03:17:49 2024 00:17:15.442 read: IOPS=3068, BW=12.0MiB/s (12.6MB/s)(12.0MiB/1001msec) 00:17:15.442 slat (nsec): min=6363, max=23523, avg=7425.94, stdev=894.79 00:17:15.442 clat (usec): min=76, max=220, avg=148.62, stdev=20.62 00:17:15.442 lat (usec): min=83, max=227, avg=156.05, stdev=20.63 00:17:15.442 clat percentiles (usec): 00:17:15.442 | 1.00th=[ 84], 5.00th=[ 96], 10.00th=[ 135], 20.00th=[ 141], 00:17:15.442 | 30.00th=[ 143], 40.00th=[ 147], 50.00th=[ 149], 60.00th=[ 151], 00:17:15.442 | 70.00th=[ 155], 80.00th=[ 161], 90.00th=[ 172], 95.00th=[ 184], 00:17:15.442 | 99.00th=[ 200], 99.50th=[ 206], 99.90th=[ 217], 99.95th=[ 219], 00:17:15.442 | 99.99th=[ 221] 00:17:15.442 write: IOPS=3424, BW=13.4MiB/s (14.0MB/s)(13.4MiB/1001msec); 0 zone resets 00:17:15.442 slat (nsec): min=8335, max=49918, avg=9551.70, stdev=1150.24 00:17:15.442 clat (usec): min=72, max=208, avg=138.26, stdev=20.04 00:17:15.442 lat (usec): min=81, max=218, avg=147.81, stdev=20.17 00:17:15.442 clat percentiles (usec): 00:17:15.442 | 1.00th=[ 81], 5.00th=[ 91], 10.00th=[ 122], 20.00th=[ 130], 00:17:15.442 | 30.00th=[ 133], 40.00th=[ 137], 50.00th=[ 139], 60.00th=[ 141], 00:17:15.442 | 70.00th=[ 145], 80.00th=[ 151], 90.00th=[ 161], 95.00th=[ 172], 00:17:15.442 | 99.00th=[ 188], 99.50th=[ 192], 99.90th=[ 202], 99.95th=[ 206], 00:17:15.442 | 99.99th=[ 208] 00:17:15.442 bw ( KiB/s): min=13640, max=13640, per=21.50%, avg=13640.00, stdev= 0.00, samples=1 00:17:15.442 iops : min= 3410, max= 3410, avg=3410.00, stdev= 0.00, samples=1 00:17:15.442 lat (usec) : 100=6.32%, 250=93.68% 00:17:15.442 cpu : usr=3.90%, sys=7.30%, ctx=6500, majf=0, minf=1 00:17:15.442 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:15.442 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:15.442 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:15.442 issued rwts: total=3072,3428,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:15.442 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:15.442 00:17:15.442 Run status group 0 (all jobs): 00:17:15.442 READ: bw=55.9MiB/s (58.7MB/s), 12.0MiB/s-20.0MiB/s (12.6MB/s-20.9MB/s), io=56.0MiB (58.7MB), run=1001-1001msec 00:17:15.442 WRITE: bw=62.0MiB/s (65.0MB/s), 13.4MiB/s-21.7MiB/s (14.0MB/s-22.8MB/s), io=62.0MiB (65.0MB), run=1001-1001msec 00:17:15.442 00:17:15.442 Disk stats (read/write): 00:17:15.442 nvme0n1: ios=4424/4608, merge=0/0, ticks=349/328, in_queue=677, util=84.97% 00:17:15.442 nvme0n2: ios=2560/2895, merge=0/0, ticks=359/371, in_queue=730, util=86.51% 00:17:15.442 nvme0n3: ios=2560/2897, merge=0/0, ticks=358/379, in_queue=737, util=88.89% 00:17:15.442 nvme0n4: ios=2560/2886, merge=0/0, ticks=363/363, in_queue=726, util=89.55% 00:17:15.442 03:17:49 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:17:15.442 [global] 00:17:15.442 thread=1 00:17:15.442 invalidate=1 00:17:15.442 rw=randwrite 00:17:15.442 time_based=1 00:17:15.442 runtime=1 00:17:15.442 ioengine=libaio 00:17:15.442 direct=1 00:17:15.442 bs=4096 00:17:15.442 iodepth=1 00:17:15.442 norandommap=0 00:17:15.442 numjobs=1 00:17:15.442 00:17:15.442 verify_dump=1 00:17:15.442 verify_backlog=512 00:17:15.442 verify_state_save=0 00:17:15.442 do_verify=1 00:17:15.442 verify=crc32c-intel 00:17:15.442 [job0] 00:17:15.442 filename=/dev/nvme0n1 00:17:15.442 [job1] 00:17:15.442 filename=/dev/nvme0n2 00:17:15.442 [job2] 00:17:15.442 filename=/dev/nvme0n3 00:17:15.442 [job3] 00:17:15.442 filename=/dev/nvme0n4 00:17:15.442 Could not set queue depth (nvme0n1) 00:17:15.442 Could not set queue depth (nvme0n2) 00:17:15.442 Could not set queue depth (nvme0n3) 00:17:15.442 Could not set queue depth (nvme0n4) 00:17:15.442 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:15.442 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:15.442 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:15.442 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:15.442 fio-3.35 00:17:15.442 Starting 4 threads 00:17:16.814 00:17:16.814 job0: (groupid=0, jobs=1): err= 0: pid=4093316: Thu Apr 25 03:17:51 2024 00:17:16.814 read: IOPS=5114, BW=20.0MiB/s (20.9MB/s)(20.0MiB/1001msec) 00:17:16.814 slat (nsec): min=6170, max=23113, avg=7170.40, stdev=656.49 00:17:16.814 clat (usec): min=67, max=160, avg=85.34, stdev=10.60 00:17:16.814 lat (usec): min=74, max=167, avg=92.51, stdev=10.62 00:17:16.815 clat percentiles (usec): 00:17:16.815 | 1.00th=[ 73], 5.00th=[ 75], 10.00th=[ 77], 20.00th=[ 79], 00:17:16.815 | 30.00th=[ 80], 40.00th=[ 82], 50.00th=[ 83], 60.00th=[ 85], 00:17:16.815 | 70.00th=[ 87], 80.00th=[ 90], 90.00th=[ 100], 95.00th=[ 112], 00:17:16.815 | 99.00th=[ 122], 99.50th=[ 125], 99.90th=[ 137], 99.95th=[ 147], 00:17:16.815 | 99.99th=[ 161] 00:17:16.815 write: IOPS=5514, BW=21.5MiB/s (22.6MB/s)(21.6MiB/1001msec); 0 zone resets 00:17:16.815 slat (nsec): min=7916, max=48181, avg=8928.78, stdev=976.39 00:17:16.815 clat (usec): min=62, max=164, avg=82.72, stdev=10.25 00:17:16.815 lat (usec): min=73, max=199, avg=91.64, stdev=10.35 00:17:16.815 clat percentiles (usec): 00:17:16.815 | 1.00th=[ 70], 5.00th=[ 73], 10.00th=[ 75], 20.00th=[ 77], 00:17:16.815 | 30.00th=[ 78], 40.00th=[ 80], 50.00th=[ 81], 60.00th=[ 83], 00:17:16.815 | 70.00th=[ 84], 80.00th=[ 87], 90.00th=[ 94], 95.00th=[ 109], 00:17:16.815 | 99.00th=[ 122], 99.50th=[ 125], 99.90th=[ 145], 99.95th=[ 151], 00:17:16.815 | 99.99th=[ 165] 00:17:16.815 bw ( KiB/s): min=23328, max=23328, per=31.00%, avg=23328.00, stdev= 0.00, samples=1 00:17:16.815 iops : min= 5832, max= 5832, avg=5832.00, stdev= 0.00, samples=1 00:17:16.815 lat (usec) : 100=91.45%, 250=8.55% 00:17:16.815 cpu : usr=6.30%, sys=11.10%, ctx=10640, majf=0, minf=2 00:17:16.815 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:16.815 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:16.815 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:16.815 issued rwts: total=5120,5520,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:16.815 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:16.815 job1: (groupid=0, jobs=1): err= 0: pid=4093317: Thu Apr 25 03:17:51 2024 00:17:16.815 read: IOPS=3982, BW=15.6MiB/s (16.3MB/s)(15.6MiB/1001msec) 00:17:16.815 slat (nsec): min=5765, max=29807, avg=6996.53, stdev=895.92 00:17:16.815 clat (usec): min=69, max=207, avg=112.00, stdev=28.55 00:17:16.815 lat (usec): min=75, max=214, avg=118.99, stdev=28.59 00:17:16.815 clat percentiles (usec): 00:17:16.815 | 1.00th=[ 74], 5.00th=[ 78], 10.00th=[ 81], 20.00th=[ 85], 00:17:16.815 | 30.00th=[ 89], 40.00th=[ 94], 50.00th=[ 105], 60.00th=[ 125], 00:17:16.815 | 70.00th=[ 135], 80.00th=[ 141], 90.00th=[ 147], 95.00th=[ 155], 00:17:16.815 | 99.00th=[ 186], 99.50th=[ 192], 99.90th=[ 204], 99.95th=[ 206], 00:17:16.815 | 99.99th=[ 208] 00:17:16.815 write: IOPS=4091, BW=16.0MiB/s (16.8MB/s)(16.0MiB/1001msec); 0 zone resets 00:17:16.815 slat (nsec): min=7720, max=54631, avg=8962.17, stdev=1398.57 00:17:16.815 clat (usec): min=64, max=200, avg=115.31, stdev=23.67 00:17:16.815 lat (usec): min=73, max=209, avg=124.27, stdev=23.70 00:17:16.815 clat percentiles (usec): 00:17:16.815 | 1.00th=[ 74], 5.00th=[ 78], 10.00th=[ 82], 20.00th=[ 88], 00:17:16.815 | 30.00th=[ 100], 40.00th=[ 114], 50.00th=[ 121], 60.00th=[ 126], 00:17:16.815 | 70.00th=[ 130], 80.00th=[ 135], 90.00th=[ 141], 95.00th=[ 147], 00:17:16.815 | 99.00th=[ 174], 99.50th=[ 182], 99.90th=[ 192], 99.95th=[ 194], 00:17:16.815 | 99.99th=[ 200] 00:17:16.815 bw ( KiB/s): min=16384, max=16384, per=21.77%, avg=16384.00, stdev= 0.00, samples=1 00:17:16.815 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=1 00:17:16.815 lat (usec) : 100=38.37%, 250=61.63% 00:17:16.815 cpu : usr=5.60%, sys=7.40%, ctx=8082, majf=0, minf=1 00:17:16.815 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:16.815 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:16.815 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:16.815 issued rwts: total=3986,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:16.815 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:16.815 job2: (groupid=0, jobs=1): err= 0: pid=4093322: Thu Apr 25 03:17:51 2024 00:17:16.815 read: IOPS=4777, BW=18.7MiB/s (19.6MB/s)(18.7MiB/1001msec) 00:17:16.815 slat (nsec): min=6345, max=30344, avg=7292.55, stdev=666.46 00:17:16.815 clat (usec): min=72, max=129, avg=91.73, stdev= 6.57 00:17:16.815 lat (usec): min=83, max=137, avg=99.03, stdev= 6.60 00:17:16.815 clat percentiles (usec): 00:17:16.815 | 1.00th=[ 80], 5.00th=[ 83], 10.00th=[ 85], 20.00th=[ 87], 00:17:16.815 | 30.00th=[ 88], 40.00th=[ 90], 50.00th=[ 91], 60.00th=[ 93], 00:17:16.815 | 70.00th=[ 95], 80.00th=[ 97], 90.00th=[ 100], 95.00th=[ 104], 00:17:16.815 | 99.00th=[ 113], 99.50th=[ 115], 99.90th=[ 120], 99.95th=[ 120], 00:17:16.815 | 99.99th=[ 130] 00:17:16.815 write: IOPS=5114, BW=20.0MiB/s (20.9MB/s)(20.0MiB/1001msec); 0 zone resets 00:17:16.815 slat (nsec): min=8073, max=63882, avg=9102.36, stdev=1118.37 00:17:16.815 clat (usec): min=73, max=150, avg=89.93, stdev= 8.60 00:17:16.815 lat (usec): min=81, max=205, avg=99.03, stdev= 8.78 00:17:16.815 clat percentiles (usec): 00:17:16.815 | 1.00th=[ 78], 5.00th=[ 81], 10.00th=[ 82], 20.00th=[ 84], 00:17:16.815 | 30.00th=[ 86], 40.00th=[ 87], 50.00th=[ 89], 60.00th=[ 90], 00:17:16.815 | 70.00th=[ 92], 80.00th=[ 95], 90.00th=[ 100], 95.00th=[ 108], 00:17:16.815 | 99.00th=[ 122], 99.50th=[ 128], 99.90th=[ 141], 99.95th=[ 149], 00:17:16.815 | 99.99th=[ 151] 00:17:16.815 bw ( KiB/s): min=20480, max=20480, per=27.21%, avg=20480.00, stdev= 0.00, samples=1 00:17:16.815 iops : min= 5120, max= 5120, avg=5120.00, stdev= 0.00, samples=1 00:17:16.815 lat (usec) : 100=89.80%, 250=10.20% 00:17:16.815 cpu : usr=5.70%, sys=10.80%, ctx=9902, majf=0, minf=1 00:17:16.815 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:16.815 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:16.815 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:16.815 issued rwts: total=4782,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:16.815 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:16.815 job3: (groupid=0, jobs=1): err= 0: pid=4093323: Thu Apr 25 03:17:51 2024 00:17:16.815 read: IOPS=3882, BW=15.2MiB/s (15.9MB/s)(15.2MiB/1001msec) 00:17:16.815 slat (nsec): min=4422, max=29928, avg=6095.33, stdev=1256.52 00:17:16.815 clat (usec): min=81, max=284, avg=119.11, stdev=26.74 00:17:16.815 lat (usec): min=88, max=290, avg=125.20, stdev=26.32 00:17:16.815 clat percentiles (usec): 00:17:16.815 | 1.00th=[ 86], 5.00th=[ 90], 10.00th=[ 92], 20.00th=[ 96], 00:17:16.815 | 30.00th=[ 99], 40.00th=[ 103], 50.00th=[ 109], 60.00th=[ 122], 00:17:16.815 | 70.00th=[ 139], 80.00th=[ 145], 90.00th=[ 155], 95.00th=[ 172], 00:17:16.815 | 99.00th=[ 190], 99.50th=[ 192], 99.90th=[ 204], 99.95th=[ 215], 00:17:16.815 | 99.99th=[ 285] 00:17:16.815 write: IOPS=4091, BW=16.0MiB/s (16.8MB/s)(16.0MiB/1001msec); 0 zone resets 00:17:16.815 slat (nsec): min=4900, max=71959, avg=7327.93, stdev=2203.24 00:17:16.815 clat (usec): min=76, max=203, avg=115.07, stdev=25.27 00:17:16.815 lat (usec): min=83, max=218, avg=122.40, stdev=24.29 00:17:16.815 clat percentiles (usec): 00:17:16.815 | 1.00th=[ 82], 5.00th=[ 86], 10.00th=[ 88], 20.00th=[ 91], 00:17:16.815 | 30.00th=[ 95], 40.00th=[ 99], 50.00th=[ 108], 60.00th=[ 126], 00:17:16.815 | 70.00th=[ 133], 80.00th=[ 137], 90.00th=[ 149], 95.00th=[ 163], 00:17:16.815 | 99.00th=[ 178], 99.50th=[ 182], 99.90th=[ 188], 99.95th=[ 192], 00:17:16.815 | 99.99th=[ 204] 00:17:16.815 bw ( KiB/s): min=16384, max=16384, per=21.77%, avg=16384.00, stdev= 0.00, samples=1 00:17:16.815 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=1 00:17:16.815 lat (usec) : 100=38.21%, 250=61.78%, 500=0.01% 00:17:16.815 cpu : usr=2.20%, sys=5.80%, ctx=7982, majf=0, minf=1 00:17:16.815 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:16.815 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:16.815 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:16.815 issued rwts: total=3886,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:16.815 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:16.815 00:17:16.815 Run status group 0 (all jobs): 00:17:16.815 READ: bw=69.4MiB/s (72.7MB/s), 15.2MiB/s-20.0MiB/s (15.9MB/s-20.9MB/s), io=69.4MiB (72.8MB), run=1001-1001msec 00:17:16.815 WRITE: bw=73.5MiB/s (77.1MB/s), 16.0MiB/s-21.5MiB/s (16.8MB/s-22.6MB/s), io=73.6MiB (77.1MB), run=1001-1001msec 00:17:16.815 00:17:16.815 Disk stats (read/write): 00:17:16.815 nvme0n1: ios=4371/4608, merge=0/0, ticks=338/348, in_queue=686, util=82.57% 00:17:16.815 nvme0n2: ios=3072/3300, merge=0/0, ticks=347/365, in_queue=712, util=83.71% 00:17:16.815 nvme0n3: ios=3981/4096, merge=0/0, ticks=342/335, in_queue=677, util=87.55% 00:17:16.815 nvme0n4: ios=3072/3153, merge=0/0, ticks=383/363, in_queue=746, util=89.18% 00:17:16.815 03:17:51 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:17:16.815 [global] 00:17:16.815 thread=1 00:17:16.815 invalidate=1 00:17:16.815 rw=write 00:17:16.815 time_based=1 00:17:16.815 runtime=1 00:17:16.815 ioengine=libaio 00:17:16.815 direct=1 00:17:16.815 bs=4096 00:17:16.815 iodepth=128 00:17:16.815 norandommap=0 00:17:16.815 numjobs=1 00:17:16.815 00:17:16.815 verify_dump=1 00:17:16.815 verify_backlog=512 00:17:16.815 verify_state_save=0 00:17:16.815 do_verify=1 00:17:16.815 verify=crc32c-intel 00:17:16.815 [job0] 00:17:16.815 filename=/dev/nvme0n1 00:17:16.815 [job1] 00:17:16.815 filename=/dev/nvme0n2 00:17:16.815 [job2] 00:17:16.815 filename=/dev/nvme0n3 00:17:16.815 [job3] 00:17:16.815 filename=/dev/nvme0n4 00:17:16.815 Could not set queue depth (nvme0n1) 00:17:16.815 Could not set queue depth (nvme0n2) 00:17:16.815 Could not set queue depth (nvme0n3) 00:17:16.815 Could not set queue depth (nvme0n4) 00:17:17.073 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:17.073 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:17.073 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:17.073 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:17.073 fio-3.35 00:17:17.073 Starting 4 threads 00:17:18.446 00:17:18.446 job0: (groupid=0, jobs=1): err= 0: pid=4093702: Thu Apr 25 03:17:52 2024 00:17:18.446 read: IOPS=9698, BW=37.9MiB/s (39.7MB/s)(38.0MiB/1003msec) 00:17:18.446 slat (nsec): min=1389, max=1069.3k, avg=52008.07, stdev=193073.49 00:17:18.446 clat (usec): min=3936, max=8381, avg=6756.92, stdev=302.34 00:17:18.446 lat (usec): min=3941, max=8388, avg=6808.92, stdev=269.43 00:17:18.446 clat percentiles (usec): 00:17:18.446 | 1.00th=[ 5866], 5.00th=[ 6063], 10.00th=[ 6456], 20.00th=[ 6587], 00:17:18.446 | 30.00th=[ 6718], 40.00th=[ 6783], 50.00th=[ 6783], 60.00th=[ 6849], 00:17:18.446 | 70.00th=[ 6915], 80.00th=[ 6980], 90.00th=[ 7046], 95.00th=[ 7111], 00:17:18.446 | 99.00th=[ 7242], 99.50th=[ 7439], 99.90th=[ 8291], 99.95th=[ 8356], 00:17:18.446 | 99.99th=[ 8356] 00:17:18.446 write: IOPS=9742, BW=38.1MiB/s (39.9MB/s)(38.2MiB/1003msec); 0 zone resets 00:17:18.446 slat (nsec): min=1940, max=1247.6k, avg=48651.60, stdev=178053.49 00:17:18.446 clat (usec): min=1536, max=7279, avg=6279.61, stdev=331.30 00:17:18.446 lat (usec): min=2399, max=7582, avg=6328.26, stdev=323.15 00:17:18.446 clat percentiles (usec): 00:17:18.446 | 1.00th=[ 5342], 5.00th=[ 5735], 10.00th=[ 6063], 20.00th=[ 6194], 00:17:18.446 | 30.00th=[ 6259], 40.00th=[ 6259], 50.00th=[ 6325], 60.00th=[ 6325], 00:17:18.446 | 70.00th=[ 6390], 80.00th=[ 6456], 90.00th=[ 6521], 95.00th=[ 6587], 00:17:18.446 | 99.00th=[ 6783], 99.50th=[ 6915], 99.90th=[ 7111], 99.95th=[ 7111], 00:17:18.446 | 99.99th=[ 7308] 00:17:18.446 bw ( KiB/s): min=37544, max=40280, per=35.71%, avg=38912.00, stdev=1934.64, samples=2 00:17:18.446 iops : min= 9386, max=10070, avg=9728.00, stdev=483.66, samples=2 00:17:18.446 lat (msec) : 2=0.01%, 4=0.25%, 10=99.75% 00:17:18.446 cpu : usr=2.79%, sys=4.79%, ctx=1224, majf=0, minf=1 00:17:18.446 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.7% 00:17:18.446 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:18.446 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:18.446 issued rwts: total=9728,9772,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:18.446 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:18.446 job1: (groupid=0, jobs=1): err= 0: pid=4093710: Thu Apr 25 03:17:52 2024 00:17:18.446 read: IOPS=4300, BW=16.8MiB/s (17.6MB/s)(16.8MiB/1003msec) 00:17:18.446 slat (nsec): min=1396, max=1835.6k, avg=114050.67, stdev=300589.51 00:17:18.446 clat (usec): min=2203, max=17164, avg=14491.32, stdev=1156.21 00:17:18.446 lat (usec): min=2927, max=17167, avg=14605.37, stdev=1118.74 00:17:18.446 clat percentiles (usec): 00:17:18.446 | 1.00th=[ 7832], 5.00th=[13698], 10.00th=[13960], 20.00th=[14353], 00:17:18.446 | 30.00th=[14484], 40.00th=[14615], 50.00th=[14746], 60.00th=[14746], 00:17:18.446 | 70.00th=[14877], 80.00th=[14877], 90.00th=[15008], 95.00th=[15139], 00:17:18.446 | 99.00th=[15270], 99.50th=[15270], 99.90th=[17171], 99.95th=[17171], 00:17:18.446 | 99.99th=[17171] 00:17:18.446 write: IOPS=4594, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1003msec); 0 zone resets 00:17:18.446 slat (usec): min=2, max=2492, avg=107.61, stdev=291.22 00:17:18.446 clat (usec): min=10660, max=14849, avg=13929.38, stdev=409.63 00:17:18.446 lat (usec): min=10701, max=14853, avg=14036.99, stdev=289.69 00:17:18.446 clat percentiles (usec): 00:17:18.446 | 1.00th=[12518], 5.00th=[13173], 10.00th=[13304], 20.00th=[13698], 00:17:18.446 | 30.00th=[13829], 40.00th=[13960], 50.00th=[13960], 60.00th=[14091], 00:17:18.446 | 70.00th=[14091], 80.00th=[14222], 90.00th=[14353], 95.00th=[14484], 00:17:18.446 | 99.00th=[14746], 99.50th=[14877], 99.90th=[14877], 99.95th=[14877], 00:17:18.446 | 99.99th=[14877] 00:17:18.447 bw ( KiB/s): min=18424, max=18440, per=16.91%, avg=18432.00, stdev=11.31, samples=2 00:17:18.447 iops : min= 4606, max= 4610, avg=4608.00, stdev= 2.83, samples=2 00:17:18.447 lat (msec) : 4=0.20%, 10=0.53%, 20=99.27% 00:17:18.447 cpu : usr=2.30%, sys=2.99%, ctx=1100, majf=0, minf=1 00:17:18.447 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:17:18.447 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:18.447 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:18.447 issued rwts: total=4313,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:18.447 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:18.447 job2: (groupid=0, jobs=1): err= 0: pid=4093729: Thu Apr 25 03:17:52 2024 00:17:18.447 read: IOPS=4297, BW=16.8MiB/s (17.6MB/s)(16.8MiB/1003msec) 00:17:18.447 slat (nsec): min=1366, max=1831.9k, avg=113982.83, stdev=299245.98 00:17:18.447 clat (usec): min=2145, max=17149, avg=14500.09, stdev=1129.98 00:17:18.447 lat (usec): min=2949, max=17152, avg=14614.08, stdev=1090.75 00:17:18.447 clat percentiles (usec): 00:17:18.447 | 1.00th=[ 7767], 5.00th=[13698], 10.00th=[13960], 20.00th=[14353], 00:17:18.447 | 30.00th=[14484], 40.00th=[14615], 50.00th=[14746], 60.00th=[14746], 00:17:18.447 | 70.00th=[14877], 80.00th=[14877], 90.00th=[15008], 95.00th=[15139], 00:17:18.447 | 99.00th=[15270], 99.50th=[15401], 99.90th=[17171], 99.95th=[17171], 00:17:18.447 | 99.99th=[17171] 00:17:18.447 write: IOPS=4594, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1003msec); 0 zone resets 00:17:18.447 slat (usec): min=2, max=2453, avg=107.51, stdev=289.77 00:17:18.447 clat (usec): min=10661, max=14841, avg=13930.51, stdev=406.90 00:17:18.447 lat (usec): min=10701, max=14845, avg=14038.01, stdev=287.15 00:17:18.447 clat percentiles (usec): 00:17:18.447 | 1.00th=[12649], 5.00th=[13173], 10.00th=[13304], 20.00th=[13698], 00:17:18.447 | 30.00th=[13829], 40.00th=[13960], 50.00th=[13960], 60.00th=[14091], 00:17:18.447 | 70.00th=[14091], 80.00th=[14222], 90.00th=[14353], 95.00th=[14484], 00:17:18.447 | 99.00th=[14746], 99.50th=[14877], 99.90th=[14877], 99.95th=[14877], 00:17:18.447 | 99.99th=[14877] 00:17:18.447 bw ( KiB/s): min=18424, max=18440, per=16.91%, avg=18432.00, stdev=11.31, samples=2 00:17:18.447 iops : min= 4606, max= 4610, avg=4608.00, stdev= 2.83, samples=2 00:17:18.447 lat (msec) : 4=0.17%, 10=0.56%, 20=99.27% 00:17:18.447 cpu : usr=1.50%, sys=3.79%, ctx=1122, majf=0, minf=1 00:17:18.447 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:17:18.447 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:18.447 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:18.447 issued rwts: total=4310,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:18.447 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:18.447 job3: (groupid=0, jobs=1): err= 0: pid=4093735: Thu Apr 25 03:17:52 2024 00:17:18.447 read: IOPS=8175, BW=31.9MiB/s (33.5MB/s)(32.0MiB/1002msec) 00:17:18.447 slat (nsec): min=1454, max=2477.7k, avg=61046.59, stdev=267025.57 00:17:18.447 clat (usec): min=6152, max=10557, avg=7883.85, stdev=334.49 00:17:18.447 lat (usec): min=6736, max=10569, avg=7944.90, stdev=323.92 00:17:18.447 clat percentiles (usec): 00:17:18.447 | 1.00th=[ 6849], 5.00th=[ 7373], 10.00th=[ 7504], 20.00th=[ 7701], 00:17:18.447 | 30.00th=[ 7767], 40.00th=[ 7832], 50.00th=[ 7898], 60.00th=[ 7963], 00:17:18.447 | 70.00th=[ 8029], 80.00th=[ 8094], 90.00th=[ 8160], 95.00th=[ 8225], 00:17:18.447 | 99.00th=[ 8455], 99.50th=[ 9896], 99.90th=[10290], 99.95th=[10421], 00:17:18.447 | 99.99th=[10552] 00:17:18.447 write: IOPS=8319, BW=32.5MiB/s (34.1MB/s)(32.6MiB/1002msec); 0 zone resets 00:17:18.447 slat (usec): min=2, max=2441, avg=57.85, stdev=251.38 00:17:18.447 clat (usec): min=822, max=10281, avg=7467.94, stdev=549.24 00:17:18.447 lat (usec): min=1560, max=10290, avg=7525.79, stdev=543.77 00:17:18.447 clat percentiles (usec): 00:17:18.447 | 1.00th=[ 5473], 5.00th=[ 6849], 10.00th=[ 7177], 20.00th=[ 7308], 00:17:18.447 | 30.00th=[ 7373], 40.00th=[ 7439], 50.00th=[ 7504], 60.00th=[ 7570], 00:17:18.447 | 70.00th=[ 7635], 80.00th=[ 7767], 90.00th=[ 7898], 95.00th=[ 7963], 00:17:18.447 | 99.00th=[ 8160], 99.50th=[ 9372], 99.90th=[ 9765], 99.95th=[ 9896], 00:17:18.447 | 99.99th=[10290] 00:17:18.447 bw ( KiB/s): min=32768, max=32768, per=30.07%, avg=32768.00, stdev= 0.00, samples=1 00:17:18.447 iops : min= 8192, max= 8192, avg=8192.00, stdev= 0.00, samples=1 00:17:18.447 lat (usec) : 1000=0.01% 00:17:18.447 lat (msec) : 2=0.10%, 4=0.18%, 10=99.50%, 20=0.22% 00:17:18.447 cpu : usr=2.70%, sys=4.70%, ctx=973, majf=0, minf=1 00:17:18.447 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:17:18.447 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:18.447 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:18.447 issued rwts: total=8192,8336,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:18.447 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:18.447 00:17:18.447 Run status group 0 (all jobs): 00:17:18.447 READ: bw=103MiB/s (108MB/s), 16.8MiB/s-37.9MiB/s (17.6MB/s-39.7MB/s), io=104MiB (109MB), run=1002-1003msec 00:17:18.447 WRITE: bw=106MiB/s (112MB/s), 17.9MiB/s-38.1MiB/s (18.8MB/s-39.9MB/s), io=107MiB (112MB), run=1002-1003msec 00:17:18.447 00:17:18.447 Disk stats (read/write): 00:17:18.447 nvme0n1: ios=8242/8348, merge=0/0, ticks=27444/25838, in_queue=53282, util=86.27% 00:17:18.447 nvme0n2: ios=3584/4000, merge=0/0, ticks=13195/13916, in_queue=27111, util=86.69% 00:17:18.447 nvme0n3: ios=3584/4000, merge=0/0, ticks=13173/13885, in_queue=27058, util=88.95% 00:17:18.447 nvme0n4: ios=6885/7168, merge=0/0, ticks=17670/17422, in_queue=35092, util=89.70% 00:17:18.447 03:17:52 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:17:18.447 [global] 00:17:18.447 thread=1 00:17:18.447 invalidate=1 00:17:18.447 rw=randwrite 00:17:18.447 time_based=1 00:17:18.447 runtime=1 00:17:18.447 ioengine=libaio 00:17:18.447 direct=1 00:17:18.447 bs=4096 00:17:18.447 iodepth=128 00:17:18.447 norandommap=0 00:17:18.447 numjobs=1 00:17:18.447 00:17:18.447 verify_dump=1 00:17:18.447 verify_backlog=512 00:17:18.447 verify_state_save=0 00:17:18.447 do_verify=1 00:17:18.447 verify=crc32c-intel 00:17:18.447 [job0] 00:17:18.447 filename=/dev/nvme0n1 00:17:18.447 [job1] 00:17:18.447 filename=/dev/nvme0n2 00:17:18.447 [job2] 00:17:18.447 filename=/dev/nvme0n3 00:17:18.447 [job3] 00:17:18.447 filename=/dev/nvme0n4 00:17:18.447 Could not set queue depth (nvme0n1) 00:17:18.447 Could not set queue depth (nvme0n2) 00:17:18.447 Could not set queue depth (nvme0n3) 00:17:18.447 Could not set queue depth (nvme0n4) 00:17:18.704 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:18.704 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:18.704 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:18.704 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:18.704 fio-3.35 00:17:18.704 Starting 4 threads 00:17:20.082 00:17:20.082 job0: (groupid=0, jobs=1): err= 0: pid=4094176: Thu Apr 25 03:17:54 2024 00:17:20.082 read: IOPS=4088, BW=16.0MiB/s (16.7MB/s)(16.1MiB/1005msec) 00:17:20.082 slat (nsec): min=1653, max=1072.0k, avg=117058.49, stdev=300469.02 00:17:20.082 clat (usec): min=2730, max=16578, avg=15002.69, stdev=787.26 00:17:20.082 lat (usec): min=3601, max=16738, avg=15119.75, stdev=772.29 00:17:20.082 clat percentiles (usec): 00:17:20.082 | 1.00th=[13698], 5.00th=[14091], 10.00th=[14353], 20.00th=[14746], 00:17:20.082 | 30.00th=[14877], 40.00th=[15008], 50.00th=[15139], 60.00th=[15270], 00:17:20.082 | 70.00th=[15270], 80.00th=[15401], 90.00th=[15533], 95.00th=[15664], 00:17:20.082 | 99.00th=[16188], 99.50th=[16319], 99.90th=[16450], 99.95th=[16581], 00:17:20.082 | 99.99th=[16581] 00:17:20.082 write: IOPS=4585, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1005msec); 0 zone resets 00:17:20.082 slat (usec): min=2, max=1854, avg=110.05, stdev=284.34 00:17:20.082 clat (usec): min=4525, max=17075, avg=14167.36, stdev=926.67 00:17:20.082 lat (usec): min=4528, max=17980, avg=14277.41, stdev=925.09 00:17:20.082 clat percentiles (usec): 00:17:20.082 | 1.00th=[ 9896], 5.00th=[13304], 10.00th=[13566], 20.00th=[13829], 00:17:20.082 | 30.00th=[14091], 40.00th=[14222], 50.00th=[14353], 60.00th=[14353], 00:17:20.082 | 70.00th=[14484], 80.00th=[14615], 90.00th=[14746], 95.00th=[15008], 00:17:20.082 | 99.00th=[15401], 99.50th=[15664], 99.90th=[17171], 99.95th=[17171], 00:17:20.082 | 99.99th=[17171] 00:17:20.082 bw ( KiB/s): min=17664, max=18288, per=16.43%, avg=17976.00, stdev=441.23, samples=2 00:17:20.082 iops : min= 4416, max= 4572, avg=4494.00, stdev=110.31, samples=2 00:17:20.082 lat (msec) : 4=0.09%, 10=0.70%, 20=99.21% 00:17:20.082 cpu : usr=1.69%, sys=3.59%, ctx=1270, majf=0, minf=1 00:17:20.082 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:17:20.082 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:20.082 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:20.082 issued rwts: total=4109,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:20.082 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:20.082 job1: (groupid=0, jobs=1): err= 0: pid=4094190: Thu Apr 25 03:17:54 2024 00:17:20.082 read: IOPS=9708, BW=37.9MiB/s (39.8MB/s)(38.0MiB/1002msec) 00:17:20.082 slat (nsec): min=1332, max=1027.2k, avg=50586.76, stdev=185249.67 00:17:20.082 clat (usec): min=5397, max=7537, avg=6614.77, stdev=246.48 00:17:20.082 lat (usec): min=5400, max=7773, avg=6665.36, stdev=213.76 00:17:20.082 clat percentiles (usec): 00:17:20.082 | 1.00th=[ 5735], 5.00th=[ 5997], 10.00th=[ 6390], 20.00th=[ 6456], 00:17:20.082 | 30.00th=[ 6587], 40.00th=[ 6587], 50.00th=[ 6652], 60.00th=[ 6718], 00:17:20.082 | 70.00th=[ 6718], 80.00th=[ 6783], 90.00th=[ 6849], 95.00th=[ 6915], 00:17:20.082 | 99.00th=[ 7046], 99.50th=[ 7111], 99.90th=[ 7177], 99.95th=[ 7373], 00:17:20.082 | 99.99th=[ 7570] 00:17:20.082 write: IOPS=10.1k, BW=39.3MiB/s (41.2MB/s)(39.4MiB/1002msec); 0 zone resets 00:17:20.082 slat (nsec): min=1885, max=1238.7k, avg=47985.68, stdev=173665.69 00:17:20.082 clat (usec): min=1830, max=8130, avg=6223.02, stdev=343.77 00:17:20.082 lat (usec): min=2609, max=8134, avg=6271.00, stdev=322.87 00:17:20.082 clat percentiles (usec): 00:17:20.082 | 1.00th=[ 5145], 5.00th=[ 5604], 10.00th=[ 5932], 20.00th=[ 6063], 00:17:20.082 | 30.00th=[ 6194], 40.00th=[ 6194], 50.00th=[ 6259], 60.00th=[ 6325], 00:17:20.082 | 70.00th=[ 6390], 80.00th=[ 6456], 90.00th=[ 6521], 95.00th=[ 6587], 00:17:20.082 | 99.00th=[ 6718], 99.50th=[ 6783], 99.90th=[ 8094], 99.95th=[ 8094], 00:17:20.082 | 99.99th=[ 8160] 00:17:20.082 bw ( KiB/s): min=38632, max=40960, per=36.38%, avg=39796.00, stdev=1646.14, samples=2 00:17:20.082 iops : min= 9658, max=10240, avg=9949.00, stdev=411.54, samples=2 00:17:20.082 lat (msec) : 2=0.01%, 4=0.16%, 10=99.83% 00:17:20.082 cpu : usr=3.60%, sys=6.09%, ctx=1259, majf=0, minf=1 00:17:20.082 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.7% 00:17:20.082 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:20.082 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:20.082 issued rwts: total=9728,10076,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:20.082 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:20.082 job2: (groupid=0, jobs=1): err= 0: pid=4094207: Thu Apr 25 03:17:54 2024 00:17:20.082 read: IOPS=4087, BW=16.0MiB/s (16.7MB/s)(16.0MiB/1003msec) 00:17:20.082 slat (nsec): min=1584, max=1127.9k, avg=116760.88, stdev=300286.86 00:17:20.082 clat (usec): min=2731, max=16743, avg=15048.39, stdev=610.70 00:17:20.082 lat (usec): min=3600, max=16747, avg=15165.15, stdev=596.06 00:17:20.082 clat percentiles (usec): 00:17:20.082 | 1.00th=[13829], 5.00th=[14091], 10.00th=[14353], 20.00th=[14746], 00:17:20.082 | 30.00th=[14877], 40.00th=[15008], 50.00th=[15139], 60.00th=[15270], 00:17:20.082 | 70.00th=[15270], 80.00th=[15401], 90.00th=[15664], 95.00th=[15795], 00:17:20.082 | 99.00th=[16188], 99.50th=[16450], 99.90th=[16712], 99.95th=[16712], 00:17:20.082 | 99.99th=[16712] 00:17:20.082 write: IOPS=4594, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1003msec); 0 zone resets 00:17:20.082 slat (usec): min=2, max=2478, avg=110.46, stdev=284.50 00:17:20.082 clat (usec): min=3610, max=17060, avg=14131.58, stdev=1034.54 00:17:20.082 lat (usec): min=3614, max=17064, avg=14242.04, stdev=1029.44 00:17:20.082 clat percentiles (usec): 00:17:20.082 | 1.00th=[ 8979], 5.00th=[13304], 10.00th=[13435], 20.00th=[13698], 00:17:20.082 | 30.00th=[14091], 40.00th=[14222], 50.00th=[14353], 60.00th=[14353], 00:17:20.082 | 70.00th=[14484], 80.00th=[14615], 90.00th=[14746], 95.00th=[15008], 00:17:20.082 | 99.00th=[15401], 99.50th=[15664], 99.90th=[17171], 99.95th=[17171], 00:17:20.082 | 99.99th=[17171] 00:17:20.082 bw ( KiB/s): min=17560, max=18320, per=16.40%, avg=17940.00, stdev=537.40, samples=2 00:17:20.082 iops : min= 4390, max= 4580, avg=4485.00, stdev=134.35, samples=2 00:17:20.082 lat (msec) : 4=0.10%, 10=0.65%, 20=99.24% 00:17:20.082 cpu : usr=1.70%, sys=3.69%, ctx=1245, majf=0, minf=1 00:17:20.082 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:17:20.082 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:20.082 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:20.082 issued rwts: total=4100,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:20.082 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:20.082 job3: (groupid=0, jobs=1): err= 0: pid=4094213: Thu Apr 25 03:17:54 2024 00:17:20.082 read: IOPS=7939, BW=31.0MiB/s (32.5MB/s)(31.1MiB/1002msec) 00:17:20.082 slat (nsec): min=1536, max=1345.6k, avg=62353.76, stdev=231370.70 00:17:20.082 clat (usec): min=1108, max=9260, avg=8022.43, stdev=524.72 00:17:20.082 lat (usec): min=2052, max=9362, avg=8084.79, stdev=474.93 00:17:20.082 clat percentiles (usec): 00:17:20.082 | 1.00th=[ 6063], 5.00th=[ 7242], 10.00th=[ 7767], 20.00th=[ 7898], 00:17:20.082 | 30.00th=[ 7963], 40.00th=[ 8029], 50.00th=[ 8094], 60.00th=[ 8160], 00:17:20.082 | 70.00th=[ 8225], 80.00th=[ 8291], 90.00th=[ 8356], 95.00th=[ 8455], 00:17:20.082 | 99.00th=[ 8455], 99.50th=[ 8586], 99.90th=[ 9110], 99.95th=[ 9110], 00:17:20.082 | 99.99th=[ 9241] 00:17:20.082 write: IOPS=8175, BW=31.9MiB/s (33.5MB/s)(32.0MiB/1002msec); 0 zone resets 00:17:20.082 slat (usec): min=2, max=2138, avg=59.01, stdev=218.59 00:17:20.082 clat (usec): min=5709, max=9039, avg=7691.78, stdev=336.23 00:17:20.082 lat (usec): min=5717, max=9079, avg=7750.79, stdev=260.42 00:17:20.082 clat percentiles (usec): 00:17:20.082 | 1.00th=[ 6587], 5.00th=[ 6980], 10.00th=[ 7373], 20.00th=[ 7504], 00:17:20.082 | 30.00th=[ 7570], 40.00th=[ 7635], 50.00th=[ 7701], 60.00th=[ 7832], 00:17:20.083 | 70.00th=[ 7898], 80.00th=[ 7963], 90.00th=[ 8029], 95.00th=[ 8160], 00:17:20.083 | 99.00th=[ 8291], 99.50th=[ 8356], 99.90th=[ 8848], 99.95th=[ 8848], 00:17:20.083 | 99.99th=[ 8979] 00:17:20.083 bw ( KiB/s): min=32768, max=32768, per=29.96%, avg=32768.00, stdev= 0.00, samples=2 00:17:20.083 iops : min= 8192, max= 8192, avg=8192.00, stdev= 0.00, samples=2 00:17:20.083 lat (msec) : 2=0.01%, 4=0.28%, 10=99.71% 00:17:20.083 cpu : usr=2.70%, sys=5.59%, ctx=1027, majf=0, minf=1 00:17:20.083 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:17:20.083 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:20.083 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:20.083 issued rwts: total=7955,8192,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:20.083 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:20.083 00:17:20.083 Run status group 0 (all jobs): 00:17:20.083 READ: bw=101MiB/s (106MB/s), 16.0MiB/s-37.9MiB/s (16.7MB/s-39.8MB/s), io=101MiB (106MB), run=1002-1005msec 00:17:20.083 WRITE: bw=107MiB/s (112MB/s), 17.9MiB/s-39.3MiB/s (18.8MB/s-41.2MB/s), io=107MiB (113MB), run=1002-1005msec 00:17:20.083 00:17:20.083 Disk stats (read/write): 00:17:20.083 nvme0n1: ios=3634/3819, merge=0/0, ticks=17682/17821, in_queue=35503, util=86.57% 00:17:20.083 nvme0n2: ios=8192/8684, merge=0/0, ticks=26513/26322, in_queue=52835, util=86.80% 00:17:20.083 nvme0n3: ios=3584/3809, merge=0/0, ticks=17733/17731, in_queue=35464, util=88.97% 00:17:20.083 nvme0n4: ios=6656/7080, merge=0/0, ticks=17570/17507, in_queue=35077, util=89.72% 00:17:20.083 03:17:54 -- target/fio.sh@55 -- # sync 00:17:20.083 03:17:54 -- target/fio.sh@59 -- # fio_pid=4094305 00:17:20.083 03:17:54 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:17:20.083 03:17:54 -- target/fio.sh@61 -- # sleep 3 00:17:20.083 [global] 00:17:20.083 thread=1 00:17:20.083 invalidate=1 00:17:20.083 rw=read 00:17:20.083 time_based=1 00:17:20.083 runtime=10 00:17:20.083 ioengine=libaio 00:17:20.083 direct=1 00:17:20.083 bs=4096 00:17:20.083 iodepth=1 00:17:20.083 norandommap=1 00:17:20.083 numjobs=1 00:17:20.083 00:17:20.083 [job0] 00:17:20.083 filename=/dev/nvme0n1 00:17:20.083 [job1] 00:17:20.083 filename=/dev/nvme0n2 00:17:20.083 [job2] 00:17:20.083 filename=/dev/nvme0n3 00:17:20.083 [job3] 00:17:20.083 filename=/dev/nvme0n4 00:17:20.083 Could not set queue depth (nvme0n1) 00:17:20.083 Could not set queue depth (nvme0n2) 00:17:20.083 Could not set queue depth (nvme0n3) 00:17:20.083 Could not set queue depth (nvme0n4) 00:17:20.339 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:20.339 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:20.339 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:20.339 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:20.339 fio-3.35 00:17:20.339 Starting 4 threads 00:17:22.859 03:17:57 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:17:23.116 03:17:57 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:17:23.116 fio: io_u error on file /dev/nvme0n4: Remote I/O error: read offset=68722688, buflen=4096 00:17:23.116 fio: pid=4094644, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:17:23.373 fio: io_u error on file /dev/nvme0n3: Remote I/O error: read offset=73867264, buflen=4096 00:17:23.373 fio: pid=4094643, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:17:23.373 03:17:57 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:23.373 03:17:57 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:17:23.373 fio: io_u error on file /dev/nvme0n1: Remote I/O error: read offset=12947456, buflen=4096 00:17:23.373 fio: pid=4094637, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:17:23.373 03:17:57 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:23.373 03:17:57 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:17:23.630 fio: io_u error on file /dev/nvme0n2: Remote I/O error: read offset=44613632, buflen=4096 00:17:23.630 fio: pid=4094642, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:17:23.630 03:17:58 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:23.630 03:17:58 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:17:23.630 00:17:23.630 job0: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=4094637: Thu Apr 25 03:17:58 2024 00:17:23.630 read: IOPS=6474, BW=25.3MiB/s (26.5MB/s)(76.3MiB/3019msec) 00:17:23.630 slat (usec): min=3, max=32788, avg=11.50, stdev=271.82 00:17:23.630 clat (usec): min=57, max=8681, avg=140.63, stdev=66.30 00:17:23.630 lat (usec): min=64, max=32890, avg=152.13, stdev=279.32 00:17:23.630 clat percentiles (usec): 00:17:23.630 | 1.00th=[ 65], 5.00th=[ 81], 10.00th=[ 88], 20.00th=[ 139], 00:17:23.630 | 30.00th=[ 143], 40.00th=[ 145], 50.00th=[ 147], 60.00th=[ 149], 00:17:23.630 | 70.00th=[ 151], 80.00th=[ 155], 90.00th=[ 161], 95.00th=[ 167], 00:17:23.630 | 99.00th=[ 196], 99.50th=[ 208], 99.90th=[ 221], 99.95th=[ 223], 00:17:23.630 | 99.99th=[ 420] 00:17:23.630 bw ( KiB/s): min=23816, max=25912, per=24.65%, avg=25060.80, stdev=1079.82, samples=5 00:17:23.630 iops : min= 5954, max= 6478, avg=6265.20, stdev=269.95, samples=5 00:17:23.630 lat (usec) : 100=12.29%, 250=87.69%, 500=0.01% 00:17:23.630 lat (msec) : 10=0.01% 00:17:23.630 cpu : usr=3.02%, sys=9.41%, ctx=19552, majf=0, minf=1 00:17:23.630 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:23.630 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:23.630 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:23.630 issued rwts: total=19546,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:23.630 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:23.630 job1: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=4094642: Thu Apr 25 03:17:58 2024 00:17:23.630 read: IOPS=8492, BW=33.2MiB/s (34.8MB/s)(107MiB/3212msec) 00:17:23.630 slat (usec): min=3, max=15691, avg= 9.97, stdev=185.99 00:17:23.630 clat (usec): min=49, max=8679, avg=106.15, stdev=80.17 00:17:23.630 lat (usec): min=56, max=15808, avg=116.12, stdev=202.37 00:17:23.630 clat percentiles (usec): 00:17:23.630 | 1.00th=[ 60], 5.00th=[ 65], 10.00th=[ 72], 20.00th=[ 77], 00:17:23.630 | 30.00th=[ 80], 40.00th=[ 83], 50.00th=[ 86], 60.00th=[ 114], 00:17:23.630 | 70.00th=[ 143], 80.00th=[ 147], 90.00th=[ 149], 95.00th=[ 153], 00:17:23.630 | 99.00th=[ 157], 99.50th=[ 159], 99.90th=[ 165], 99.95th=[ 169], 00:17:23.630 | 99.99th=[ 202] 00:17:23.630 bw ( KiB/s): min=25864, max=45536, per=32.73%, avg=33276.50, stdev=9444.62, samples=6 00:17:23.630 iops : min= 6466, max=11384, avg=8319.00, stdev=2361.19, samples=6 00:17:23.630 lat (usec) : 50=0.01%, 100=58.56%, 250=41.43% 00:17:23.630 lat (msec) : 10=0.01% 00:17:23.630 cpu : usr=2.90%, sys=10.06%, ctx=27284, majf=0, minf=1 00:17:23.630 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:23.630 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:23.630 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:23.630 issued rwts: total=27277,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:23.630 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:23.630 job2: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=4094643: Thu Apr 25 03:17:58 2024 00:17:23.630 read: IOPS=6334, BW=24.7MiB/s (25.9MB/s)(70.4MiB/2847msec) 00:17:23.630 slat (usec): min=3, max=15954, avg=11.37, stdev=166.75 00:17:23.630 clat (usec): min=66, max=246, avg=144.11, stdev=17.99 00:17:23.630 lat (usec): min=77, max=16067, avg=155.48, stdev=167.46 00:17:23.630 clat percentiles (usec): 00:17:23.630 | 1.00th=[ 86], 5.00th=[ 104], 10.00th=[ 135], 20.00th=[ 139], 00:17:23.630 | 30.00th=[ 141], 40.00th=[ 143], 50.00th=[ 145], 60.00th=[ 147], 00:17:23.630 | 70.00th=[ 151], 80.00th=[ 155], 90.00th=[ 161], 95.00th=[ 169], 00:17:23.630 | 99.00th=[ 192], 99.50th=[ 204], 99.90th=[ 217], 99.95th=[ 221], 00:17:23.630 | 99.99th=[ 239] 00:17:23.630 bw ( KiB/s): min=23776, max=25912, per=24.65%, avg=25057.60, stdev=1055.05, samples=5 00:17:23.630 iops : min= 5944, max= 6478, avg=6264.40, stdev=263.76, samples=5 00:17:23.630 lat (usec) : 100=4.65%, 250=95.35% 00:17:23.630 cpu : usr=2.42%, sys=9.38%, ctx=18037, majf=0, minf=1 00:17:23.630 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:23.630 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:23.630 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:23.630 issued rwts: total=18035,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:23.630 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:23.630 job3: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=4094644: Thu Apr 25 03:17:58 2024 00:17:23.630 read: IOPS=6251, BW=24.4MiB/s (25.6MB/s)(65.5MiB/2684msec) 00:17:23.630 slat (nsec): min=6330, max=38991, avg=9191.03, stdev=1710.68 00:17:23.630 clat (usec): min=78, max=378, avg=147.19, stdev=12.94 00:17:23.631 lat (usec): min=86, max=387, avg=156.39, stdev=12.43 00:17:23.631 clat percentiles (usec): 00:17:23.631 | 1.00th=[ 95], 5.00th=[ 137], 10.00th=[ 139], 20.00th=[ 141], 00:17:23.631 | 30.00th=[ 143], 40.00th=[ 143], 50.00th=[ 145], 60.00th=[ 147], 00:17:23.631 | 70.00th=[ 151], 80.00th=[ 157], 90.00th=[ 163], 95.00th=[ 167], 00:17:23.631 | 99.00th=[ 186], 99.50th=[ 192], 99.90th=[ 200], 99.95th=[ 206], 00:17:23.631 | 99.99th=[ 229] 00:17:23.631 bw ( KiB/s): min=24488, max=25920, per=24.89%, avg=25304.00, stdev=728.68, samples=5 00:17:23.631 iops : min= 6122, max= 6480, avg=6326.00, stdev=182.17, samples=5 00:17:23.631 lat (usec) : 100=1.58%, 250=98.41%, 500=0.01% 00:17:23.631 cpu : usr=2.57%, sys=9.24%, ctx=16780, majf=0, minf=2 00:17:23.631 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:23.631 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:23.631 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:23.631 issued rwts: total=16779,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:23.631 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:23.631 00:17:23.631 Run status group 0 (all jobs): 00:17:23.631 READ: bw=99.3MiB/s (104MB/s), 24.4MiB/s-33.2MiB/s (25.6MB/s-34.8MB/s), io=319MiB (334MB), run=2684-3212msec 00:17:23.631 00:17:23.631 Disk stats (read/write): 00:17:23.631 nvme0n1: ios=17781/0, merge=0/0, ticks=2419/0, in_queue=2419, util=92.76% 00:17:23.631 nvme0n2: ios=25476/0, merge=0/0, ticks=2600/0, in_queue=2600, util=93.09% 00:17:23.631 nvme0n3: ios=17881/0, merge=0/0, ticks=2429/0, in_queue=2429, util=95.19% 00:17:23.631 nvme0n4: ios=16242/0, merge=0/0, ticks=2279/0, in_queue=2279, util=96.36% 00:17:23.888 03:17:58 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:23.888 03:17:58 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:17:24.145 03:17:58 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:24.145 03:17:58 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:17:24.145 03:17:58 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:24.145 03:17:58 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:17:24.402 03:17:58 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:24.402 03:17:58 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:17:24.659 03:17:59 -- target/fio.sh@69 -- # fio_status=0 00:17:24.659 03:17:59 -- target/fio.sh@70 -- # wait 4094305 00:17:24.659 03:17:59 -- target/fio.sh@70 -- # fio_status=4 00:17:24.659 03:17:59 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:17:25.590 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:17:25.590 03:17:59 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:17:25.590 03:17:59 -- common/autotest_common.sh@1205 -- # local i=0 00:17:25.590 03:17:59 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:17:25.590 03:17:59 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:17:25.590 03:17:59 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:17:25.590 03:17:59 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:17:25.590 03:17:59 -- common/autotest_common.sh@1217 -- # return 0 00:17:25.590 03:17:59 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:17:25.590 03:17:59 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:17:25.590 nvmf hotplug test: fio failed as expected 00:17:25.590 03:17:59 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:25.590 03:18:00 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:17:25.590 03:18:00 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:17:25.590 03:18:00 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:17:25.590 03:18:00 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:17:25.590 03:18:00 -- target/fio.sh@91 -- # nvmftestfini 00:17:25.590 03:18:00 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:25.590 03:18:00 -- nvmf/common.sh@117 -- # sync 00:17:25.590 03:18:00 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:17:25.590 03:18:00 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:17:25.590 03:18:00 -- nvmf/common.sh@120 -- # set +e 00:17:25.590 03:18:00 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:25.590 03:18:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:17:25.847 rmmod nvme_rdma 00:17:25.847 rmmod nvme_fabrics 00:17:25.847 03:18:00 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:25.847 03:18:00 -- nvmf/common.sh@124 -- # set -e 00:17:25.847 03:18:00 -- nvmf/common.sh@125 -- # return 0 00:17:25.847 03:18:00 -- nvmf/common.sh@478 -- # '[' -n 4091766 ']' 00:17:25.847 03:18:00 -- nvmf/common.sh@479 -- # killprocess 4091766 00:17:25.847 03:18:00 -- common/autotest_common.sh@936 -- # '[' -z 4091766 ']' 00:17:25.847 03:18:00 -- common/autotest_common.sh@940 -- # kill -0 4091766 00:17:25.847 03:18:00 -- common/autotest_common.sh@941 -- # uname 00:17:25.847 03:18:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:25.847 03:18:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4091766 00:17:25.847 03:18:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:25.847 03:18:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:25.847 03:18:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4091766' 00:17:25.847 killing process with pid 4091766 00:17:25.847 03:18:00 -- common/autotest_common.sh@955 -- # kill 4091766 00:17:25.847 03:18:00 -- common/autotest_common.sh@960 -- # wait 4091766 00:17:25.847 [2024-04-25 03:18:00.211395] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:17:26.105 03:18:00 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:26.105 03:18:00 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:17:26.105 00:17:26.105 real 0m24.688s 00:17:26.105 user 1m46.953s 00:17:26.105 sys 0m8.763s 00:17:26.105 03:18:00 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:26.105 03:18:00 -- common/autotest_common.sh@10 -- # set +x 00:17:26.105 ************************************ 00:17:26.105 END TEST nvmf_fio_target 00:17:26.105 ************************************ 00:17:26.105 03:18:00 -- nvmf/nvmf.sh@56 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=rdma 00:17:26.105 03:18:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:26.105 03:18:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:26.105 03:18:00 -- common/autotest_common.sh@10 -- # set +x 00:17:26.105 ************************************ 00:17:26.105 START TEST nvmf_bdevio 00:17:26.105 ************************************ 00:17:26.105 03:18:00 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=rdma 00:17:26.362 * Looking for test storage... 00:17:26.362 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:17:26.362 03:18:00 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:17:26.362 03:18:00 -- nvmf/common.sh@7 -- # uname -s 00:17:26.363 03:18:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:26.363 03:18:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:26.363 03:18:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:26.363 03:18:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:26.363 03:18:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:26.363 03:18:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:26.363 03:18:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:26.363 03:18:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:26.363 03:18:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:26.363 03:18:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:26.363 03:18:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:17:26.363 03:18:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:17:26.363 03:18:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:26.363 03:18:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:26.363 03:18:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:26.363 03:18:00 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:26.363 03:18:00 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:17:26.363 03:18:00 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:26.363 03:18:00 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:26.363 03:18:00 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:26.363 03:18:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:26.363 03:18:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:26.363 03:18:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:26.363 03:18:00 -- paths/export.sh@5 -- # export PATH 00:17:26.363 03:18:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:26.363 03:18:00 -- nvmf/common.sh@47 -- # : 0 00:17:26.363 03:18:00 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:17:26.363 03:18:00 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:17:26.363 03:18:00 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:26.363 03:18:00 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:26.363 03:18:00 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:26.363 03:18:00 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:17:26.363 03:18:00 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:17:26.363 03:18:00 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:17:26.363 03:18:00 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:26.363 03:18:00 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:26.363 03:18:00 -- target/bdevio.sh@14 -- # nvmftestinit 00:17:26.363 03:18:00 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:17:26.363 03:18:00 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:26.363 03:18:00 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:26.363 03:18:00 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:26.363 03:18:00 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:26.363 03:18:00 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:26.363 03:18:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:26.363 03:18:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:26.363 03:18:00 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:26.363 03:18:00 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:26.363 03:18:00 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:26.363 03:18:00 -- common/autotest_common.sh@10 -- # set +x 00:17:32.911 03:18:06 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:32.911 03:18:06 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:32.911 03:18:06 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:32.911 03:18:06 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:32.911 03:18:06 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:32.911 03:18:06 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:32.911 03:18:06 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:32.911 03:18:06 -- nvmf/common.sh@295 -- # net_devs=() 00:17:32.911 03:18:06 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:32.911 03:18:06 -- nvmf/common.sh@296 -- # e810=() 00:17:32.911 03:18:06 -- nvmf/common.sh@296 -- # local -ga e810 00:17:32.911 03:18:06 -- nvmf/common.sh@297 -- # x722=() 00:17:32.911 03:18:06 -- nvmf/common.sh@297 -- # local -ga x722 00:17:32.911 03:18:06 -- nvmf/common.sh@298 -- # mlx=() 00:17:32.911 03:18:06 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:32.911 03:18:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:32.911 03:18:06 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:32.911 03:18:06 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:32.911 03:18:06 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:32.911 03:18:06 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:32.911 03:18:06 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:32.911 03:18:06 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:32.911 03:18:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:32.911 03:18:06 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:32.911 03:18:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:32.911 03:18:06 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:32.911 03:18:06 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:32.911 03:18:06 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:17:32.911 03:18:06 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:17:32.911 03:18:06 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:17:32.911 03:18:06 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:17:32.911 03:18:06 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:17:32.911 03:18:06 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:17:32.911 03:18:06 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:32.911 03:18:06 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:32.911 03:18:06 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:17:32.911 Found 0000:af:00.0 (0x8086 - 0x159b) 00:17:32.911 03:18:06 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:32.911 03:18:06 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:32.911 03:18:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:32.911 03:18:06 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:32.911 03:18:06 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:32.911 03:18:06 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:32.911 03:18:06 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:32.911 03:18:06 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:17:32.911 Found 0000:af:00.1 (0x8086 - 0x159b) 00:17:32.911 03:18:06 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:32.911 03:18:06 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:32.911 03:18:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:32.911 03:18:06 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:32.911 03:18:06 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:32.911 03:18:06 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:32.911 03:18:06 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:32.911 03:18:06 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:17:32.911 03:18:06 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:17:32.911 03:18:06 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:17:32.911 03:18:06 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:17:32.911 03:18:06 -- nvmf/common.sh@377 -- # modinfo irdma 00:17:32.911 03:18:06 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:17:32.911 03:18:06 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:32.911 03:18:06 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:32.911 03:18:06 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:32.911 03:18:06 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:32.911 03:18:06 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:17:32.911 Found net devices under 0000:af:00.0: cvl_0_0 00:17:32.911 03:18:06 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:32.911 03:18:06 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:32.911 03:18:06 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:32.911 03:18:06 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:32.911 03:18:06 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:32.911 03:18:06 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:17:32.911 Found net devices under 0000:af:00.1: cvl_0_1 00:17:32.911 03:18:06 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:32.911 03:18:06 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:32.911 03:18:06 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:32.911 03:18:06 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:32.911 03:18:06 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:17:32.911 03:18:06 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:17:32.911 03:18:06 -- nvmf/common.sh@409 -- # rdma_device_init 00:17:32.911 03:18:06 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:17:32.911 03:18:06 -- nvmf/common.sh@58 -- # uname 00:17:32.911 03:18:06 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:17:32.911 03:18:06 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:17:32.911 03:18:06 -- nvmf/common.sh@63 -- # modprobe ib_core 00:17:32.911 03:18:06 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:17:32.911 03:18:06 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:17:32.911 03:18:06 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:17:32.911 03:18:06 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:17:32.911 03:18:06 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:17:32.911 03:18:06 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:17:32.911 03:18:06 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:17:32.911 03:18:06 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:17:32.911 03:18:06 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:32.911 03:18:06 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:32.911 03:18:06 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:32.911 03:18:06 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:32.911 03:18:06 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:32.911 03:18:06 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:32.911 03:18:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:32.911 03:18:06 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:17:32.911 03:18:06 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:17:32.911 03:18:06 -- nvmf/common.sh@105 -- # continue 2 00:17:32.911 03:18:06 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:32.911 03:18:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:32.911 03:18:06 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:17:32.911 03:18:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:32.911 03:18:06 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:17:32.911 03:18:06 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:17:32.911 03:18:06 -- nvmf/common.sh@105 -- # continue 2 00:17:32.911 03:18:06 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:32.912 03:18:06 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:17:32.912 03:18:06 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:17:32.912 03:18:06 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:17:32.912 03:18:06 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:32.912 03:18:06 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:32.912 03:18:06 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:17:32.912 03:18:06 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:17:32.912 03:18:06 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:17:32.912 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:17:32.912 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:17:32.912 altname enp175s0f0np0 00:17:32.912 altname ens801f0np0 00:17:32.912 inet 192.168.100.8/24 scope global cvl_0_0 00:17:32.912 valid_lft forever preferred_lft forever 00:17:32.912 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:17:32.912 valid_lft forever preferred_lft forever 00:17:32.912 03:18:06 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:32.912 03:18:06 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:17:32.912 03:18:06 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:17:32.912 03:18:06 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:17:32.912 03:18:06 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:32.912 03:18:06 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:32.912 03:18:06 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:17:32.912 03:18:06 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:17:32.912 03:18:06 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:17:32.912 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:17:32.912 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:17:32.912 altname enp175s0f1np1 00:17:32.912 altname ens801f1np1 00:17:32.912 inet 192.168.100.9/24 scope global cvl_0_1 00:17:32.912 valid_lft forever preferred_lft forever 00:17:32.912 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:17:32.912 valid_lft forever preferred_lft forever 00:17:32.912 03:18:06 -- nvmf/common.sh@411 -- # return 0 00:17:32.912 03:18:06 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:32.912 03:18:06 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:17:32.912 03:18:06 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:17:32.912 03:18:06 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:17:32.912 03:18:06 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:17:32.912 03:18:06 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:32.912 03:18:06 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:32.912 03:18:06 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:32.912 03:18:06 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:32.912 03:18:06 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:32.912 03:18:06 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:32.912 03:18:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:32.912 03:18:06 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:17:32.912 03:18:06 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:17:32.912 03:18:06 -- nvmf/common.sh@105 -- # continue 2 00:17:32.912 03:18:06 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:32.912 03:18:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:32.912 03:18:06 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:17:32.912 03:18:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:32.912 03:18:06 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:17:32.912 03:18:06 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:17:32.912 03:18:06 -- nvmf/common.sh@105 -- # continue 2 00:17:32.912 03:18:06 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:32.912 03:18:06 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:17:32.912 03:18:06 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:17:32.912 03:18:06 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:17:32.912 03:18:06 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:32.912 03:18:06 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:32.912 03:18:06 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:32.912 03:18:06 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:17:32.912 03:18:06 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:17:32.912 03:18:06 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:17:32.912 03:18:06 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:32.912 03:18:06 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:32.912 03:18:06 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:17:32.912 192.168.100.9' 00:17:32.912 03:18:06 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:17:32.912 192.168.100.9' 00:17:32.912 03:18:06 -- nvmf/common.sh@446 -- # head -n 1 00:17:32.912 03:18:06 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:17:32.912 03:18:06 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:17:32.912 192.168.100.9' 00:17:32.912 03:18:06 -- nvmf/common.sh@447 -- # tail -n +2 00:17:32.912 03:18:06 -- nvmf/common.sh@447 -- # head -n 1 00:17:32.912 03:18:06 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:17:32.912 03:18:06 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:17:32.912 03:18:06 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:17:32.912 03:18:06 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:17:32.912 03:18:06 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:17:32.912 03:18:06 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:17:32.912 03:18:06 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:17:32.912 03:18:06 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:32.912 03:18:06 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:32.912 03:18:06 -- common/autotest_common.sh@10 -- # set +x 00:17:32.912 03:18:06 -- nvmf/common.sh@470 -- # nvmfpid=4099036 00:17:32.912 03:18:06 -- nvmf/common.sh@471 -- # waitforlisten 4099036 00:17:32.912 03:18:06 -- common/autotest_common.sh@817 -- # '[' -z 4099036 ']' 00:17:32.912 03:18:06 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:32.912 03:18:06 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:32.912 03:18:06 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:32.912 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:32.912 03:18:06 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:17:32.912 03:18:06 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:32.912 03:18:06 -- common/autotest_common.sh@10 -- # set +x 00:17:32.912 [2024-04-25 03:18:06.490819] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:17:32.912 [2024-04-25 03:18:06.490868] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:32.912 EAL: No free 2048 kB hugepages reported on node 1 00:17:32.912 [2024-04-25 03:18:06.551152] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:32.912 [2024-04-25 03:18:06.628271] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:32.912 [2024-04-25 03:18:06.628306] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:32.912 [2024-04-25 03:18:06.628312] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:32.912 [2024-04-25 03:18:06.628318] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:32.912 [2024-04-25 03:18:06.628323] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:32.912 [2024-04-25 03:18:06.628445] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:32.912 [2024-04-25 03:18:06.628557] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:32.912 [2024-04-25 03:18:06.628661] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:32.912 [2024-04-25 03:18:06.628662] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:32.912 03:18:07 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:32.912 03:18:07 -- common/autotest_common.sh@850 -- # return 0 00:17:32.912 03:18:07 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:32.912 03:18:07 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:32.912 03:18:07 -- common/autotest_common.sh@10 -- # set +x 00:17:32.912 03:18:07 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:32.912 03:18:07 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:17:32.912 03:18:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:32.912 03:18:07 -- common/autotest_common.sh@10 -- # set +x 00:17:32.912 [2024-04-25 03:18:07.348145] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x16ff780/0x16fedc0) succeed. 00:17:32.912 [2024-04-25 03:18:07.358367] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x1700af0/0x16ff340) succeed. 00:17:32.912 [2024-04-25 03:18:07.358388] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:17:32.912 03:18:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:32.912 03:18:07 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:32.912 03:18:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:32.912 03:18:07 -- common/autotest_common.sh@10 -- # set +x 00:17:32.912 Malloc0 00:17:32.912 03:18:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:32.912 03:18:07 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:32.912 03:18:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:32.912 03:18:07 -- common/autotest_common.sh@10 -- # set +x 00:17:32.912 03:18:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:32.912 03:18:07 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:32.912 03:18:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:32.912 03:18:07 -- common/autotest_common.sh@10 -- # set +x 00:17:32.912 03:18:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:32.912 03:18:07 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:17:32.912 03:18:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:32.912 03:18:07 -- common/autotest_common.sh@10 -- # set +x 00:17:32.912 [2024-04-25 03:18:07.405175] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:17:32.912 03:18:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:33.169 03:18:07 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:17:33.169 03:18:07 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:17:33.169 03:18:07 -- nvmf/common.sh@521 -- # config=() 00:17:33.169 03:18:07 -- nvmf/common.sh@521 -- # local subsystem config 00:17:33.169 03:18:07 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:33.169 03:18:07 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:33.169 { 00:17:33.169 "params": { 00:17:33.169 "name": "Nvme$subsystem", 00:17:33.169 "trtype": "$TEST_TRANSPORT", 00:17:33.169 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:33.169 "adrfam": "ipv4", 00:17:33.169 "trsvcid": "$NVMF_PORT", 00:17:33.169 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:33.169 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:33.169 "hdgst": ${hdgst:-false}, 00:17:33.169 "ddgst": ${ddgst:-false} 00:17:33.169 }, 00:17:33.169 "method": "bdev_nvme_attach_controller" 00:17:33.169 } 00:17:33.169 EOF 00:17:33.169 )") 00:17:33.169 03:18:07 -- nvmf/common.sh@543 -- # cat 00:17:33.169 03:18:07 -- nvmf/common.sh@545 -- # jq . 00:17:33.169 03:18:07 -- nvmf/common.sh@546 -- # IFS=, 00:17:33.169 03:18:07 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:17:33.169 "params": { 00:17:33.169 "name": "Nvme1", 00:17:33.169 "trtype": "rdma", 00:17:33.169 "traddr": "192.168.100.8", 00:17:33.169 "adrfam": "ipv4", 00:17:33.169 "trsvcid": "4420", 00:17:33.169 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:33.169 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:33.169 "hdgst": false, 00:17:33.169 "ddgst": false 00:17:33.169 }, 00:17:33.170 "method": "bdev_nvme_attach_controller" 00:17:33.170 }' 00:17:33.170 [2024-04-25 03:18:07.451604] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:17:33.170 [2024-04-25 03:18:07.451648] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4099279 ] 00:17:33.170 EAL: No free 2048 kB hugepages reported on node 1 00:17:33.170 [2024-04-25 03:18:07.511698] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:33.170 [2024-04-25 03:18:07.583798] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:33.170 [2024-04-25 03:18:07.583900] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:33.170 [2024-04-25 03:18:07.583902] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:33.427 I/O targets: 00:17:33.427 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:17:33.427 00:17:33.427 00:17:33.427 CUnit - A unit testing framework for C - Version 2.1-3 00:17:33.427 http://cunit.sourceforge.net/ 00:17:33.427 00:17:33.427 00:17:33.427 Suite: bdevio tests on: Nvme1n1 00:17:33.427 Test: blockdev write read block ...passed 00:17:33.427 Test: blockdev write zeroes read block ...passed 00:17:33.427 Test: blockdev write zeroes read no split ...passed 00:17:33.427 Test: blockdev write zeroes read split ...passed 00:17:33.427 Test: blockdev write zeroes read split partial ...passed 00:17:33.427 Test: blockdev reset ...[2024-04-25 03:18:07.773755] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:33.427 [2024-04-25 03:18:07.796750] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:33.427 [2024-04-25 03:18:07.825557] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:33.427 passed 00:17:33.427 Test: blockdev write read 8 blocks ...passed 00:17:33.427 Test: blockdev write read size > 128k ...passed 00:17:33.427 Test: blockdev write read invalid size ...passed 00:17:33.427 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:17:33.427 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:17:33.427 Test: blockdev write read max offset ...passed 00:17:33.427 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:17:33.427 Test: blockdev writev readv 8 blocks ...passed 00:17:33.427 Test: blockdev writev readv 30 x 1block ...passed 00:17:33.427 Test: blockdev writev readv block ...passed 00:17:33.427 Test: blockdev writev readv size > 128k ...passed 00:17:33.427 Test: blockdev writev readv size > 128k in two iovs ...passed 00:17:33.427 Test: blockdev comparev and writev ...[2024-04-25 03:18:07.828852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:33.427 [2024-04-25 03:18:07.828882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:17:33.427 [2024-04-25 03:18:07.828892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:33.427 [2024-04-25 03:18:07.828899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:17:33.427 [2024-04-25 03:18:07.829081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:33.427 [2024-04-25 03:18:07.829090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0029 p:0 m:0 dnr:0 00:17:33.427 [2024-04-25 03:18:07.829098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:33.427 [2024-04-25 03:18:07.829105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:002a p:0 m:0 dnr:0 00:17:33.427 [2024-04-25 03:18:07.829269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:33.427 [2024-04-25 03:18:07.829278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:002b p:0 m:0 dnr:0 00:17:33.427 [2024-04-25 03:18:07.829285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:33.427 [2024-04-25 03:18:07.829292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:17:33.427 [2024-04-25 03:18:07.829462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:33.427 [2024-04-25 03:18:07.829470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:17:33.427 [2024-04-25 03:18:07.829478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:33.427 [2024-04-25 03:18:07.829485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:17:33.427 passed 00:17:33.427 Test: blockdev nvme passthru rw ...passed 00:17:33.427 Test: blockdev nvme passthru vendor specific ...[2024-04-25 03:18:07.829764] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:17:33.427 [2024-04-25 03:18:07.829774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:0032 p:0 m:0 dnr:0 00:17:33.427 [2024-04-25 03:18:07.829822] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:17:33.427 [2024-04-25 03:18:07.829830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:0033 p:0 m:0 dnr:0 00:17:33.427 [2024-04-25 03:18:07.829881] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:17:33.427 [2024-04-25 03:18:07.829890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:0034 p:0 m:0 dnr:0 00:17:33.427 [2024-04-25 03:18:07.829936] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:17:33.427 [2024-04-25 03:18:07.829944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:0035 p:0 m:0 dnr:0 00:17:33.427 passed 00:17:33.427 Test: blockdev nvme admin passthru ...passed 00:17:33.427 Test: blockdev copy ...passed 00:17:33.427 00:17:33.427 Run Summary: Type Total Ran Passed Failed Inactive 00:17:33.427 suites 1 1 n/a 0 0 00:17:33.428 tests 23 23 23 0 0 00:17:33.428 asserts 152 152 152 0 n/a 00:17:33.428 00:17:33.428 Elapsed time = 0.176 seconds 00:17:33.685 03:18:08 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:33.685 03:18:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:33.685 03:18:08 -- common/autotest_common.sh@10 -- # set +x 00:17:33.685 03:18:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:33.685 03:18:08 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:17:33.685 03:18:08 -- target/bdevio.sh@30 -- # nvmftestfini 00:17:33.685 03:18:08 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:33.685 03:18:08 -- nvmf/common.sh@117 -- # sync 00:17:33.685 03:18:08 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:17:33.685 03:18:08 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:17:33.685 03:18:08 -- nvmf/common.sh@120 -- # set +e 00:17:33.685 03:18:08 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:33.685 03:18:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:17:33.685 rmmod nvme_rdma 00:17:33.685 rmmod nvme_fabrics 00:17:33.685 03:18:08 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:33.685 03:18:08 -- nvmf/common.sh@124 -- # set -e 00:17:33.685 03:18:08 -- nvmf/common.sh@125 -- # return 0 00:17:33.685 03:18:08 -- nvmf/common.sh@478 -- # '[' -n 4099036 ']' 00:17:33.685 03:18:08 -- nvmf/common.sh@479 -- # killprocess 4099036 00:17:33.685 03:18:08 -- common/autotest_common.sh@936 -- # '[' -z 4099036 ']' 00:17:33.686 03:18:08 -- common/autotest_common.sh@940 -- # kill -0 4099036 00:17:33.686 03:18:08 -- common/autotest_common.sh@941 -- # uname 00:17:33.686 03:18:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:33.686 03:18:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4099036 00:17:33.686 03:18:08 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:17:33.686 03:18:08 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:17:33.686 03:18:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4099036' 00:17:33.686 killing process with pid 4099036 00:17:33.686 03:18:08 -- common/autotest_common.sh@955 -- # kill 4099036 00:17:33.686 03:18:08 -- common/autotest_common.sh@960 -- # wait 4099036 00:17:33.686 [2024-04-25 03:18:08.173712] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:17:33.944 03:18:08 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:33.944 03:18:08 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:17:33.944 00:17:33.944 real 0m7.839s 00:17:33.944 user 0m9.748s 00:17:33.944 sys 0m4.887s 00:17:33.944 03:18:08 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:33.944 03:18:08 -- common/autotest_common.sh@10 -- # set +x 00:17:33.944 ************************************ 00:17:33.944 END TEST nvmf_bdevio 00:17:33.944 ************************************ 00:17:33.944 03:18:08 -- nvmf/nvmf.sh@58 -- # '[' rdma = tcp ']' 00:17:33.944 03:18:08 -- nvmf/nvmf.sh@64 -- # '[' 1 -eq 1 ']' 00:17:33.944 03:18:08 -- nvmf/nvmf.sh@65 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=rdma 00:17:33.944 03:18:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:33.944 03:18:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:33.944 03:18:08 -- common/autotest_common.sh@10 -- # set +x 00:17:34.203 ************************************ 00:17:34.203 START TEST nvmf_fuzz 00:17:34.203 ************************************ 00:17:34.203 03:18:08 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=rdma 00:17:34.203 * Looking for test storage... 00:17:34.203 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:17:34.203 03:18:08 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:17:34.203 03:18:08 -- nvmf/common.sh@7 -- # uname -s 00:17:34.203 03:18:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:34.203 03:18:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:34.203 03:18:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:34.203 03:18:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:34.203 03:18:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:34.203 03:18:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:34.203 03:18:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:34.203 03:18:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:34.203 03:18:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:34.203 03:18:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:34.203 03:18:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:17:34.203 03:18:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:17:34.203 03:18:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:34.203 03:18:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:34.203 03:18:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:34.203 03:18:08 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:34.203 03:18:08 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:17:34.203 03:18:08 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:34.203 03:18:08 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:34.203 03:18:08 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:34.203 03:18:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:34.203 03:18:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:34.203 03:18:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:34.203 03:18:08 -- paths/export.sh@5 -- # export PATH 00:17:34.203 03:18:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:34.203 03:18:08 -- nvmf/common.sh@47 -- # : 0 00:17:34.203 03:18:08 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:17:34.203 03:18:08 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:17:34.203 03:18:08 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:34.203 03:18:08 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:34.203 03:18:08 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:34.203 03:18:08 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:17:34.203 03:18:08 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:17:34.203 03:18:08 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:17:34.203 03:18:08 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:17:34.203 03:18:08 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:17:34.203 03:18:08 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:34.203 03:18:08 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:34.203 03:18:08 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:34.203 03:18:08 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:34.203 03:18:08 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:34.203 03:18:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:34.203 03:18:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:34.203 03:18:08 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:34.203 03:18:08 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:34.203 03:18:08 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:34.203 03:18:08 -- common/autotest_common.sh@10 -- # set +x 00:17:40.851 03:18:14 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:40.851 03:18:14 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:40.851 03:18:14 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:40.851 03:18:14 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:40.851 03:18:14 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:40.851 03:18:14 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:40.851 03:18:14 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:40.851 03:18:14 -- nvmf/common.sh@295 -- # net_devs=() 00:17:40.851 03:18:14 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:40.851 03:18:14 -- nvmf/common.sh@296 -- # e810=() 00:17:40.851 03:18:14 -- nvmf/common.sh@296 -- # local -ga e810 00:17:40.851 03:18:14 -- nvmf/common.sh@297 -- # x722=() 00:17:40.851 03:18:14 -- nvmf/common.sh@297 -- # local -ga x722 00:17:40.851 03:18:14 -- nvmf/common.sh@298 -- # mlx=() 00:17:40.851 03:18:14 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:40.851 03:18:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:40.851 03:18:14 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:40.851 03:18:14 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:40.851 03:18:14 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:40.851 03:18:14 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:40.851 03:18:14 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:40.851 03:18:14 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:40.851 03:18:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:40.851 03:18:14 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:40.851 03:18:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:40.851 03:18:14 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:40.851 03:18:14 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:40.851 03:18:14 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:17:40.851 03:18:14 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:17:40.851 03:18:14 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:17:40.851 03:18:14 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:17:40.851 03:18:14 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:17:40.851 03:18:14 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:17:40.851 03:18:14 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:40.851 03:18:14 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:40.852 03:18:14 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:17:40.852 Found 0000:af:00.0 (0x8086 - 0x159b) 00:17:40.852 03:18:14 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:40.852 03:18:14 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:40.852 03:18:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:40.852 03:18:14 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:40.852 03:18:14 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:40.852 03:18:14 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:40.852 03:18:14 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:40.852 03:18:14 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:17:40.852 Found 0000:af:00.1 (0x8086 - 0x159b) 00:17:40.852 03:18:14 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:40.852 03:18:14 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:40.852 03:18:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:40.852 03:18:14 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:40.852 03:18:14 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:40.852 03:18:14 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:40.852 03:18:14 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:40.852 03:18:14 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:17:40.852 03:18:14 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:17:40.852 03:18:14 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:17:40.852 03:18:14 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:17:40.852 03:18:14 -- nvmf/common.sh@377 -- # modinfo irdma 00:17:40.852 03:18:14 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:17:40.852 03:18:14 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:40.852 03:18:14 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:40.852 03:18:14 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:40.852 03:18:14 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:40.852 03:18:14 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:17:40.852 Found net devices under 0000:af:00.0: cvl_0_0 00:17:40.852 03:18:14 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:40.852 03:18:14 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:40.852 03:18:14 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:40.852 03:18:14 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:40.852 03:18:14 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:40.852 03:18:14 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:17:40.852 Found net devices under 0000:af:00.1: cvl_0_1 00:17:40.852 03:18:14 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:40.852 03:18:14 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:40.852 03:18:14 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:40.852 03:18:14 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:40.852 03:18:14 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:17:40.852 03:18:14 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:17:40.852 03:18:14 -- nvmf/common.sh@409 -- # rdma_device_init 00:17:40.852 03:18:14 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:17:40.852 03:18:14 -- nvmf/common.sh@58 -- # uname 00:17:40.852 03:18:14 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:17:40.852 03:18:14 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:17:40.852 03:18:14 -- nvmf/common.sh@63 -- # modprobe ib_core 00:17:40.852 03:18:14 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:17:40.852 03:18:14 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:17:40.852 03:18:14 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:17:40.852 03:18:14 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:17:40.852 03:18:14 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:17:40.852 03:18:14 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:17:40.852 03:18:14 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:17:40.852 03:18:14 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:17:40.852 03:18:14 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:40.852 03:18:14 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:40.852 03:18:14 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:40.852 03:18:14 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:40.852 03:18:14 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:40.852 03:18:14 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:40.852 03:18:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:40.852 03:18:14 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:17:40.852 03:18:14 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:17:40.852 03:18:14 -- nvmf/common.sh@105 -- # continue 2 00:17:40.852 03:18:14 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:40.852 03:18:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:40.852 03:18:14 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:17:40.852 03:18:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:40.852 03:18:14 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:17:40.852 03:18:14 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:17:40.852 03:18:14 -- nvmf/common.sh@105 -- # continue 2 00:17:40.852 03:18:14 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:40.852 03:18:14 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:17:40.852 03:18:14 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:17:40.852 03:18:14 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:17:40.852 03:18:14 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:40.852 03:18:14 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:40.852 03:18:14 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:17:40.852 03:18:14 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:17:40.852 03:18:14 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:17:40.852 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:17:40.852 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:17:40.852 altname enp175s0f0np0 00:17:40.852 altname ens801f0np0 00:17:40.852 inet 192.168.100.8/24 scope global cvl_0_0 00:17:40.852 valid_lft forever preferred_lft forever 00:17:40.852 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:17:40.852 valid_lft forever preferred_lft forever 00:17:40.852 03:18:14 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:40.852 03:18:14 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:17:40.852 03:18:14 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:17:40.852 03:18:14 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:17:40.852 03:18:14 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:40.852 03:18:14 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:40.852 03:18:14 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:17:40.852 03:18:14 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:17:40.852 03:18:14 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:17:40.852 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:17:40.852 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:17:40.852 altname enp175s0f1np1 00:17:40.852 altname ens801f1np1 00:17:40.852 inet 192.168.100.9/24 scope global cvl_0_1 00:17:40.852 valid_lft forever preferred_lft forever 00:17:40.852 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:17:40.852 valid_lft forever preferred_lft forever 00:17:40.852 03:18:14 -- nvmf/common.sh@411 -- # return 0 00:17:40.852 03:18:14 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:40.852 03:18:14 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:17:40.852 03:18:14 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:17:40.852 03:18:14 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:17:40.852 03:18:14 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:17:40.852 03:18:14 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:40.852 03:18:14 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:40.852 03:18:14 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:40.852 03:18:14 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:40.852 03:18:14 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:40.852 03:18:14 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:40.852 03:18:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:40.852 03:18:14 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:17:40.852 03:18:14 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:17:40.852 03:18:14 -- nvmf/common.sh@105 -- # continue 2 00:17:40.852 03:18:14 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:40.852 03:18:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:40.852 03:18:14 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:17:40.852 03:18:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:40.852 03:18:14 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:17:40.852 03:18:14 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:17:40.852 03:18:14 -- nvmf/common.sh@105 -- # continue 2 00:17:40.852 03:18:14 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:40.852 03:18:14 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:17:40.852 03:18:14 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:17:40.852 03:18:14 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:17:40.852 03:18:14 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:40.852 03:18:14 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:40.852 03:18:14 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:40.852 03:18:14 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:17:40.852 03:18:14 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:17:40.852 03:18:14 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:17:40.852 03:18:14 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:40.852 03:18:14 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:40.852 03:18:14 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:17:40.852 192.168.100.9' 00:17:40.852 03:18:14 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:17:40.852 192.168.100.9' 00:17:40.852 03:18:14 -- nvmf/common.sh@446 -- # head -n 1 00:17:40.852 03:18:14 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:17:40.852 03:18:14 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:17:40.852 192.168.100.9' 00:17:40.852 03:18:14 -- nvmf/common.sh@447 -- # head -n 1 00:17:40.852 03:18:14 -- nvmf/common.sh@447 -- # tail -n +2 00:17:40.852 03:18:14 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:17:40.852 03:18:14 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:17:40.852 03:18:14 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:17:40.852 03:18:14 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:17:40.852 03:18:14 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:17:40.852 03:18:14 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:17:40.852 03:18:14 -- target/fabrics_fuzz.sh@13 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:40.852 03:18:14 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=4103222 00:17:40.853 03:18:14 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:17:40.853 03:18:14 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 4103222 00:17:40.853 03:18:14 -- common/autotest_common.sh@817 -- # '[' -z 4103222 ']' 00:17:40.853 03:18:14 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:40.853 03:18:14 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:40.853 03:18:14 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:40.853 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:40.853 03:18:14 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:40.853 03:18:14 -- common/autotest_common.sh@10 -- # set +x 00:17:41.164 03:18:15 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:41.164 03:18:15 -- common/autotest_common.sh@850 -- # return 0 00:17:41.164 03:18:15 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:17:41.164 03:18:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:41.164 03:18:15 -- common/autotest_common.sh@10 -- # set +x 00:17:41.164 03:18:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:41.164 03:18:15 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:17:41.164 03:18:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:41.164 03:18:15 -- common/autotest_common.sh@10 -- # set +x 00:17:41.164 Malloc0 00:17:41.164 03:18:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:41.164 03:18:15 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:41.164 03:18:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:41.164 03:18:15 -- common/autotest_common.sh@10 -- # set +x 00:17:41.164 03:18:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:41.164 03:18:15 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:41.164 03:18:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:41.164 03:18:15 -- common/autotest_common.sh@10 -- # set +x 00:17:41.164 03:18:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:41.164 03:18:15 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:17:41.164 03:18:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:41.164 03:18:15 -- common/autotest_common.sh@10 -- # set +x 00:17:41.164 03:18:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:41.164 03:18:15 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:rdma adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:192.168.100.8 trsvcid:4420' 00:17:41.164 03:18:15 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -t 30 -S 123456 -F 'trtype:rdma adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:192.168.100.8 trsvcid:4420' -N -a 00:18:13.228 Fuzzing completed. Shutting down the fuzz application 00:18:13.228 00:18:13.228 Dumping successful admin opcodes: 00:18:13.228 8, 9, 10, 24, 00:18:13.228 Dumping successful io opcodes: 00:18:13.228 0, 9, 00:18:13.228 NS: 0x200003af1f00 I/O qp, Total commands completed: 1325603, total successful commands: 7801, random_seed: 343768320 00:18:13.228 NS: 0x200003af1f00 admin qp, Total commands completed: 167024, total successful commands: 1363, random_seed: 401949056 00:18:13.228 03:18:46 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -F 'trtype:rdma adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:192.168.100.8 trsvcid:4420' -j /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:18:13.228 Fuzzing completed. Shutting down the fuzz application 00:18:13.228 00:18:13.228 Dumping successful admin opcodes: 00:18:13.228 24, 00:18:13.228 Dumping successful io opcodes: 00:18:13.228 00:18:13.228 NS: 0x200003af1f00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 1637404878 00:18:13.228 NS: 0x200003af1f00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 1637470994 00:18:13.228 03:18:47 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:13.228 03:18:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:13.228 03:18:47 -- common/autotest_common.sh@10 -- # set +x 00:18:13.228 03:18:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:13.228 03:18:47 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:18:13.228 03:18:47 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:18:13.228 03:18:47 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:13.228 03:18:47 -- nvmf/common.sh@117 -- # sync 00:18:13.228 03:18:47 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:18:13.228 03:18:47 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:18:13.228 03:18:47 -- nvmf/common.sh@120 -- # set +e 00:18:13.228 03:18:47 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:13.228 03:18:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:18:13.228 rmmod nvme_rdma 00:18:13.228 rmmod nvme_fabrics 00:18:13.228 03:18:47 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:13.228 03:18:47 -- nvmf/common.sh@124 -- # set -e 00:18:13.228 03:18:47 -- nvmf/common.sh@125 -- # return 0 00:18:13.229 03:18:47 -- nvmf/common.sh@478 -- # '[' -n 4103222 ']' 00:18:13.229 03:18:47 -- nvmf/common.sh@479 -- # killprocess 4103222 00:18:13.229 03:18:47 -- common/autotest_common.sh@936 -- # '[' -z 4103222 ']' 00:18:13.229 03:18:47 -- common/autotest_common.sh@940 -- # kill -0 4103222 00:18:13.229 03:18:47 -- common/autotest_common.sh@941 -- # uname 00:18:13.229 03:18:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:13.229 03:18:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4103222 00:18:13.229 03:18:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:13.229 03:18:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:13.229 03:18:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4103222' 00:18:13.229 killing process with pid 4103222 00:18:13.229 03:18:47 -- common/autotest_common.sh@955 -- # kill 4103222 00:18:13.229 03:18:47 -- common/autotest_common.sh@960 -- # wait 4103222 00:18:13.229 03:18:47 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:13.229 03:18:47 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:18:13.229 03:18:47 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:18:13.488 00:18:13.488 real 0m39.169s 00:18:13.488 user 0m53.781s 00:18:13.488 sys 0m16.655s 00:18:13.488 03:18:47 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:13.488 03:18:47 -- common/autotest_common.sh@10 -- # set +x 00:18:13.488 ************************************ 00:18:13.488 END TEST nvmf_fuzz 00:18:13.488 ************************************ 00:18:13.488 03:18:47 -- nvmf/nvmf.sh@66 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=rdma 00:18:13.488 03:18:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:13.488 03:18:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:13.488 03:18:47 -- common/autotest_common.sh@10 -- # set +x 00:18:13.488 ************************************ 00:18:13.488 START TEST nvmf_multiconnection 00:18:13.488 ************************************ 00:18:13.488 03:18:47 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=rdma 00:18:13.488 * Looking for test storage... 00:18:13.488 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:18:13.488 03:18:47 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:18:13.488 03:18:47 -- nvmf/common.sh@7 -- # uname -s 00:18:13.488 03:18:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:13.488 03:18:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:13.488 03:18:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:13.488 03:18:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:13.488 03:18:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:13.488 03:18:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:13.488 03:18:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:13.488 03:18:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:13.488 03:18:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:13.488 03:18:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:13.488 03:18:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:18:13.488 03:18:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:18:13.488 03:18:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:13.488 03:18:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:13.488 03:18:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:13.488 03:18:47 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:13.488 03:18:47 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:18:13.488 03:18:47 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:13.488 03:18:47 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:13.488 03:18:47 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:13.488 03:18:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:13.488 03:18:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:13.488 03:18:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:13.488 03:18:47 -- paths/export.sh@5 -- # export PATH 00:18:13.488 03:18:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:13.488 03:18:47 -- nvmf/common.sh@47 -- # : 0 00:18:13.488 03:18:47 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:13.488 03:18:47 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:13.488 03:18:47 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:13.488 03:18:47 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:13.488 03:18:47 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:13.488 03:18:47 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:13.488 03:18:47 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:13.488 03:18:47 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:13.488 03:18:47 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:13.488 03:18:47 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:13.488 03:18:47 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:18:13.488 03:18:47 -- target/multiconnection.sh@16 -- # nvmftestinit 00:18:13.488 03:18:47 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:18:13.488 03:18:47 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:13.488 03:18:47 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:13.488 03:18:47 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:13.488 03:18:47 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:13.488 03:18:47 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:13.488 03:18:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:13.488 03:18:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:13.488 03:18:47 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:13.488 03:18:47 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:13.488 03:18:47 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:13.488 03:18:47 -- common/autotest_common.sh@10 -- # set +x 00:18:20.052 03:18:53 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:20.052 03:18:53 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:20.052 03:18:53 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:20.052 03:18:53 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:20.052 03:18:53 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:20.052 03:18:53 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:20.052 03:18:53 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:20.052 03:18:53 -- nvmf/common.sh@295 -- # net_devs=() 00:18:20.052 03:18:53 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:20.052 03:18:53 -- nvmf/common.sh@296 -- # e810=() 00:18:20.052 03:18:53 -- nvmf/common.sh@296 -- # local -ga e810 00:18:20.052 03:18:53 -- nvmf/common.sh@297 -- # x722=() 00:18:20.052 03:18:53 -- nvmf/common.sh@297 -- # local -ga x722 00:18:20.052 03:18:53 -- nvmf/common.sh@298 -- # mlx=() 00:18:20.052 03:18:53 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:20.052 03:18:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:20.052 03:18:53 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:20.052 03:18:53 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:20.052 03:18:53 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:20.052 03:18:53 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:20.052 03:18:53 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:20.052 03:18:53 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:20.052 03:18:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:20.052 03:18:53 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:20.052 03:18:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:20.052 03:18:53 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:20.052 03:18:53 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:20.052 03:18:53 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:18:20.052 03:18:53 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:18:20.052 03:18:53 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:18:20.052 03:18:53 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:18:20.052 03:18:53 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:18:20.052 03:18:53 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:18:20.052 03:18:53 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:20.052 03:18:53 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:20.052 03:18:53 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:18:20.052 Found 0000:af:00.0 (0x8086 - 0x159b) 00:18:20.052 03:18:53 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:18:20.052 03:18:53 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:18:20.052 03:18:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:20.052 03:18:53 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:20.052 03:18:53 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:20.052 03:18:53 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:20.052 03:18:53 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:20.052 03:18:53 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:18:20.052 Found 0000:af:00.1 (0x8086 - 0x159b) 00:18:20.052 03:18:53 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:18:20.052 03:18:53 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:18:20.052 03:18:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:20.052 03:18:53 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:20.052 03:18:53 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:20.052 03:18:53 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:20.052 03:18:53 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:20.052 03:18:53 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:18:20.052 03:18:53 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:18:20.052 03:18:53 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:18:20.052 03:18:53 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:18:20.052 03:18:53 -- nvmf/common.sh@377 -- # modinfo irdma 00:18:20.052 03:18:54 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:18:20.052 03:18:54 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:20.052 03:18:54 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:20.052 03:18:54 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:20.052 03:18:54 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:20.052 03:18:54 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:18:20.052 Found net devices under 0000:af:00.0: cvl_0_0 00:18:20.052 03:18:54 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:20.052 03:18:54 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:20.052 03:18:54 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:20.052 03:18:54 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:20.052 03:18:54 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:20.052 03:18:54 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:18:20.052 Found net devices under 0000:af:00.1: cvl_0_1 00:18:20.052 03:18:54 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:20.052 03:18:54 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:20.052 03:18:54 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:20.052 03:18:54 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:20.052 03:18:54 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:18:20.052 03:18:54 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:18:20.052 03:18:54 -- nvmf/common.sh@409 -- # rdma_device_init 00:18:20.052 03:18:54 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:18:20.052 03:18:54 -- nvmf/common.sh@58 -- # uname 00:18:20.052 03:18:54 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:18:20.052 03:18:54 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:18:20.052 03:18:54 -- nvmf/common.sh@63 -- # modprobe ib_core 00:18:20.052 03:18:54 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:18:20.052 03:18:54 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:18:20.052 03:18:54 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:18:20.052 03:18:54 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:18:20.052 03:18:54 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:18:20.052 03:18:54 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:18:20.052 03:18:54 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:18:20.052 03:18:54 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:18:20.052 03:18:54 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:20.052 03:18:54 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:20.052 03:18:54 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:20.052 03:18:54 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:20.052 03:18:54 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:20.052 03:18:54 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:20.052 03:18:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:20.052 03:18:54 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:18:20.052 03:18:54 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:18:20.052 03:18:54 -- nvmf/common.sh@105 -- # continue 2 00:18:20.052 03:18:54 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:20.052 03:18:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:20.052 03:18:54 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:18:20.052 03:18:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:20.052 03:18:54 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:18:20.052 03:18:54 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:18:20.052 03:18:54 -- nvmf/common.sh@105 -- # continue 2 00:18:20.052 03:18:54 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:20.052 03:18:54 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:18:20.052 03:18:54 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:18:20.052 03:18:54 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:18:20.052 03:18:54 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:20.052 03:18:54 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:20.052 03:18:54 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:18:20.052 03:18:54 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:18:20.052 03:18:54 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:18:20.053 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:18:20.053 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:18:20.053 altname enp175s0f0np0 00:18:20.053 altname ens801f0np0 00:18:20.053 inet 192.168.100.8/24 scope global cvl_0_0 00:18:20.053 valid_lft forever preferred_lft forever 00:18:20.053 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:18:20.053 valid_lft forever preferred_lft forever 00:18:20.053 03:18:54 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:20.053 03:18:54 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:18:20.053 03:18:54 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:18:20.053 03:18:54 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:18:20.053 03:18:54 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:20.053 03:18:54 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:20.053 03:18:54 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:18:20.053 03:18:54 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:18:20.053 03:18:54 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:18:20.053 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:18:20.053 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:18:20.053 altname enp175s0f1np1 00:18:20.053 altname ens801f1np1 00:18:20.053 inet 192.168.100.9/24 scope global cvl_0_1 00:18:20.053 valid_lft forever preferred_lft forever 00:18:20.053 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:18:20.053 valid_lft forever preferred_lft forever 00:18:20.053 03:18:54 -- nvmf/common.sh@411 -- # return 0 00:18:20.053 03:18:54 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:20.053 03:18:54 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:18:20.053 03:18:54 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:18:20.053 03:18:54 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:18:20.053 03:18:54 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:18:20.053 03:18:54 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:20.053 03:18:54 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:20.053 03:18:54 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:20.053 03:18:54 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:20.053 03:18:54 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:20.053 03:18:54 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:20.053 03:18:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:20.053 03:18:54 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:18:20.053 03:18:54 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:18:20.053 03:18:54 -- nvmf/common.sh@105 -- # continue 2 00:18:20.053 03:18:54 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:20.053 03:18:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:20.053 03:18:54 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:18:20.053 03:18:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:20.053 03:18:54 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:18:20.053 03:18:54 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:18:20.053 03:18:54 -- nvmf/common.sh@105 -- # continue 2 00:18:20.053 03:18:54 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:20.053 03:18:54 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:18:20.053 03:18:54 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:18:20.053 03:18:54 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:18:20.053 03:18:54 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:20.053 03:18:54 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:20.053 03:18:54 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:20.053 03:18:54 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:18:20.053 03:18:54 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:18:20.053 03:18:54 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:18:20.053 03:18:54 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:20.053 03:18:54 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:20.053 03:18:54 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:18:20.053 192.168.100.9' 00:18:20.053 03:18:54 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:18:20.053 192.168.100.9' 00:18:20.053 03:18:54 -- nvmf/common.sh@446 -- # head -n 1 00:18:20.053 03:18:54 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:18:20.053 03:18:54 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:18:20.053 192.168.100.9' 00:18:20.053 03:18:54 -- nvmf/common.sh@447 -- # tail -n +2 00:18:20.053 03:18:54 -- nvmf/common.sh@447 -- # head -n 1 00:18:20.053 03:18:54 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:18:20.053 03:18:54 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:18:20.053 03:18:54 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:18:20.053 03:18:54 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:18:20.053 03:18:54 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:18:20.053 03:18:54 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:18:20.053 03:18:54 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:18:20.053 03:18:54 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:18:20.053 03:18:54 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:20.053 03:18:54 -- common/autotest_common.sh@10 -- # set +x 00:18:20.053 03:18:54 -- nvmf/common.sh@470 -- # nvmfpid=4111964 00:18:20.053 03:18:54 -- nvmf/common.sh@471 -- # waitforlisten 4111964 00:18:20.053 03:18:54 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:18:20.053 03:18:54 -- common/autotest_common.sh@817 -- # '[' -z 4111964 ']' 00:18:20.053 03:18:54 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:20.053 03:18:54 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:20.053 03:18:54 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:20.053 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:20.053 03:18:54 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:20.053 03:18:54 -- common/autotest_common.sh@10 -- # set +x 00:18:20.053 [2024-04-25 03:18:54.270752] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:18:20.053 [2024-04-25 03:18:54.270803] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:20.053 EAL: No free 2048 kB hugepages reported on node 1 00:18:20.053 [2024-04-25 03:18:54.332792] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:20.053 [2024-04-25 03:18:54.403749] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:20.053 [2024-04-25 03:18:54.403793] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:20.053 [2024-04-25 03:18:54.403800] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:20.053 [2024-04-25 03:18:54.403806] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:20.053 [2024-04-25 03:18:54.403811] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:20.053 [2024-04-25 03:18:54.403868] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:20.053 [2024-04-25 03:18:54.403934] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:20.053 [2024-04-25 03:18:54.404038] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:20.053 [2024-04-25 03:18:54.404039] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:20.618 03:18:55 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:20.618 03:18:55 -- common/autotest_common.sh@850 -- # return 0 00:18:20.618 03:18:55 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:18:20.618 03:18:55 -- common/autotest_common.sh@716 -- # xtrace_disable 00:18:20.618 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:20.618 03:18:55 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:20.618 03:18:55 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:18:20.618 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:20.618 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:20.875 [2024-04-25 03:18:55.133021] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x871ea0/0x8714e0) succeed. 00:18:20.875 [2024-04-25 03:18:55.143271] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x873210/0x871a60) succeed. 00:18:20.875 [2024-04-25 03:18:55.143295] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:18:20.875 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:20.875 03:18:55 -- target/multiconnection.sh@21 -- # seq 1 11 00:18:20.875 03:18:55 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:20.875 03:18:55 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:18:20.875 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:20.875 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:20.875 Malloc1 00:18:20.875 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:20.875 03:18:55 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:18:20.875 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:20.875 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:20.875 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:20.875 03:18:55 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:18:20.876 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:20.876 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:20.876 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:20.876 03:18:55 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:18:20.876 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:20.876 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:20.876 [2024-04-25 03:18:55.202128] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:18:20.876 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:20.876 03:18:55 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:20.876 03:18:55 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:18:20.876 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:20.876 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:20.876 Malloc2 00:18:20.876 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:20.876 03:18:55 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:18:20.876 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:20.876 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:20.876 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:20.876 03:18:55 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:18:20.876 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:20.876 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:20.876 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:20.876 03:18:55 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:18:20.876 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:20.876 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:20.876 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:20.876 03:18:55 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:20.876 03:18:55 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:18:20.876 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:20.876 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:20.876 Malloc3 00:18:20.876 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:20.876 03:18:55 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:18:20.876 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:20.876 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:20.876 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:20.876 03:18:55 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:18:20.876 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:20.876 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:20.876 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:20.876 03:18:55 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t rdma -a 192.168.100.8 -s 4420 00:18:20.876 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:20.876 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:20.876 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:20.876 03:18:55 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:20.876 03:18:55 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:18:20.876 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:20.876 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:20.876 Malloc4 00:18:20.876 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:20.876 03:18:55 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:18:20.876 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:20.876 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:20.876 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:20.876 03:18:55 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:18:20.876 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:20.876 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:20.876 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:20.876 03:18:55 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t rdma -a 192.168.100.8 -s 4420 00:18:20.876 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:20.876 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:20.876 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:20.876 03:18:55 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:20.876 03:18:55 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:18:20.876 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:20.876 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:20.876 Malloc5 00:18:20.876 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:20.876 03:18:55 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:18:20.876 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:20.876 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:20.876 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:20.876 03:18:55 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:18:20.876 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:20.876 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:20.876 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:20.876 03:18:55 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t rdma -a 192.168.100.8 -s 4420 00:18:20.876 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:20.876 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.134 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.134 03:18:55 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:21.134 03:18:55 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:18:21.134 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:21.134 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.134 Malloc6 00:18:21.134 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.134 03:18:55 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:18:21.134 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:21.134 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.134 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.134 03:18:55 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:18:21.134 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:21.134 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.134 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.134 03:18:55 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t rdma -a 192.168.100.8 -s 4420 00:18:21.134 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:21.134 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.134 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.134 03:18:55 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:21.134 03:18:55 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:18:21.134 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:21.134 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.134 Malloc7 00:18:21.134 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.134 03:18:55 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:18:21.134 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:21.134 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.134 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.134 03:18:55 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:18:21.134 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:21.134 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.134 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.134 03:18:55 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t rdma -a 192.168.100.8 -s 4420 00:18:21.134 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:21.134 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.134 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.134 03:18:55 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:21.134 03:18:55 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:18:21.134 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:21.134 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.134 Malloc8 00:18:21.134 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.134 03:18:55 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:18:21.134 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:21.134 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.134 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.134 03:18:55 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:18:21.134 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:21.134 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.134 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.134 03:18:55 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t rdma -a 192.168.100.8 -s 4420 00:18:21.134 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:21.134 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.134 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.134 03:18:55 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:21.134 03:18:55 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:18:21.134 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:21.134 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.134 Malloc9 00:18:21.134 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.134 03:18:55 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:18:21.134 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:21.134 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.134 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.134 03:18:55 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:18:21.134 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:21.134 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.134 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.134 03:18:55 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t rdma -a 192.168.100.8 -s 4420 00:18:21.134 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:21.134 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.134 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.134 03:18:55 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:21.134 03:18:55 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:18:21.134 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:21.134 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.134 Malloc10 00:18:21.134 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.134 03:18:55 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:18:21.134 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:21.134 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.134 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.134 03:18:55 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:18:21.134 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:21.134 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.134 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.134 03:18:55 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t rdma -a 192.168.100.8 -s 4420 00:18:21.134 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:21.134 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.134 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.134 03:18:55 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:21.134 03:18:55 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:18:21.134 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:21.135 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.135 Malloc11 00:18:21.135 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.135 03:18:55 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:18:21.135 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:21.135 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.392 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.392 03:18:55 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:18:21.392 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:21.392 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.392 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.392 03:18:55 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t rdma -a 192.168.100.8 -s 4420 00:18:21.392 03:18:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:21.392 03:18:55 -- common/autotest_common.sh@10 -- # set +x 00:18:21.392 03:18:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.392 03:18:55 -- target/multiconnection.sh@28 -- # seq 1 11 00:18:21.392 03:18:55 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:21.392 03:18:55 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:18:21.392 03:18:55 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:18:21.392 03:18:55 -- common/autotest_common.sh@1184 -- # local i=0 00:18:21.392 03:18:55 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:18:21.392 03:18:55 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:18:21.392 03:18:55 -- common/autotest_common.sh@1191 -- # sleep 2 00:18:23.917 03:18:57 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:18:23.917 03:18:57 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:18:23.917 03:18:57 -- common/autotest_common.sh@1193 -- # grep -c SPDK1 00:18:23.917 03:18:57 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:18:23.917 03:18:57 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:18:23.917 03:18:57 -- common/autotest_common.sh@1194 -- # return 0 00:18:23.917 03:18:57 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:23.917 03:18:57 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode2 -a 192.168.100.8 -s 4420 00:18:23.917 03:18:58 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:18:23.917 03:18:58 -- common/autotest_common.sh@1184 -- # local i=0 00:18:23.917 03:18:58 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:18:23.917 03:18:58 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:18:23.917 03:18:58 -- common/autotest_common.sh@1191 -- # sleep 2 00:18:25.871 03:19:00 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:18:25.871 03:19:00 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:18:25.871 03:19:00 -- common/autotest_common.sh@1193 -- # grep -c SPDK2 00:18:25.871 03:19:00 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:18:25.871 03:19:00 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:18:25.871 03:19:00 -- common/autotest_common.sh@1194 -- # return 0 00:18:25.871 03:19:00 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:25.871 03:19:00 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode3 -a 192.168.100.8 -s 4420 00:18:25.871 03:19:00 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:18:25.871 03:19:00 -- common/autotest_common.sh@1184 -- # local i=0 00:18:25.871 03:19:00 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:18:25.871 03:19:00 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:18:25.871 03:19:00 -- common/autotest_common.sh@1191 -- # sleep 2 00:18:28.396 03:19:02 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:18:28.396 03:19:02 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:18:28.396 03:19:02 -- common/autotest_common.sh@1193 -- # grep -c SPDK3 00:18:28.396 03:19:02 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:18:28.396 03:19:02 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:18:28.396 03:19:02 -- common/autotest_common.sh@1194 -- # return 0 00:18:28.396 03:19:02 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:28.396 03:19:02 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode4 -a 192.168.100.8 -s 4420 00:18:28.396 03:19:02 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:18:28.396 03:19:02 -- common/autotest_common.sh@1184 -- # local i=0 00:18:28.396 03:19:02 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:18:28.396 03:19:02 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:18:28.396 03:19:02 -- common/autotest_common.sh@1191 -- # sleep 2 00:18:30.299 03:19:04 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:18:30.299 03:19:04 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:18:30.299 03:19:04 -- common/autotest_common.sh@1193 -- # grep -c SPDK4 00:18:30.300 03:19:04 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:18:30.300 03:19:04 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:18:30.300 03:19:04 -- common/autotest_common.sh@1194 -- # return 0 00:18:30.300 03:19:04 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:30.300 03:19:04 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode5 -a 192.168.100.8 -s 4420 00:18:30.556 03:19:04 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:18:30.556 03:19:04 -- common/autotest_common.sh@1184 -- # local i=0 00:18:30.556 03:19:04 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:18:30.556 03:19:04 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:18:30.556 03:19:04 -- common/autotest_common.sh@1191 -- # sleep 2 00:18:32.451 03:19:06 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:18:32.451 03:19:06 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:18:32.451 03:19:06 -- common/autotest_common.sh@1193 -- # grep -c SPDK5 00:18:32.451 03:19:06 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:18:32.451 03:19:06 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:18:32.451 03:19:06 -- common/autotest_common.sh@1194 -- # return 0 00:18:32.451 03:19:06 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:32.451 03:19:06 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode6 -a 192.168.100.8 -s 4420 00:18:32.708 03:19:07 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:18:32.708 03:19:07 -- common/autotest_common.sh@1184 -- # local i=0 00:18:32.708 03:19:07 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:18:32.708 03:19:07 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:18:32.708 03:19:07 -- common/autotest_common.sh@1191 -- # sleep 2 00:18:34.602 03:19:09 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:18:34.602 03:19:09 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:18:34.602 03:19:09 -- common/autotest_common.sh@1193 -- # grep -c SPDK6 00:18:34.602 03:19:09 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:18:34.602 03:19:09 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:18:34.602 03:19:09 -- common/autotest_common.sh@1194 -- # return 0 00:18:34.602 03:19:09 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:34.602 03:19:09 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode7 -a 192.168.100.8 -s 4420 00:18:34.859 03:19:09 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:18:34.859 03:19:09 -- common/autotest_common.sh@1184 -- # local i=0 00:18:34.859 03:19:09 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:18:34.859 03:19:09 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:18:34.859 03:19:09 -- common/autotest_common.sh@1191 -- # sleep 2 00:18:37.383 03:19:11 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:18:37.383 03:19:11 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:18:37.383 03:19:11 -- common/autotest_common.sh@1193 -- # grep -c SPDK7 00:18:37.383 03:19:11 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:18:37.383 03:19:11 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:18:37.383 03:19:11 -- common/autotest_common.sh@1194 -- # return 0 00:18:37.383 03:19:11 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:37.383 03:19:11 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode8 -a 192.168.100.8 -s 4420 00:18:37.383 03:19:11 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:18:37.383 03:19:11 -- common/autotest_common.sh@1184 -- # local i=0 00:18:37.383 03:19:11 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:18:37.383 03:19:11 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:18:37.383 03:19:11 -- common/autotest_common.sh@1191 -- # sleep 2 00:18:39.274 03:19:13 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:18:39.274 03:19:13 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:18:39.274 03:19:13 -- common/autotest_common.sh@1193 -- # grep -c SPDK8 00:18:39.274 03:19:13 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:18:39.274 03:19:13 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:18:39.274 03:19:13 -- common/autotest_common.sh@1194 -- # return 0 00:18:39.274 03:19:13 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:39.274 03:19:13 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode9 -a 192.168.100.8 -s 4420 00:18:39.531 03:19:13 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:18:39.531 03:19:13 -- common/autotest_common.sh@1184 -- # local i=0 00:18:39.531 03:19:13 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:18:39.531 03:19:13 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:18:39.531 03:19:13 -- common/autotest_common.sh@1191 -- # sleep 2 00:18:41.421 03:19:15 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:18:41.421 03:19:15 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:18:41.421 03:19:15 -- common/autotest_common.sh@1193 -- # grep -c SPDK9 00:18:41.421 03:19:15 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:18:41.421 03:19:15 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:18:41.421 03:19:15 -- common/autotest_common.sh@1194 -- # return 0 00:18:41.421 03:19:15 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:41.421 03:19:15 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode10 -a 192.168.100.8 -s 4420 00:18:41.679 03:19:16 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:18:41.679 03:19:16 -- common/autotest_common.sh@1184 -- # local i=0 00:18:41.679 03:19:16 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:18:41.679 03:19:16 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:18:41.679 03:19:16 -- common/autotest_common.sh@1191 -- # sleep 2 00:18:43.575 03:19:18 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:18:43.575 03:19:18 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:18:43.575 03:19:18 -- common/autotest_common.sh@1193 -- # grep -c SPDK10 00:18:43.575 03:19:18 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:18:43.575 03:19:18 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:18:43.575 03:19:18 -- common/autotest_common.sh@1194 -- # return 0 00:18:43.575 03:19:18 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:43.575 03:19:18 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode11 -a 192.168.100.8 -s 4420 00:18:43.832 03:19:18 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:18:43.832 03:19:18 -- common/autotest_common.sh@1184 -- # local i=0 00:18:43.832 03:19:18 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:18:43.832 03:19:18 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:18:43.832 03:19:18 -- common/autotest_common.sh@1191 -- # sleep 2 00:18:46.355 03:19:20 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:18:46.355 03:19:20 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:18:46.355 03:19:20 -- common/autotest_common.sh@1193 -- # grep -c SPDK11 00:18:46.355 03:19:20 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:18:46.355 03:19:20 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:18:46.355 03:19:20 -- common/autotest_common.sh@1194 -- # return 0 00:18:46.355 03:19:20 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:18:46.355 [global] 00:18:46.355 thread=1 00:18:46.355 invalidate=1 00:18:46.355 rw=read 00:18:46.355 time_based=1 00:18:46.355 runtime=10 00:18:46.355 ioengine=libaio 00:18:46.355 direct=1 00:18:46.355 bs=262144 00:18:46.355 iodepth=64 00:18:46.355 norandommap=1 00:18:46.355 numjobs=1 00:18:46.355 00:18:46.355 [job0] 00:18:46.355 filename=/dev/nvme0n1 00:18:46.355 [job1] 00:18:46.355 filename=/dev/nvme10n1 00:18:46.355 [job2] 00:18:46.355 filename=/dev/nvme11n1 00:18:46.355 [job3] 00:18:46.355 filename=/dev/nvme2n1 00:18:46.355 [job4] 00:18:46.355 filename=/dev/nvme3n1 00:18:46.355 [job5] 00:18:46.355 filename=/dev/nvme4n1 00:18:46.355 [job6] 00:18:46.355 filename=/dev/nvme5n1 00:18:46.355 [job7] 00:18:46.355 filename=/dev/nvme6n1 00:18:46.355 [job8] 00:18:46.355 filename=/dev/nvme7n1 00:18:46.355 [job9] 00:18:46.355 filename=/dev/nvme8n1 00:18:46.355 [job10] 00:18:46.355 filename=/dev/nvme9n1 00:18:46.355 Could not set queue depth (nvme0n1) 00:18:46.355 Could not set queue depth (nvme10n1) 00:18:46.355 Could not set queue depth (nvme11n1) 00:18:46.355 Could not set queue depth (nvme2n1) 00:18:46.355 Could not set queue depth (nvme3n1) 00:18:46.355 Could not set queue depth (nvme4n1) 00:18:46.355 Could not set queue depth (nvme5n1) 00:18:46.355 Could not set queue depth (nvme6n1) 00:18:46.355 Could not set queue depth (nvme7n1) 00:18:46.355 Could not set queue depth (nvme8n1) 00:18:46.355 Could not set queue depth (nvme9n1) 00:18:46.355 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:46.355 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:46.355 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:46.355 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:46.355 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:46.355 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:46.355 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:46.355 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:46.355 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:46.355 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:46.355 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:46.355 fio-3.35 00:18:46.355 Starting 11 threads 00:18:58.602 00:18:58.602 job0: (groupid=0, jobs=1): err= 0: pid=4116796: Thu Apr 25 03:19:31 2024 00:18:58.602 read: IOPS=1148, BW=287MiB/s (301MB/s)(2883MiB/10039msec) 00:18:58.602 slat (usec): min=9, max=23626, avg=864.04, stdev=2213.84 00:18:58.602 clat (usec): min=10422, max=94638, avg=54808.55, stdev=11154.78 00:18:58.602 lat (usec): min=10634, max=95452, avg=55672.59, stdev=11472.62 00:18:58.602 clat percentiles (usec): 00:18:58.602 | 1.00th=[38011], 5.00th=[39584], 10.00th=[41681], 20.00th=[44303], 00:18:58.602 | 30.00th=[47973], 40.00th=[49021], 50.00th=[51119], 60.00th=[54789], 00:18:58.602 | 70.00th=[65799], 80.00th=[66847], 90.00th=[67634], 95.00th=[70779], 00:18:58.602 | 99.00th=[78119], 99.50th=[80217], 99.90th=[85459], 99.95th=[89654], 00:18:58.602 | 99.99th=[94897] 00:18:58.602 bw ( KiB/s): min=230912, max=385536, per=6.21%, avg=293767.80, stdev=55665.24, samples=20 00:18:58.602 iops : min= 902, max= 1506, avg=1147.30, stdev=217.38, samples=20 00:18:58.602 lat (msec) : 20=0.23%, 50=46.63%, 100=53.14% 00:18:58.602 cpu : usr=0.45%, sys=4.41%, ctx=2455, majf=0, minf=4097 00:18:58.602 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:18:58.602 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:58.602 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:18:58.602 issued rwts: total=11531,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:58.602 latency : target=0, window=0, percentile=100.00%, depth=64 00:18:58.602 job1: (groupid=0, jobs=1): err= 0: pid=4116813: Thu Apr 25 03:19:31 2024 00:18:58.602 read: IOPS=1435, BW=359MiB/s (376MB/s)(3604MiB/10038msec) 00:18:58.602 slat (usec): min=10, max=25659, avg=687.62, stdev=1793.68 00:18:58.602 clat (usec): min=442, max=90752, avg=43844.93, stdev=21742.90 00:18:58.602 lat (usec): min=497, max=90788, avg=44532.55, stdev=22135.09 00:18:58.602 clat percentiles (usec): 00:18:58.602 | 1.00th=[ 5538], 5.00th=[12125], 10.00th=[12518], 20.00th=[12911], 00:18:58.602 | 30.00th=[41681], 40.00th=[45876], 50.00th=[48497], 60.00th=[51119], 00:18:58.602 | 70.00th=[57934], 80.00th=[66323], 90.00th=[67634], 95.00th=[68682], 00:18:58.602 | 99.00th=[77071], 99.50th=[79168], 99.90th=[83362], 99.95th=[84411], 00:18:58.602 | 99.99th=[90702] 00:18:58.602 bw ( KiB/s): min=226816, max=1296896, per=7.77%, avg=367385.60, stdev=266108.68, samples=20 00:18:58.602 iops : min= 886, max= 5066, avg=1435.10, stdev=1039.49, samples=20 00:18:58.602 lat (usec) : 500=0.01%, 750=0.02%, 1000=0.04% 00:18:58.602 lat (msec) : 2=0.12%, 4=0.70%, 10=0.87%, 20=26.52%, 50=29.44% 00:18:58.602 lat (msec) : 100=42.29% 00:18:58.602 cpu : usr=0.35%, sys=5.18%, ctx=3422, majf=0, minf=4097 00:18:58.602 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:18:58.602 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:58.602 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:18:58.602 issued rwts: total=14414,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:58.602 latency : target=0, window=0, percentile=100.00%, depth=64 00:18:58.602 job2: (groupid=0, jobs=1): err= 0: pid=4116821: Thu Apr 25 03:19:31 2024 00:18:58.602 read: IOPS=2846, BW=712MiB/s (746MB/s)(7144MiB/10038msec) 00:18:58.602 slat (usec): min=8, max=51943, avg=341.75, stdev=1425.68 00:18:58.602 clat (usec): min=448, max=118053, avg=22122.36, stdev=15470.18 00:18:58.602 lat (usec): min=529, max=120887, avg=22464.11, stdev=15743.53 00:18:58.602 clat percentiles (msec): 00:18:58.602 | 1.00th=[ 11], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 13], 00:18:58.602 | 30.00th=[ 13], 40.00th=[ 13], 50.00th=[ 14], 60.00th=[ 14], 00:18:58.602 | 70.00th=[ 26], 80.00th=[ 34], 90.00th=[ 37], 95.00th=[ 67], 00:18:58.602 | 99.00th=[ 71], 99.50th=[ 74], 99.90th=[ 90], 99.95th=[ 94], 00:18:58.602 | 99.99th=[ 111] 00:18:58.602 bw ( KiB/s): min=235008, max=1274356, per=15.44%, avg=730269.65, stdev=400927.79, samples=20 00:18:58.602 iops : min= 918, max= 4977, avg=2852.50, stdev=1566.19, samples=20 00:18:58.602 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:18:58.602 lat (msec) : 2=0.06%, 4=0.10%, 10=0.70%, 20=62.15%, 50=30.09% 00:18:58.602 lat (msec) : 100=6.82%, 250=0.04% 00:18:58.602 cpu : usr=0.37%, sys=6.62%, ctx=7120, majf=0, minf=4097 00:18:58.602 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:18:58.602 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:58.602 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:18:58.602 issued rwts: total=28574,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:58.602 latency : target=0, window=0, percentile=100.00%, depth=64 00:18:58.602 job3: (groupid=0, jobs=1): err= 0: pid=4116829: Thu Apr 25 03:19:31 2024 00:18:58.602 read: IOPS=1149, BW=287MiB/s (301MB/s)(2884MiB/10038msec) 00:18:58.602 slat (usec): min=10, max=24177, avg=863.46, stdev=2041.52 00:18:58.602 clat (usec): min=11195, max=95290, avg=54777.55, stdev=11042.20 00:18:58.602 lat (usec): min=11399, max=95329, avg=55641.02, stdev=11334.33 00:18:58.602 clat percentiles (usec): 00:18:58.602 | 1.00th=[38536], 5.00th=[39584], 10.00th=[41681], 20.00th=[44303], 00:18:58.602 | 30.00th=[47973], 40.00th=[49021], 50.00th=[51643], 60.00th=[54789], 00:18:58.602 | 70.00th=[65799], 80.00th=[66847], 90.00th=[67634], 95.00th=[70779], 00:18:58.602 | 99.00th=[78119], 99.50th=[80217], 99.90th=[84411], 99.95th=[85459], 00:18:58.602 | 99.99th=[91751] 00:18:58.602 bw ( KiB/s): min=228864, max=394240, per=6.21%, avg=293770.40, stdev=55338.02, samples=20 00:18:58.602 iops : min= 894, max= 1540, avg=1147.50, stdev=216.11, samples=20 00:18:58.602 lat (msec) : 20=0.20%, 50=46.62%, 100=53.19% 00:18:58.602 cpu : usr=0.41%, sys=4.68%, ctx=2446, majf=0, minf=4097 00:18:58.602 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:18:58.602 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:58.602 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:18:58.602 issued rwts: total=11537,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:58.602 latency : target=0, window=0, percentile=100.00%, depth=64 00:18:58.602 job4: (groupid=0, jobs=1): err= 0: pid=4116833: Thu Apr 25 03:19:31 2024 00:18:58.602 read: IOPS=2033, BW=508MiB/s (533MB/s)(5105MiB/10039msec) 00:18:58.602 slat (usec): min=8, max=52981, avg=484.93, stdev=2053.44 00:18:58.602 clat (msec): min=6, max=125, avg=30.95, stdev=20.69 00:18:58.602 lat (msec): min=6, max=125, avg=31.44, stdev=21.08 00:18:58.602 clat percentiles (msec): 00:18:58.602 | 1.00th=[ 12], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 13], 00:18:58.602 | 30.00th=[ 13], 40.00th=[ 14], 50.00th=[ 25], 60.00th=[ 28], 00:18:58.602 | 70.00th=[ 48], 80.00th=[ 52], 90.00th=[ 66], 95.00th=[ 68], 00:18:58.602 | 99.00th=[ 73], 99.50th=[ 78], 99.90th=[ 95], 99.95th=[ 110], 00:18:58.602 | 99.99th=[ 124] 00:18:58.602 bw ( KiB/s): min=218624, max=1274356, per=11.03%, avg=521439.45, stdev=381364.04, samples=20 00:18:58.602 iops : min= 854, max= 4977, avg=2036.60, stdev=1489.69, samples=20 00:18:58.602 lat (msec) : 10=0.39%, 20=46.28%, 50=31.98%, 100=21.25%, 250=0.09% 00:18:58.602 cpu : usr=0.31%, sys=5.18%, ctx=4834, majf=0, minf=4097 00:18:58.602 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.7% 00:18:58.602 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:58.603 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:18:58.603 issued rwts: total=20419,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:58.603 latency : target=0, window=0, percentile=100.00%, depth=64 00:18:58.603 job5: (groupid=0, jobs=1): err= 0: pid=4116846: Thu Apr 25 03:19:31 2024 00:18:58.603 read: IOPS=1136, BW=284MiB/s (298MB/s)(2849MiB/10031msec) 00:18:58.603 slat (usec): min=9, max=24637, avg=866.41, stdev=2206.58 00:18:58.603 clat (usec): min=10438, max=90572, avg=55410.75, stdev=11199.96 00:18:58.603 lat (usec): min=10649, max=92899, avg=56277.16, stdev=11507.19 00:18:58.603 clat percentiles (usec): 00:18:58.603 | 1.00th=[35914], 5.00th=[38536], 10.00th=[39584], 20.00th=[47973], 00:18:58.603 | 30.00th=[49021], 40.00th=[51119], 50.00th=[53740], 60.00th=[56886], 00:18:58.603 | 70.00th=[65799], 80.00th=[66847], 90.00th=[67634], 95.00th=[70779], 00:18:58.603 | 99.00th=[78119], 99.50th=[80217], 99.90th=[88605], 99.95th=[89654], 00:18:58.603 | 99.99th=[90702] 00:18:58.603 bw ( KiB/s): min=232448, max=404992, per=6.14%, avg=290337.65, stdev=53406.94, samples=20 00:18:58.603 iops : min= 908, max= 1582, avg=1133.95, stdev=208.65, samples=20 00:18:58.603 lat (msec) : 20=0.25%, 50=36.30%, 100=63.46% 00:18:58.603 cpu : usr=0.22%, sys=3.87%, ctx=2613, majf=0, minf=4097 00:18:58.603 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:18:58.603 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:58.603 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:18:58.603 issued rwts: total=11397,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:58.603 latency : target=0, window=0, percentile=100.00%, depth=64 00:18:58.603 job6: (groupid=0, jobs=1): err= 0: pid=4116851: Thu Apr 25 03:19:31 2024 00:18:58.603 read: IOPS=2031, BW=508MiB/s (532MB/s)(5098MiB/10038msec) 00:18:58.603 slat (usec): min=9, max=8187, avg=488.21, stdev=1068.34 00:18:58.603 clat (usec): min=10002, max=79812, avg=30991.87, stdev=6220.79 00:18:58.603 lat (usec): min=10202, max=83712, avg=31480.08, stdev=6351.74 00:18:58.603 clat percentiles (usec): 00:18:58.603 | 1.00th=[22938], 5.00th=[23462], 10.00th=[23987], 20.00th=[24511], 00:18:58.603 | 30.00th=[25035], 40.00th=[26084], 50.00th=[32900], 60.00th=[34341], 00:18:58.603 | 70.00th=[35914], 80.00th=[36439], 90.00th=[37487], 95.00th=[38536], 00:18:58.603 | 99.00th=[44303], 99.50th=[45876], 99.90th=[69731], 99.95th=[74974], 00:18:58.603 | 99.99th=[80217] 00:18:58.603 bw ( KiB/s): min=408881, max=659456, per=11.01%, avg=520696.55, stdev=97809.93, samples=20 00:18:58.603 iops : min= 1597, max= 2576, avg=2033.85, stdev=382.14, samples=20 00:18:58.603 lat (msec) : 20=0.19%, 50=99.57%, 100=0.24% 00:18:58.603 cpu : usr=0.56%, sys=6.12%, ctx=4482, majf=0, minf=4097 00:18:58.603 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.7% 00:18:58.603 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:58.603 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:18:58.603 issued rwts: total=20390,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:58.603 latency : target=0, window=0, percentile=100.00%, depth=64 00:18:58.603 job7: (groupid=0, jobs=1): err= 0: pid=4116854: Thu Apr 25 03:19:31 2024 00:18:58.603 read: IOPS=1598, BW=400MiB/s (419MB/s)(4008MiB/10031msec) 00:18:58.603 slat (usec): min=9, max=13079, avg=621.22, stdev=1434.24 00:18:58.603 clat (usec): min=10025, max=66334, avg=39391.80, stdev=10069.23 00:18:58.603 lat (usec): min=10221, max=67137, avg=40013.02, stdev=10282.27 00:18:58.603 clat percentiles (usec): 00:18:58.603 | 1.00th=[25297], 5.00th=[26084], 10.00th=[26608], 20.00th=[27395], 00:18:58.603 | 30.00th=[28967], 40.00th=[39060], 50.00th=[40109], 60.00th=[41157], 00:18:58.603 | 70.00th=[47973], 80.00th=[49546], 90.00th=[53216], 95.00th=[54264], 00:18:58.603 | 99.00th=[57934], 99.50th=[60031], 99.90th=[63177], 99.95th=[64750], 00:18:58.603 | 99.99th=[66323] 00:18:58.603 bw ( KiB/s): min=293888, max=597675, per=8.65%, avg=409018.25, stdev=104024.43, samples=20 00:18:58.603 iops : min= 1148, max= 2334, avg=1597.60, stdev=406.34, samples=20 00:18:58.603 lat (msec) : 20=0.17%, 50=81.88%, 100=17.94% 00:18:58.603 cpu : usr=0.47%, sys=5.58%, ctx=3478, majf=0, minf=4097 00:18:58.603 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:18:58.603 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:58.603 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:18:58.603 issued rwts: total=16030,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:58.603 latency : target=0, window=0, percentile=100.00%, depth=64 00:18:58.603 job8: (groupid=0, jobs=1): err= 0: pid=4116856: Thu Apr 25 03:19:31 2024 00:18:58.603 read: IOPS=1599, BW=400MiB/s (419MB/s)(4012MiB/10031msec) 00:18:58.603 slat (usec): min=10, max=12223, avg=620.30, stdev=1406.24 00:18:58.603 clat (usec): min=10304, max=67137, avg=39352.61, stdev=10035.92 00:18:58.603 lat (usec): min=10602, max=68494, avg=39972.90, stdev=10250.17 00:18:58.603 clat percentiles (usec): 00:18:58.603 | 1.00th=[25560], 5.00th=[26084], 10.00th=[26608], 20.00th=[27132], 00:18:58.603 | 30.00th=[28705], 40.00th=[39060], 50.00th=[40109], 60.00th=[40633], 00:18:58.603 | 70.00th=[47973], 80.00th=[49546], 90.00th=[53216], 95.00th=[54264], 00:18:58.603 | 99.00th=[57410], 99.50th=[58983], 99.90th=[61604], 99.95th=[63701], 00:18:58.603 | 99.99th=[66847] 00:18:58.603 bw ( KiB/s): min=295424, max=598701, per=8.66%, avg=409428.65, stdev=104475.25, samples=20 00:18:58.603 iops : min= 1154, max= 2338, avg=1599.20, stdev=408.10, samples=20 00:18:58.603 lat (msec) : 20=0.17%, 50=81.96%, 100=17.86% 00:18:58.603 cpu : usr=0.50%, sys=5.67%, ctx=3477, majf=0, minf=4097 00:18:58.603 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:18:58.603 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:58.603 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:18:58.603 issued rwts: total=16046,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:58.603 latency : target=0, window=0, percentile=100.00%, depth=64 00:18:58.603 job9: (groupid=0, jobs=1): err= 0: pid=4116857: Thu Apr 25 03:19:31 2024 00:18:58.603 read: IOPS=1461, BW=365MiB/s (383MB/s)(3667MiB/10039msec) 00:18:58.603 slat (usec): min=10, max=34283, avg=661.84, stdev=1549.72 00:18:58.603 clat (usec): min=9946, max=86258, avg=43101.33, stdev=7771.95 00:18:58.603 lat (usec): min=10139, max=86312, avg=43763.17, stdev=7946.28 00:18:58.603 clat percentiles (usec): 00:18:58.603 | 1.00th=[33162], 5.00th=[35390], 10.00th=[35914], 20.00th=[36439], 00:18:58.603 | 30.00th=[37487], 40.00th=[39060], 50.00th=[40109], 60.00th=[41681], 00:18:58.603 | 70.00th=[48497], 80.00th=[50070], 90.00th=[53740], 95.00th=[54789], 00:18:58.603 | 99.00th=[68682], 99.50th=[72877], 99.90th=[79168], 99.95th=[83362], 00:18:58.603 | 99.99th=[86508] 00:18:58.603 bw ( KiB/s): min=300032, max=444928, per=7.91%, avg=373913.60, stdev=55544.73, samples=20 00:18:58.603 iops : min= 1172, max= 1738, avg=1460.60, stdev=216.97, samples=20 00:18:58.603 lat (msec) : 10=0.01%, 20=0.23%, 50=79.28%, 100=20.49% 00:18:58.603 cpu : usr=0.45%, sys=5.35%, ctx=3451, majf=0, minf=4097 00:18:58.603 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:18:58.603 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:58.603 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:18:58.603 issued rwts: total=14669,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:58.603 latency : target=0, window=0, percentile=100.00%, depth=64 00:18:58.603 job10: (groupid=0, jobs=1): err= 0: pid=4116858: Thu Apr 25 03:19:31 2024 00:18:58.603 read: IOPS=2033, BW=508MiB/s (533MB/s)(5103MiB/10038msec) 00:18:58.603 slat (usec): min=9, max=11152, avg=487.92, stdev=1127.98 00:18:58.603 clat (usec): min=8512, max=86726, avg=30957.35, stdev=6218.03 00:18:58.603 lat (usec): min=8706, max=86762, avg=31445.27, stdev=6361.35 00:18:58.603 clat percentiles (usec): 00:18:58.603 | 1.00th=[22938], 5.00th=[23462], 10.00th=[23725], 20.00th=[24511], 00:18:58.603 | 30.00th=[25035], 40.00th=[26084], 50.00th=[32900], 60.00th=[34341], 00:18:58.603 | 70.00th=[35914], 80.00th=[36439], 90.00th=[37487], 95.00th=[38536], 00:18:58.603 | 99.00th=[44827], 99.50th=[45876], 99.90th=[68682], 99.95th=[71828], 00:18:58.603 | 99.99th=[78119] 00:18:58.603 bw ( KiB/s): min=409907, max=666112, per=11.02%, avg=521285.05, stdev=98024.66, samples=20 00:18:58.603 iops : min= 1601, max= 2602, avg=2036.15, stdev=382.98, samples=20 00:18:58.603 lat (msec) : 10=0.04%, 20=0.14%, 50=99.55%, 100=0.26% 00:18:58.603 cpu : usr=0.44%, sys=6.12%, ctx=4504, majf=0, minf=3347 00:18:58.603 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.7% 00:18:58.603 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:58.603 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:18:58.603 issued rwts: total=20413,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:58.603 latency : target=0, window=0, percentile=100.00%, depth=64 00:18:58.603 00:18:58.603 Run status group 0 (all jobs): 00:18:58.603 READ: bw=4617MiB/s (4842MB/s), 284MiB/s-712MiB/s (298MB/s-746MB/s), io=45.3GiB (48.6GB), run=10031-10039msec 00:18:58.603 00:18:58.603 Disk stats (read/write): 00:18:58.603 nvme0n1: ios=22937/0, merge=0/0, ticks=1229975/0, in_queue=1229975, util=97.82% 00:18:58.603 nvme10n1: ios=28686/0, merge=0/0, ticks=1232389/0, in_queue=1232389, util=97.97% 00:18:58.603 nvme11n1: ios=57014/0, merge=0/0, ticks=1223851/0, in_queue=1223851, util=98.10% 00:18:58.604 nvme2n1: ios=22945/0, merge=0/0, ticks=1231427/0, in_queue=1231427, util=98.19% 00:18:58.604 nvme3n1: ios=40711/0, merge=0/0, ticks=1224301/0, in_queue=1224301, util=98.24% 00:18:58.604 nvme4n1: ios=22668/0, merge=0/0, ticks=1229973/0, in_queue=1229973, util=98.53% 00:18:58.604 nvme5n1: ios=40654/0, merge=0/0, ticks=1224876/0, in_queue=1224876, util=98.65% 00:18:58.604 nvme6n1: ios=31932/0, merge=0/0, ticks=1228571/0, in_queue=1228571, util=98.74% 00:18:58.604 nvme7n1: ios=31966/0, merge=0/0, ticks=1229446/0, in_queue=1229446, util=99.04% 00:18:58.604 nvme8n1: ios=29204/0, merge=0/0, ticks=1229174/0, in_queue=1229174, util=99.16% 00:18:58.604 nvme9n1: ios=40702/0, merge=0/0, ticks=1225556/0, in_queue=1225556, util=99.26% 00:18:58.604 03:19:31 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:18:58.604 [global] 00:18:58.604 thread=1 00:18:58.604 invalidate=1 00:18:58.604 rw=randwrite 00:18:58.604 time_based=1 00:18:58.604 runtime=10 00:18:58.604 ioengine=libaio 00:18:58.604 direct=1 00:18:58.604 bs=262144 00:18:58.604 iodepth=64 00:18:58.604 norandommap=1 00:18:58.604 numjobs=1 00:18:58.604 00:18:58.604 [job0] 00:18:58.604 filename=/dev/nvme0n1 00:18:58.604 [job1] 00:18:58.604 filename=/dev/nvme10n1 00:18:58.604 [job2] 00:18:58.604 filename=/dev/nvme11n1 00:18:58.604 [job3] 00:18:58.604 filename=/dev/nvme2n1 00:18:58.604 [job4] 00:18:58.604 filename=/dev/nvme3n1 00:18:58.604 [job5] 00:18:58.604 filename=/dev/nvme4n1 00:18:58.604 [job6] 00:18:58.604 filename=/dev/nvme5n1 00:18:58.604 [job7] 00:18:58.604 filename=/dev/nvme6n1 00:18:58.604 [job8] 00:18:58.604 filename=/dev/nvme7n1 00:18:58.604 [job9] 00:18:58.604 filename=/dev/nvme8n1 00:18:58.604 [job10] 00:18:58.604 filename=/dev/nvme9n1 00:18:58.604 Could not set queue depth (nvme0n1) 00:18:58.604 Could not set queue depth (nvme10n1) 00:18:58.604 Could not set queue depth (nvme11n1) 00:18:58.604 Could not set queue depth (nvme2n1) 00:18:58.604 Could not set queue depth (nvme3n1) 00:18:58.604 Could not set queue depth (nvme4n1) 00:18:58.604 Could not set queue depth (nvme5n1) 00:18:58.604 Could not set queue depth (nvme6n1) 00:18:58.604 Could not set queue depth (nvme7n1) 00:18:58.604 Could not set queue depth (nvme8n1) 00:18:58.604 Could not set queue depth (nvme9n1) 00:18:58.604 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:58.604 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:58.604 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:58.604 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:58.604 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:58.604 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:58.604 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:58.604 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:58.604 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:58.604 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:58.604 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:58.604 fio-3.35 00:18:58.604 Starting 11 threads 00:19:08.571 00:19:08.571 job0: (groupid=0, jobs=1): err= 0: pid=4118598: Thu Apr 25 03:19:41 2024 00:19:08.571 write: IOPS=1290, BW=323MiB/s (338MB/s)(3248MiB/10066msec); 0 zone resets 00:19:08.571 slat (usec): min=21, max=85927, avg=758.63, stdev=2762.84 00:19:08.571 clat (msec): min=5, max=169, avg=48.82, stdev=21.23 00:19:08.571 lat (msec): min=5, max=169, avg=49.57, stdev=21.66 00:19:08.571 clat percentiles (msec): 00:19:08.571 | 1.00th=[ 29], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 33], 00:19:08.571 | 30.00th=[ 34], 40.00th=[ 36], 50.00th=[ 48], 60.00th=[ 50], 00:19:08.571 | 70.00th=[ 52], 80.00th=[ 59], 90.00th=[ 68], 95.00th=[ 108], 00:19:08.571 | 99.00th=[ 117], 99.50th=[ 127], 99.90th=[ 161], 99.95th=[ 165], 00:19:08.571 | 99.99th=[ 169] 00:19:08.571 bw ( KiB/s): min=136704, max=512000, per=8.99%, avg=330905.60, stdev=114565.60, samples=20 00:19:08.571 iops : min= 534, max= 2000, avg=1292.60, stdev=447.52, samples=20 00:19:08.571 lat (msec) : 10=0.04%, 20=0.15%, 50=61.72%, 100=30.99%, 250=7.09% 00:19:08.571 cpu : usr=2.61%, sys=3.99%, ctx=2735, majf=0, minf=1 00:19:08.571 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.5% 00:19:08.571 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:08.571 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:08.571 issued rwts: total=0,12990,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:08.571 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:08.571 job1: (groupid=0, jobs=1): err= 0: pid=4118623: Thu Apr 25 03:19:41 2024 00:19:08.571 write: IOPS=1375, BW=344MiB/s (361MB/s)(3461MiB/10066msec); 0 zone resets 00:19:08.571 slat (usec): min=19, max=48712, avg=707.86, stdev=2728.76 00:19:08.571 clat (msec): min=5, max=172, avg=45.80, stdev=22.97 00:19:08.571 lat (msec): min=5, max=172, avg=46.51, stdev=23.44 00:19:08.571 clat percentiles (msec): 00:19:08.571 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 33], 20.00th=[ 33], 00:19:08.571 | 30.00th=[ 34], 40.00th=[ 34], 50.00th=[ 35], 60.00th=[ 36], 00:19:08.571 | 70.00th=[ 48], 80.00th=[ 57], 90.00th=[ 94], 95.00th=[ 108], 00:19:08.571 | 99.00th=[ 113], 99.50th=[ 126], 99.90th=[ 153], 99.95th=[ 171], 00:19:08.571 | 99.99th=[ 174] 00:19:08.571 bw ( KiB/s): min=139776, max=487424, per=9.59%, avg=352865.60, stdev=137290.47, samples=20 00:19:08.571 iops : min= 546, max= 1904, avg=1378.35, stdev=536.26, samples=20 00:19:08.571 lat (msec) : 10=0.04%, 20=0.18%, 50=75.37%, 100=17.74%, 250=6.67% 00:19:08.571 cpu : usr=2.64%, sys=4.26%, ctx=2754, majf=0, minf=1 00:19:08.571 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.5% 00:19:08.571 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:08.571 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:08.571 issued rwts: total=0,13845,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:08.571 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:08.571 job2: (groupid=0, jobs=1): err= 0: pid=4118628: Thu Apr 25 03:19:41 2024 00:19:08.571 write: IOPS=991, BW=248MiB/s (260MB/s)(2496MiB/10069msec); 0 zone resets 00:19:08.571 slat (usec): min=22, max=80985, avg=973.41, stdev=3913.26 00:19:08.571 clat (usec): min=658, max=181393, avg=63567.75, stdev=23568.16 00:19:08.571 lat (usec): min=715, max=184395, avg=64541.15, stdev=24196.54 00:19:08.571 clat percentiles (msec): 00:19:08.571 | 1.00th=[ 14], 5.00th=[ 32], 10.00th=[ 43], 20.00th=[ 47], 00:19:08.571 | 30.00th=[ 48], 40.00th=[ 49], 50.00th=[ 62], 60.00th=[ 64], 00:19:08.571 | 70.00th=[ 71], 80.00th=[ 86], 90.00th=[ 101], 95.00th=[ 110], 00:19:08.571 | 99.00th=[ 116], 99.50th=[ 122], 99.90th=[ 140], 99.95th=[ 142], 00:19:08.571 | 99.99th=[ 182] 00:19:08.571 bw ( KiB/s): min=137216, max=432128, per=6.90%, avg=253900.80, stdev=83631.78, samples=20 00:19:08.571 iops : min= 536, max= 1688, avg=991.80, stdev=326.69, samples=20 00:19:08.571 lat (usec) : 750=0.01%, 1000=0.01% 00:19:08.571 lat (msec) : 2=0.14%, 4=0.53%, 10=0.21%, 20=0.28%, 50=43.98% 00:19:08.571 lat (msec) : 100=44.93%, 250=9.91% 00:19:08.571 cpu : usr=2.44%, sys=2.85%, ctx=2233, majf=0, minf=1 00:19:08.571 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:19:08.571 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:08.571 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:08.571 issued rwts: total=0,9982,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:08.571 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:08.571 job3: (groupid=0, jobs=1): err= 0: pid=4118633: Thu Apr 25 03:19:41 2024 00:19:08.571 write: IOPS=961, BW=240MiB/s (252MB/s)(2419MiB/10066msec); 0 zone resets 00:19:08.571 slat (usec): min=22, max=45087, avg=1030.78, stdev=3172.61 00:19:08.571 clat (msec): min=5, max=175, avg=65.51, stdev=21.22 00:19:08.571 lat (msec): min=5, max=175, avg=66.54, stdev=21.72 00:19:08.571 clat percentiles (msec): 00:19:08.571 | 1.00th=[ 48], 5.00th=[ 50], 10.00th=[ 51], 20.00th=[ 51], 00:19:08.571 | 30.00th=[ 52], 40.00th=[ 53], 50.00th=[ 54], 60.00th=[ 55], 00:19:08.571 | 70.00th=[ 75], 80.00th=[ 86], 90.00th=[ 101], 95.00th=[ 110], 00:19:08.571 | 99.00th=[ 117], 99.50th=[ 124], 99.90th=[ 163], 99.95th=[ 165], 00:19:08.571 | 99.99th=[ 176] 00:19:08.571 bw ( KiB/s): min=137216, max=318464, per=6.69%, avg=246118.40, stdev=70451.27, samples=20 00:19:08.571 iops : min= 536, max= 1244, avg=961.40, stdev=275.20, samples=20 00:19:08.571 lat (msec) : 10=0.03%, 20=0.11%, 50=10.94%, 100=79.01%, 250=9.90% 00:19:08.571 cpu : usr=2.21%, sys=3.36%, ctx=2149, majf=0, minf=1 00:19:08.571 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:19:08.571 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:08.571 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:08.571 issued rwts: total=0,9677,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:08.571 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:08.571 job4: (groupid=0, jobs=1): err= 0: pid=4118635: Thu Apr 25 03:19:41 2024 00:19:08.571 write: IOPS=1270, BW=318MiB/s (333MB/s)(3180MiB/10013msec); 0 zone resets 00:19:08.571 slat (usec): min=13, max=52291, avg=761.92, stdev=2647.66 00:19:08.571 clat (usec): min=676, max=161072, avg=49603.71, stdev=26009.00 00:19:08.571 lat (usec): min=721, max=163813, avg=50365.63, stdev=26535.49 00:19:08.571 clat percentiles (msec): 00:19:08.571 | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 16], 20.00th=[ 17], 00:19:08.571 | 30.00th=[ 49], 40.00th=[ 51], 50.00th=[ 52], 60.00th=[ 53], 00:19:08.571 | 70.00th=[ 54], 80.00th=[ 71], 90.00th=[ 87], 95.00th=[ 96], 00:19:08.571 | 99.00th=[ 112], 99.50th=[ 113], 99.90th=[ 127], 99.95th=[ 130], 00:19:08.571 | 99.99th=[ 161] 00:19:08.571 bw ( KiB/s): min=137216, max=961024, per=8.80%, avg=323993.60, stdev=215158.45, samples=20 00:19:08.571 iops : min= 536, max= 3754, avg=1265.60, stdev=840.46, samples=20 00:19:08.571 lat (usec) : 750=0.05%, 1000=0.04% 00:19:08.571 lat (msec) : 2=0.02%, 4=0.05%, 10=0.84%, 20=26.21%, 50=10.28% 00:19:08.571 lat (msec) : 100=59.56%, 250=2.96% 00:19:08.571 cpu : usr=2.71%, sys=3.60%, ctx=2613, majf=0, minf=1 00:19:08.571 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:19:08.571 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:08.571 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:08.571 issued rwts: total=0,12719,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:08.571 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:08.571 job5: (groupid=0, jobs=1): err= 0: pid=4118636: Thu Apr 25 03:19:41 2024 00:19:08.571 write: IOPS=1155, BW=289MiB/s (303MB/s)(2898MiB/10027msec); 0 zone resets 00:19:08.571 slat (usec): min=21, max=40418, avg=852.69, stdev=2690.89 00:19:08.571 clat (msec): min=5, max=128, avg=54.49, stdev=16.96 00:19:08.571 lat (msec): min=5, max=135, avg=55.35, stdev=17.39 00:19:08.571 clat percentiles (msec): 00:19:08.571 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 33], 20.00th=[ 43], 00:19:08.571 | 30.00th=[ 50], 40.00th=[ 51], 50.00th=[ 52], 60.00th=[ 53], 00:19:08.571 | 70.00th=[ 55], 80.00th=[ 61], 90.00th=[ 85], 95.00th=[ 88], 00:19:08.571 | 99.00th=[ 100], 99.50th=[ 107], 99.90th=[ 118], 99.95th=[ 126], 00:19:08.571 | 99.99th=[ 129] 00:19:08.571 bw ( KiB/s): min=177152, max=490496, per=8.02%, avg=295091.20, stdev=85404.99, samples=20 00:19:08.571 iops : min= 692, max= 1916, avg=1152.70, stdev=333.61, samples=20 00:19:08.571 lat (msec) : 10=0.02%, 20=0.11%, 50=32.31%, 100=66.83%, 250=0.73% 00:19:08.571 cpu : usr=2.48%, sys=3.58%, ctx=2485, majf=0, minf=1 00:19:08.571 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:19:08.571 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:08.571 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:08.571 issued rwts: total=0,11591,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:08.571 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:08.571 job6: (groupid=0, jobs=1): err= 0: pid=4118637: Thu Apr 25 03:19:41 2024 00:19:08.571 write: IOPS=1206, BW=302MiB/s (316MB/s)(3037MiB/10066msec); 0 zone resets 00:19:08.571 slat (usec): min=20, max=90938, avg=809.38, stdev=3292.89 00:19:08.571 clat (msec): min=17, max=179, avg=52.20, stdev=22.69 00:19:08.571 lat (msec): min=17, max=179, avg=53.01, stdev=23.18 00:19:08.571 clat percentiles (msec): 00:19:08.572 | 1.00th=[ 29], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 33], 00:19:08.572 | 30.00th=[ 35], 40.00th=[ 47], 50.00th=[ 48], 60.00th=[ 50], 00:19:08.572 | 70.00th=[ 59], 80.00th=[ 64], 90.00th=[ 84], 95.00th=[ 109], 00:19:08.572 | 99.00th=[ 122], 99.50th=[ 136], 99.90th=[ 171], 99.95th=[ 174], 00:19:08.572 | 99.99th=[ 180] 00:19:08.572 bw ( KiB/s): min=131584, max=521216, per=8.41%, avg=309401.60, stdev=107640.69, samples=20 00:19:08.572 iops : min= 514, max= 2036, avg=1208.60, stdev=420.47, samples=20 00:19:08.572 lat (msec) : 20=0.03%, 50=63.28%, 100=28.93%, 250=7.75% 00:19:08.572 cpu : usr=2.37%, sys=3.47%, ctx=2535, majf=0, minf=1 00:19:08.572 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:19:08.572 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:08.572 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:08.572 issued rwts: total=0,12149,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:08.572 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:08.572 job7: (groupid=0, jobs=1): err= 0: pid=4118638: Thu Apr 25 03:19:41 2024 00:19:08.572 write: IOPS=1068, BW=267MiB/s (280MB/s)(2689MiB/10066msec); 0 zone resets 00:19:08.572 slat (usec): min=21, max=81110, avg=920.63, stdev=3109.90 00:19:08.572 clat (msec): min=5, max=187, avg=58.94, stdev=26.01 00:19:08.572 lat (msec): min=5, max=187, avg=59.86, stdev=26.55 00:19:08.572 clat percentiles (msec): 00:19:08.572 | 1.00th=[ 31], 5.00th=[ 33], 10.00th=[ 33], 20.00th=[ 34], 00:19:08.572 | 30.00th=[ 36], 40.00th=[ 50], 50.00th=[ 51], 60.00th=[ 59], 00:19:08.572 | 70.00th=[ 71], 80.00th=[ 86], 90.00th=[ 99], 95.00th=[ 109], 00:19:08.572 | 99.00th=[ 117], 99.50th=[ 121], 99.90th=[ 157], 99.95th=[ 157], 00:19:08.572 | 99.99th=[ 161] 00:19:08.572 bw ( KiB/s): min=138240, max=479232, per=7.44%, avg=273740.80, stdev=111778.71, samples=20 00:19:08.572 iops : min= 540, max= 1872, avg=1069.30, stdev=436.64, samples=20 00:19:08.572 lat (msec) : 10=0.03%, 20=0.22%, 50=45.15%, 100=45.18%, 250=9.42% 00:19:08.572 cpu : usr=2.22%, sys=3.47%, ctx=2274, majf=0, minf=1 00:19:08.572 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:19:08.572 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:08.572 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:08.572 issued rwts: total=0,10757,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:08.572 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:08.572 job8: (groupid=0, jobs=1): err= 0: pid=4118639: Thu Apr 25 03:19:41 2024 00:19:08.572 write: IOPS=1531, BW=383MiB/s (401MB/s)(3839MiB/10027msec); 0 zone resets 00:19:08.572 slat (usec): min=13, max=73228, avg=638.17, stdev=2296.80 00:19:08.572 clat (msec): min=5, max=124, avg=41.14, stdev=17.83 00:19:08.572 lat (msec): min=5, max=126, avg=41.78, stdev=18.20 00:19:08.572 clat percentiles (msec): 00:19:08.572 | 1.00th=[ 14], 5.00th=[ 15], 10.00th=[ 16], 20.00th=[ 28], 00:19:08.572 | 30.00th=[ 32], 40.00th=[ 34], 50.00th=[ 37], 60.00th=[ 50], 00:19:08.572 | 70.00th=[ 52], 80.00th=[ 59], 90.00th=[ 64], 95.00th=[ 66], 00:19:08.572 | 99.00th=[ 73], 99.50th=[ 89], 99.90th=[ 121], 99.95th=[ 122], 00:19:08.572 | 99.99th=[ 125] 00:19:08.572 bw ( KiB/s): min=243712, max=1014784, per=10.64%, avg=391449.60, stdev=200295.76, samples=20 00:19:08.572 iops : min= 952, max= 3964, avg=1529.10, stdev=782.41, samples=20 00:19:08.572 lat (msec) : 10=0.02%, 20=19.42%, 50=44.39%, 100=35.75%, 250=0.43% 00:19:08.572 cpu : usr=2.93%, sys=3.97%, ctx=2943, majf=0, minf=1 00:19:08.572 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:19:08.572 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:08.572 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:08.572 issued rwts: total=0,15354,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:08.572 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:08.572 job9: (groupid=0, jobs=1): err= 0: pid=4118640: Thu Apr 25 03:19:41 2024 00:19:08.572 write: IOPS=2019, BW=505MiB/s (529MB/s)(5063MiB/10027msec); 0 zone resets 00:19:08.572 slat (usec): min=14, max=18697, avg=489.97, stdev=1371.91 00:19:08.572 clat (usec): min=1171, max=69955, avg=31187.42, stdev=9178.36 00:19:08.572 lat (usec): min=1229, max=70005, avg=31677.39, stdev=9383.24 00:19:08.572 clat percentiles (usec): 00:19:08.572 | 1.00th=[14746], 5.00th=[16057], 10.00th=[16581], 20.00th=[18744], 00:19:08.572 | 30.00th=[30802], 40.00th=[32375], 50.00th=[33162], 60.00th=[33817], 00:19:08.572 | 70.00th=[34341], 80.00th=[35914], 90.00th=[42206], 95.00th=[44303], 00:19:08.572 | 99.00th=[56361], 99.50th=[57410], 99.90th=[60031], 99.95th=[60556], 00:19:08.572 | 99.99th=[67634] 00:19:08.572 bw ( KiB/s): min=317440, max=848384, per=14.04%, avg=516812.80, stdev=141661.73, samples=20 00:19:08.572 iops : min= 1240, max= 3314, avg=2018.80, stdev=553.37, samples=20 00:19:08.572 lat (msec) : 2=0.05%, 4=0.07%, 10=0.45%, 20=20.61%, 50=76.17% 00:19:08.572 lat (msec) : 100=2.65% 00:19:08.572 cpu : usr=3.82%, sys=4.92%, ctx=3875, majf=0, minf=1 00:19:08.572 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.7% 00:19:08.572 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:08.572 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:08.572 issued rwts: total=0,20251,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:08.572 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:08.572 job10: (groupid=0, jobs=1): err= 0: pid=4118641: Thu Apr 25 03:19:41 2024 00:19:08.572 write: IOPS=1539, BW=385MiB/s (404MB/s)(3859MiB/10027msec); 0 zone resets 00:19:08.572 slat (usec): min=20, max=80368, avg=642.75, stdev=2091.62 00:19:08.572 clat (msec): min=12, max=127, avg=40.92, stdev=13.09 00:19:08.572 lat (msec): min=12, max=129, avg=41.56, stdev=13.39 00:19:08.572 clat percentiles (msec): 00:19:08.572 | 1.00th=[ 16], 5.00th=[ 27], 10.00th=[ 29], 20.00th=[ 31], 00:19:08.572 | 30.00th=[ 33], 40.00th=[ 34], 50.00th=[ 41], 60.00th=[ 44], 00:19:08.572 | 70.00th=[ 47], 80.00th=[ 49], 90.00th=[ 62], 95.00th=[ 64], 00:19:08.572 | 99.00th=[ 67], 99.50th=[ 80], 99.90th=[ 123], 99.95th=[ 124], 00:19:08.572 | 99.99th=[ 128] 00:19:08.572 bw ( KiB/s): min=254464, max=616448, per=10.69%, avg=393523.20, stdev=107921.20, samples=20 00:19:08.572 iops : min= 994, max= 2408, avg=1537.20, stdev=421.57, samples=20 00:19:08.572 lat (msec) : 20=3.57%, 50=80.08%, 100=15.94%, 250=0.41% 00:19:08.572 cpu : usr=3.13%, sys=4.09%, ctx=3105, majf=0, minf=1 00:19:08.572 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:19:08.572 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:08.572 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:08.572 issued rwts: total=0,15435,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:08.572 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:08.572 00:19:08.572 Run status group 0 (all jobs): 00:19:08.572 WRITE: bw=3594MiB/s (3769MB/s), 240MiB/s-505MiB/s (252MB/s-529MB/s), io=35.3GiB (37.9GB), run=10013-10069msec 00:19:08.572 00:19:08.572 Disk stats (read/write): 00:19:08.572 nvme0n1: ios=49/25816, merge=0/0, ticks=15/1228264, in_queue=1228279, util=97.72% 00:19:08.572 nvme10n1: ios=0/27545, merge=0/0, ticks=0/1230722, in_queue=1230722, util=97.81% 00:19:08.572 nvme11n1: ios=0/19796, merge=0/0, ticks=0/1234620, in_queue=1234620, util=97.94% 00:19:08.572 nvme2n1: ios=0/19212, merge=0/0, ticks=0/1230904, in_queue=1230904, util=98.04% 00:19:08.572 nvme3n1: ios=0/25150, merge=0/0, ticks=0/1235587, in_queue=1235587, util=98.08% 00:19:08.572 nvme4n1: ios=0/22939, merge=0/0, ticks=0/1233422, in_queue=1233422, util=98.35% 00:19:08.572 nvme5n1: ios=0/24171, merge=0/0, ticks=0/1230610, in_queue=1230610, util=98.47% 00:19:08.572 nvme6n1: ios=0/21352, merge=0/0, ticks=0/1229897, in_queue=1229897, util=98.55% 00:19:08.572 nvme7n1: ios=0/30492, merge=0/0, ticks=0/1235566, in_queue=1235566, util=98.86% 00:19:08.572 nvme8n1: ios=0/40326, merge=0/0, ticks=0/1234380, in_queue=1234380, util=98.99% 00:19:08.572 nvme9n1: ios=0/30683, merge=0/0, ticks=0/1234848, in_queue=1234848, util=99.09% 00:19:08.572 03:19:41 -- target/multiconnection.sh@36 -- # sync 00:19:08.572 03:19:41 -- target/multiconnection.sh@37 -- # seq 1 11 00:19:08.572 03:19:42 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:08.572 03:19:42 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:08.572 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:08.572 03:19:42 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:19:08.572 03:19:42 -- common/autotest_common.sh@1205 -- # local i=0 00:19:08.572 03:19:42 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:19:08.572 03:19:42 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK1 00:19:08.572 03:19:42 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:19:08.572 03:19:42 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK1 00:19:08.572 03:19:42 -- common/autotest_common.sh@1217 -- # return 0 00:19:08.572 03:19:42 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:08.572 03:19:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:08.572 03:19:42 -- common/autotest_common.sh@10 -- # set +x 00:19:08.572 03:19:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:08.572 03:19:42 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:08.572 03:19:42 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:19:09.502 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:19:09.502 03:19:43 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:19:09.502 03:19:43 -- common/autotest_common.sh@1205 -- # local i=0 00:19:09.502 03:19:43 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:19:09.502 03:19:43 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK2 00:19:09.502 03:19:43 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK2 00:19:09.502 03:19:43 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:19:09.502 03:19:43 -- common/autotest_common.sh@1217 -- # return 0 00:19:09.502 03:19:43 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:19:09.502 03:19:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:09.502 03:19:43 -- common/autotest_common.sh@10 -- # set +x 00:19:09.502 03:19:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:09.502 03:19:43 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:09.502 03:19:43 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:19:10.431 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:19:10.431 03:19:44 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:19:10.431 03:19:44 -- common/autotest_common.sh@1205 -- # local i=0 00:19:10.431 03:19:44 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:19:10.431 03:19:44 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK3 00:19:10.431 03:19:44 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:19:10.431 03:19:44 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK3 00:19:10.431 03:19:44 -- common/autotest_common.sh@1217 -- # return 0 00:19:10.431 03:19:44 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:19:10.431 03:19:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:10.431 03:19:44 -- common/autotest_common.sh@10 -- # set +x 00:19:10.431 03:19:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:10.431 03:19:44 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:10.431 03:19:44 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:19:11.363 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:19:11.363 03:19:45 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:19:11.363 03:19:45 -- common/autotest_common.sh@1205 -- # local i=0 00:19:11.363 03:19:45 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:19:11.363 03:19:45 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK4 00:19:11.363 03:19:45 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:19:11.363 03:19:45 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK4 00:19:11.363 03:19:45 -- common/autotest_common.sh@1217 -- # return 0 00:19:11.363 03:19:45 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:19:11.363 03:19:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:11.363 03:19:45 -- common/autotest_common.sh@10 -- # set +x 00:19:11.363 03:19:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:11.363 03:19:45 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:11.363 03:19:45 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:19:12.295 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:19:12.295 03:19:46 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:19:12.295 03:19:46 -- common/autotest_common.sh@1205 -- # local i=0 00:19:12.295 03:19:46 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:19:12.295 03:19:46 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK5 00:19:12.295 03:19:46 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:19:12.295 03:19:46 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK5 00:19:12.295 03:19:46 -- common/autotest_common.sh@1217 -- # return 0 00:19:12.295 03:19:46 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:19:12.295 03:19:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:12.295 03:19:46 -- common/autotest_common.sh@10 -- # set +x 00:19:12.295 03:19:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:12.295 03:19:46 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:12.295 03:19:46 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:19:13.227 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:19:13.227 03:19:47 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:19:13.227 03:19:47 -- common/autotest_common.sh@1205 -- # local i=0 00:19:13.227 03:19:47 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:19:13.227 03:19:47 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK6 00:19:13.227 03:19:47 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:19:13.227 03:19:47 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK6 00:19:13.227 03:19:47 -- common/autotest_common.sh@1217 -- # return 0 00:19:13.227 03:19:47 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:19:13.227 03:19:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:13.227 03:19:47 -- common/autotest_common.sh@10 -- # set +x 00:19:13.227 03:19:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:13.227 03:19:47 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:13.227 03:19:47 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:19:13.793 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:19:13.793 03:19:48 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:19:13.793 03:19:48 -- common/autotest_common.sh@1205 -- # local i=0 00:19:13.793 03:19:48 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:19:13.793 03:19:48 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK7 00:19:14.050 03:19:48 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:19:14.050 03:19:48 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK7 00:19:14.050 03:19:48 -- common/autotest_common.sh@1217 -- # return 0 00:19:14.050 03:19:48 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:19:14.050 03:19:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:14.050 03:19:48 -- common/autotest_common.sh@10 -- # set +x 00:19:14.050 03:19:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:14.050 03:19:48 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:14.050 03:19:48 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:19:14.983 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:19:14.983 03:19:49 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:19:14.983 03:19:49 -- common/autotest_common.sh@1205 -- # local i=0 00:19:14.983 03:19:49 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:19:14.983 03:19:49 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK8 00:19:14.983 03:19:49 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:19:14.983 03:19:49 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK8 00:19:14.983 03:19:49 -- common/autotest_common.sh@1217 -- # return 0 00:19:14.983 03:19:49 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:19:14.983 03:19:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:14.983 03:19:49 -- common/autotest_common.sh@10 -- # set +x 00:19:14.983 03:19:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:14.983 03:19:49 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:14.983 03:19:49 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:19:15.916 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:19:15.916 03:19:50 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:19:15.916 03:19:50 -- common/autotest_common.sh@1205 -- # local i=0 00:19:15.916 03:19:50 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:19:15.916 03:19:50 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK9 00:19:15.916 03:19:50 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:19:15.916 03:19:50 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK9 00:19:15.916 03:19:50 -- common/autotest_common.sh@1217 -- # return 0 00:19:15.916 03:19:50 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:19:15.916 03:19:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:15.916 03:19:50 -- common/autotest_common.sh@10 -- # set +x 00:19:15.916 03:19:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:15.916 03:19:50 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:15.916 03:19:50 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:19:16.480 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:19:16.480 03:19:50 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:19:16.480 03:19:50 -- common/autotest_common.sh@1205 -- # local i=0 00:19:16.480 03:19:50 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:19:16.480 03:19:50 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK10 00:19:16.737 03:19:50 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:19:16.737 03:19:50 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK10 00:19:16.737 03:19:50 -- common/autotest_common.sh@1217 -- # return 0 00:19:16.737 03:19:50 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:19:16.737 03:19:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:16.737 03:19:50 -- common/autotest_common.sh@10 -- # set +x 00:19:16.737 03:19:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:16.737 03:19:51 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:16.737 03:19:51 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:19:17.668 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:19:17.668 03:19:51 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:19:17.668 03:19:51 -- common/autotest_common.sh@1205 -- # local i=0 00:19:17.668 03:19:51 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:19:17.668 03:19:51 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK11 00:19:17.668 03:19:51 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:19:17.668 03:19:51 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK11 00:19:17.668 03:19:51 -- common/autotest_common.sh@1217 -- # return 0 00:19:17.668 03:19:51 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:19:17.668 03:19:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:17.668 03:19:51 -- common/autotest_common.sh@10 -- # set +x 00:19:17.668 03:19:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:17.668 03:19:51 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:19:17.668 03:19:51 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:19:17.668 03:19:51 -- target/multiconnection.sh@47 -- # nvmftestfini 00:19:17.668 03:19:51 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:17.668 03:19:51 -- nvmf/common.sh@117 -- # sync 00:19:17.668 03:19:51 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:19:17.668 03:19:51 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:19:17.668 03:19:51 -- nvmf/common.sh@120 -- # set +e 00:19:17.668 03:19:51 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:17.668 03:19:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:19:17.668 rmmod nvme_rdma 00:19:17.668 rmmod nvme_fabrics 00:19:17.668 03:19:51 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:17.668 03:19:51 -- nvmf/common.sh@124 -- # set -e 00:19:17.668 03:19:51 -- nvmf/common.sh@125 -- # return 0 00:19:17.668 03:19:51 -- nvmf/common.sh@478 -- # '[' -n 4111964 ']' 00:19:17.668 03:19:51 -- nvmf/common.sh@479 -- # killprocess 4111964 00:19:17.668 03:19:51 -- common/autotest_common.sh@936 -- # '[' -z 4111964 ']' 00:19:17.668 03:19:51 -- common/autotest_common.sh@940 -- # kill -0 4111964 00:19:17.668 03:19:51 -- common/autotest_common.sh@941 -- # uname 00:19:17.668 03:19:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:17.668 03:19:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4111964 00:19:17.668 03:19:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:17.668 03:19:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:17.668 03:19:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4111964' 00:19:17.668 killing process with pid 4111964 00:19:17.668 03:19:52 -- common/autotest_common.sh@955 -- # kill 4111964 00:19:17.668 03:19:52 -- common/autotest_common.sh@960 -- # wait 4111964 00:19:17.668 [2024-04-25 03:19:52.034105] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:19:18.233 03:19:52 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:18.233 03:19:52 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:19:18.233 00:19:18.233 real 1m4.569s 00:19:18.233 user 4m7.955s 00:19:18.233 sys 0m17.943s 00:19:18.233 03:19:52 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:18.233 03:19:52 -- common/autotest_common.sh@10 -- # set +x 00:19:18.233 ************************************ 00:19:18.233 END TEST nvmf_multiconnection 00:19:18.233 ************************************ 00:19:18.233 03:19:52 -- nvmf/nvmf.sh@67 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=rdma 00:19:18.233 03:19:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:18.233 03:19:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:18.233 03:19:52 -- common/autotest_common.sh@10 -- # set +x 00:19:18.233 ************************************ 00:19:18.233 START TEST nvmf_initiator_timeout 00:19:18.233 ************************************ 00:19:18.233 03:19:52 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=rdma 00:19:18.233 * Looking for test storage... 00:19:18.233 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:19:18.233 03:19:52 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:19:18.233 03:19:52 -- nvmf/common.sh@7 -- # uname -s 00:19:18.492 03:19:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:18.492 03:19:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:18.492 03:19:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:18.492 03:19:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:18.492 03:19:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:18.492 03:19:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:18.492 03:19:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:18.492 03:19:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:18.492 03:19:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:18.492 03:19:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:18.492 03:19:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:19:18.492 03:19:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:19:18.492 03:19:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:18.492 03:19:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:18.492 03:19:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:18.492 03:19:52 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:18.492 03:19:52 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:19:18.492 03:19:52 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:18.492 03:19:52 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:18.492 03:19:52 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:18.492 03:19:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:18.492 03:19:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:18.492 03:19:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:18.492 03:19:52 -- paths/export.sh@5 -- # export PATH 00:19:18.492 03:19:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:18.492 03:19:52 -- nvmf/common.sh@47 -- # : 0 00:19:18.492 03:19:52 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:18.492 03:19:52 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:18.492 03:19:52 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:18.492 03:19:52 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:18.492 03:19:52 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:18.492 03:19:52 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:18.492 03:19:52 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:18.492 03:19:52 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:18.492 03:19:52 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:18.492 03:19:52 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:18.492 03:19:52 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:19:18.492 03:19:52 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:19:18.492 03:19:52 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:18.492 03:19:52 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:18.492 03:19:52 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:18.492 03:19:52 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:18.492 03:19:52 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:18.492 03:19:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:18.492 03:19:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:18.492 03:19:52 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:18.492 03:19:52 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:18.492 03:19:52 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:18.492 03:19:52 -- common/autotest_common.sh@10 -- # set +x 00:19:25.052 03:19:58 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:25.052 03:19:58 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:25.052 03:19:58 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:25.052 03:19:58 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:25.052 03:19:58 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:25.052 03:19:58 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:25.052 03:19:58 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:25.052 03:19:58 -- nvmf/common.sh@295 -- # net_devs=() 00:19:25.052 03:19:58 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:25.052 03:19:58 -- nvmf/common.sh@296 -- # e810=() 00:19:25.052 03:19:58 -- nvmf/common.sh@296 -- # local -ga e810 00:19:25.052 03:19:58 -- nvmf/common.sh@297 -- # x722=() 00:19:25.052 03:19:58 -- nvmf/common.sh@297 -- # local -ga x722 00:19:25.052 03:19:58 -- nvmf/common.sh@298 -- # mlx=() 00:19:25.052 03:19:58 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:25.052 03:19:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:25.052 03:19:58 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:25.052 03:19:58 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:25.052 03:19:58 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:25.052 03:19:58 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:25.052 03:19:58 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:25.052 03:19:58 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:25.052 03:19:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:25.052 03:19:58 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:25.052 03:19:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:25.052 03:19:58 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:25.052 03:19:58 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:25.052 03:19:58 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:19:25.052 03:19:58 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:19:25.052 03:19:58 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:19:25.052 03:19:58 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:19:25.052 03:19:58 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:19:25.052 03:19:58 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:19:25.052 03:19:58 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:25.052 03:19:58 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:25.052 03:19:58 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:19:25.052 Found 0000:af:00.0 (0x8086 - 0x159b) 00:19:25.052 03:19:58 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:19:25.052 03:19:58 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:19:25.052 03:19:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:25.052 03:19:58 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:25.052 03:19:58 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:25.052 03:19:58 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:25.052 03:19:58 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:25.052 03:19:58 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:19:25.052 Found 0000:af:00.1 (0x8086 - 0x159b) 00:19:25.052 03:19:58 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:19:25.052 03:19:58 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:19:25.052 03:19:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:25.052 03:19:58 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:25.052 03:19:58 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:25.052 03:19:58 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:25.052 03:19:58 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:25.052 03:19:58 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:19:25.052 03:19:58 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:19:25.052 03:19:58 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:19:25.052 03:19:58 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:19:25.052 03:19:58 -- nvmf/common.sh@377 -- # modinfo irdma 00:19:25.052 03:19:58 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:19:25.052 03:19:58 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:25.052 03:19:58 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:25.052 03:19:58 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:25.052 03:19:58 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:25.052 03:19:58 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:19:25.052 Found net devices under 0000:af:00.0: cvl_0_0 00:19:25.052 03:19:58 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:25.052 03:19:58 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:25.052 03:19:58 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:25.052 03:19:58 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:25.052 03:19:58 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:25.052 03:19:58 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:19:25.052 Found net devices under 0000:af:00.1: cvl_0_1 00:19:25.052 03:19:58 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:25.052 03:19:58 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:25.052 03:19:58 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:25.052 03:19:58 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:25.052 03:19:58 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:19:25.052 03:19:58 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:19:25.052 03:19:58 -- nvmf/common.sh@409 -- # rdma_device_init 00:19:25.052 03:19:58 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:19:25.052 03:19:58 -- nvmf/common.sh@58 -- # uname 00:19:25.052 03:19:58 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:19:25.052 03:19:58 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:19:25.052 03:19:58 -- nvmf/common.sh@63 -- # modprobe ib_core 00:19:25.052 03:19:58 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:19:25.052 03:19:58 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:19:25.052 03:19:58 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:19:25.052 03:19:58 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:19:25.052 03:19:58 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:19:25.052 03:19:58 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:19:25.052 03:19:58 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:19:25.052 03:19:58 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:19:25.052 03:19:58 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:25.052 03:19:58 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:25.052 03:19:58 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:25.052 03:19:58 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:25.052 03:19:58 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:25.052 03:19:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:25.052 03:19:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:25.052 03:19:58 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:19:25.052 03:19:58 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:19:25.052 03:19:58 -- nvmf/common.sh@105 -- # continue 2 00:19:25.052 03:19:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:25.052 03:19:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:25.052 03:19:58 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:19:25.052 03:19:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:25.052 03:19:58 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:19:25.053 03:19:58 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:19:25.053 03:19:58 -- nvmf/common.sh@105 -- # continue 2 00:19:25.053 03:19:58 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:25.053 03:19:58 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:19:25.053 03:19:58 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:19:25.053 03:19:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:19:25.053 03:19:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:25.053 03:19:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:25.053 03:19:58 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:19:25.053 03:19:58 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:19:25.053 03:19:58 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:19:25.053 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:19:25.053 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:19:25.053 altname enp175s0f0np0 00:19:25.053 altname ens801f0np0 00:19:25.053 inet 192.168.100.8/24 scope global cvl_0_0 00:19:25.053 valid_lft forever preferred_lft forever 00:19:25.053 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:19:25.053 valid_lft forever preferred_lft forever 00:19:25.053 03:19:58 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:25.053 03:19:58 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:19:25.053 03:19:58 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:19:25.053 03:19:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:19:25.053 03:19:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:25.053 03:19:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:25.053 03:19:58 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:19:25.053 03:19:58 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:19:25.053 03:19:58 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:19:25.053 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:19:25.053 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:19:25.053 altname enp175s0f1np1 00:19:25.053 altname ens801f1np1 00:19:25.053 inet 192.168.100.9/24 scope global cvl_0_1 00:19:25.053 valid_lft forever preferred_lft forever 00:19:25.053 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:19:25.053 valid_lft forever preferred_lft forever 00:19:25.053 03:19:58 -- nvmf/common.sh@411 -- # return 0 00:19:25.053 03:19:58 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:25.053 03:19:58 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:19:25.053 03:19:58 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:19:25.053 03:19:58 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:19:25.053 03:19:58 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:19:25.053 03:19:58 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:25.053 03:19:58 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:25.053 03:19:58 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:25.053 03:19:58 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:25.053 03:19:58 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:25.053 03:19:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:25.053 03:19:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:25.053 03:19:58 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:19:25.053 03:19:58 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:19:25.053 03:19:58 -- nvmf/common.sh@105 -- # continue 2 00:19:25.053 03:19:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:25.053 03:19:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:25.053 03:19:58 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:19:25.053 03:19:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:25.053 03:19:58 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:19:25.053 03:19:58 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:19:25.053 03:19:58 -- nvmf/common.sh@105 -- # continue 2 00:19:25.053 03:19:58 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:25.053 03:19:58 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:19:25.053 03:19:58 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:19:25.053 03:19:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:19:25.053 03:19:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:25.053 03:19:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:25.053 03:19:58 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:25.053 03:19:58 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:19:25.053 03:19:58 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:19:25.053 03:19:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:19:25.053 03:19:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:25.053 03:19:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:25.053 03:19:58 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:19:25.053 192.168.100.9' 00:19:25.053 03:19:58 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:19:25.053 192.168.100.9' 00:19:25.053 03:19:58 -- nvmf/common.sh@446 -- # head -n 1 00:19:25.053 03:19:58 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:19:25.053 03:19:58 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:19:25.053 192.168.100.9' 00:19:25.053 03:19:58 -- nvmf/common.sh@447 -- # tail -n +2 00:19:25.053 03:19:58 -- nvmf/common.sh@447 -- # head -n 1 00:19:25.053 03:19:58 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:19:25.053 03:19:58 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:19:25.053 03:19:58 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:19:25.053 03:19:58 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:19:25.053 03:19:58 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:19:25.053 03:19:58 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:19:25.053 03:19:58 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:19:25.053 03:19:58 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:19:25.053 03:19:58 -- common/autotest_common.sh@710 -- # xtrace_disable 00:19:25.053 03:19:58 -- common/autotest_common.sh@10 -- # set +x 00:19:25.053 03:19:58 -- nvmf/common.sh@470 -- # nvmfpid=4125282 00:19:25.053 03:19:58 -- nvmf/common.sh@471 -- # waitforlisten 4125282 00:19:25.053 03:19:58 -- common/autotest_common.sh@817 -- # '[' -z 4125282 ']' 00:19:25.053 03:19:58 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:25.053 03:19:58 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:25.053 03:19:58 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:25.053 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:25.053 03:19:58 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:25.053 03:19:58 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:25.053 03:19:58 -- common/autotest_common.sh@10 -- # set +x 00:19:25.053 [2024-04-25 03:19:58.584729] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:19:25.053 [2024-04-25 03:19:58.584772] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:25.053 EAL: No free 2048 kB hugepages reported on node 1 00:19:25.053 [2024-04-25 03:19:58.644446] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:25.053 [2024-04-25 03:19:58.720185] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:25.053 [2024-04-25 03:19:58.720220] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:25.053 [2024-04-25 03:19:58.720227] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:25.053 [2024-04-25 03:19:58.720233] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:25.053 [2024-04-25 03:19:58.720237] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:25.053 [2024-04-25 03:19:58.720274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:25.053 [2024-04-25 03:19:58.720495] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:25.053 [2024-04-25 03:19:58.720515] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:25.053 [2024-04-25 03:19:58.720516] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:25.053 03:19:59 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:25.053 03:19:59 -- common/autotest_common.sh@850 -- # return 0 00:19:25.053 03:19:59 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:19:25.053 03:19:59 -- common/autotest_common.sh@716 -- # xtrace_disable 00:19:25.053 03:19:59 -- common/autotest_common.sh@10 -- # set +x 00:19:25.054 03:19:59 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:25.054 03:19:59 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:19:25.054 03:19:59 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:25.054 03:19:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:25.054 03:19:59 -- common/autotest_common.sh@10 -- # set +x 00:19:25.054 Malloc0 00:19:25.054 03:19:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:25.054 03:19:59 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:19:25.054 03:19:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:25.054 03:19:59 -- common/autotest_common.sh@10 -- # set +x 00:19:25.054 Delay0 00:19:25.054 03:19:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:25.054 03:19:59 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:19:25.054 03:19:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:25.054 03:19:59 -- common/autotest_common.sh@10 -- # set +x 00:19:25.054 [2024-04-25 03:19:59.461873] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x1821730/0x1820d70) succeed. 00:19:25.054 [2024-04-25 03:19:59.472027] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x1822920/0x18212f0) succeed. 00:19:25.054 [2024-04-25 03:19:59.472053] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:19:25.054 03:19:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:25.054 03:19:59 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:25.054 03:19:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:25.054 03:19:59 -- common/autotest_common.sh@10 -- # set +x 00:19:25.054 03:19:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:25.054 03:19:59 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:19:25.054 03:19:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:25.054 03:19:59 -- common/autotest_common.sh@10 -- # set +x 00:19:25.054 03:19:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:25.054 03:19:59 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:19:25.054 03:19:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:25.054 03:19:59 -- common/autotest_common.sh@10 -- # set +x 00:19:25.054 [2024-04-25 03:19:59.504323] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:19:25.054 03:19:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:25.054 03:19:59 -- target/initiator_timeout.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:19:25.311 03:19:59 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:19:25.311 03:19:59 -- common/autotest_common.sh@1184 -- # local i=0 00:19:25.311 03:19:59 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:19:25.311 03:19:59 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:19:25.311 03:19:59 -- common/autotest_common.sh@1191 -- # sleep 2 00:19:27.242 03:20:01 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:19:27.242 03:20:01 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:19:27.242 03:20:01 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:19:27.242 03:20:01 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:19:27.242 03:20:01 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:19:27.242 03:20:01 -- common/autotest_common.sh@1194 -- # return 0 00:19:27.242 03:20:01 -- target/initiator_timeout.sh@35 -- # fio_pid=4125777 00:19:27.511 03:20:01 -- target/initiator_timeout.sh@37 -- # sleep 3 00:19:27.511 03:20:01 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:19:27.511 [global] 00:19:27.511 thread=1 00:19:27.511 invalidate=1 00:19:27.511 rw=write 00:19:27.511 time_based=1 00:19:27.511 runtime=60 00:19:27.511 ioengine=libaio 00:19:27.511 direct=1 00:19:27.511 bs=4096 00:19:27.511 iodepth=1 00:19:27.511 norandommap=0 00:19:27.511 numjobs=1 00:19:27.511 00:19:27.511 verify_dump=1 00:19:27.511 verify_backlog=512 00:19:27.511 verify_state_save=0 00:19:27.511 do_verify=1 00:19:27.511 verify=crc32c-intel 00:19:27.511 [job0] 00:19:27.511 filename=/dev/nvme0n1 00:19:27.511 Could not set queue depth (nvme0n1) 00:19:27.770 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:27.770 fio-3.35 00:19:27.770 Starting 1 thread 00:19:30.294 03:20:04 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:19:30.294 03:20:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:30.294 03:20:04 -- common/autotest_common.sh@10 -- # set +x 00:19:30.294 true 00:19:30.294 03:20:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:30.294 03:20:04 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:19:30.294 03:20:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:30.294 03:20:04 -- common/autotest_common.sh@10 -- # set +x 00:19:30.294 true 00:19:30.294 03:20:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:30.294 03:20:04 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:19:30.294 03:20:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:30.294 03:20:04 -- common/autotest_common.sh@10 -- # set +x 00:19:30.294 true 00:19:30.294 03:20:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:30.294 03:20:04 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:19:30.294 03:20:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:30.294 03:20:04 -- common/autotest_common.sh@10 -- # set +x 00:19:30.294 true 00:19:30.294 03:20:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:30.294 03:20:04 -- target/initiator_timeout.sh@45 -- # sleep 3 00:19:33.575 03:20:07 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:19:33.575 03:20:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:33.575 03:20:07 -- common/autotest_common.sh@10 -- # set +x 00:19:33.575 true 00:19:33.575 03:20:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:33.575 03:20:07 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:19:33.575 03:20:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:33.575 03:20:07 -- common/autotest_common.sh@10 -- # set +x 00:19:33.575 true 00:19:33.575 03:20:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:33.576 03:20:07 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:19:33.576 03:20:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:33.576 03:20:07 -- common/autotest_common.sh@10 -- # set +x 00:19:33.576 true 00:19:33.576 03:20:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:33.576 03:20:07 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:19:33.576 03:20:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:33.576 03:20:07 -- common/autotest_common.sh@10 -- # set +x 00:19:33.576 true 00:19:33.576 03:20:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:33.576 03:20:07 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:19:33.576 03:20:07 -- target/initiator_timeout.sh@54 -- # wait 4125777 00:20:29.785 00:20:29.785 job0: (groupid=0, jobs=1): err= 0: pid=4125900: Thu Apr 25 03:21:02 2024 00:20:29.785 read: IOPS=1309, BW=5237KiB/s (5363kB/s)(307MiB/60000msec) 00:20:29.786 slat (nsec): min=4711, max=44016, avg=7196.62, stdev=985.54 00:20:29.786 clat (usec): min=76, max=893, avg=104.94, stdev= 6.01 00:20:29.786 lat (usec): min=97, max=900, avg=112.14, stdev= 6.08 00:20:29.786 clat percentiles (usec): 00:20:29.786 | 1.00th=[ 95], 5.00th=[ 97], 10.00th=[ 99], 20.00th=[ 101], 00:20:29.786 | 30.00th=[ 102], 40.00th=[ 104], 50.00th=[ 105], 60.00th=[ 106], 00:20:29.786 | 70.00th=[ 109], 80.00th=[ 110], 90.00th=[ 112], 95.00th=[ 114], 00:20:29.786 | 99.00th=[ 118], 99.50th=[ 120], 99.90th=[ 125], 99.95th=[ 131], 00:20:29.786 | 99.99th=[ 192] 00:20:29.786 write: IOPS=1314, BW=5257KiB/s (5383kB/s)(308MiB/60000msec); 0 zone resets 00:20:29.786 slat (usec): min=8, max=5766, avg= 9.70, stdev=20.62 00:20:29.786 clat (usec): min=80, max=41947k, avg=635.17, stdev=149385.37 00:20:29.786 lat (usec): min=96, max=41947k, avg=644.88, stdev=149385.40 00:20:29.786 clat percentiles (usec): 00:20:29.786 | 1.00th=[ 93], 5.00th=[ 95], 10.00th=[ 97], 20.00th=[ 99], 00:20:29.786 | 30.00th=[ 100], 40.00th=[ 102], 50.00th=[ 103], 60.00th=[ 104], 00:20:29.786 | 70.00th=[ 106], 80.00th=[ 108], 90.00th=[ 111], 95.00th=[ 113], 00:20:29.786 | 99.00th=[ 117], 99.50th=[ 119], 99.90th=[ 124], 99.95th=[ 130], 00:20:29.786 | 99.99th=[ 221] 00:20:29.786 bw ( KiB/s): min= 4032, max=18712, per=100.00%, avg=17066.67, stdev=2391.69, samples=36 00:20:29.786 iops : min= 1008, max= 4678, avg=4266.67, stdev=597.92, samples=36 00:20:29.786 lat (usec) : 100=22.91%, 250=77.08%, 500=0.01%, 1000=0.01% 00:20:29.786 lat (msec) : >=2000=0.01% 00:20:29.786 cpu : usr=1.50%, sys=2.58%, ctx=157417, majf=0, minf=107 00:20:29.786 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:29.786 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:29.786 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:29.786 issued rwts: total=78561,78848,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:29.786 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:29.786 00:20:29.786 Run status group 0 (all jobs): 00:20:29.786 READ: bw=5237KiB/s (5363kB/s), 5237KiB/s-5237KiB/s (5363kB/s-5363kB/s), io=307MiB (322MB), run=60000-60000msec 00:20:29.786 WRITE: bw=5257KiB/s (5383kB/s), 5257KiB/s-5257KiB/s (5383kB/s-5383kB/s), io=308MiB (323MB), run=60000-60000msec 00:20:29.786 00:20:29.786 Disk stats (read/write): 00:20:29.786 nvme0n1: ios=78522/78336, merge=0/0, ticks=7743/7483, in_queue=15226, util=99.66% 00:20:29.786 03:21:02 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:20:29.786 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:20:29.786 03:21:03 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:20:29.786 03:21:03 -- common/autotest_common.sh@1205 -- # local i=0 00:20:29.786 03:21:03 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:20:29.786 03:21:03 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:20:29.786 03:21:03 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:20:29.786 03:21:03 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:20:29.786 03:21:03 -- common/autotest_common.sh@1217 -- # return 0 00:20:29.786 03:21:03 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:20:29.786 03:21:03 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:20:29.786 nvmf hotplug test: fio successful as expected 00:20:29.786 03:21:03 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:29.786 03:21:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:29.786 03:21:03 -- common/autotest_common.sh@10 -- # set +x 00:20:29.786 03:21:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:29.786 03:21:03 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:20:29.786 03:21:03 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:20:29.786 03:21:03 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:20:29.786 03:21:03 -- nvmf/common.sh@477 -- # nvmfcleanup 00:20:29.786 03:21:03 -- nvmf/common.sh@117 -- # sync 00:20:29.786 03:21:03 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:20:29.786 03:21:03 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:20:29.786 03:21:03 -- nvmf/common.sh@120 -- # set +e 00:20:29.786 03:21:03 -- nvmf/common.sh@121 -- # for i in {1..20} 00:20:29.786 03:21:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:20:29.786 rmmod nvme_rdma 00:20:29.786 rmmod nvme_fabrics 00:20:29.786 03:21:03 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:20:29.786 03:21:03 -- nvmf/common.sh@124 -- # set -e 00:20:29.786 03:21:03 -- nvmf/common.sh@125 -- # return 0 00:20:29.786 03:21:03 -- nvmf/common.sh@478 -- # '[' -n 4125282 ']' 00:20:29.786 03:21:03 -- nvmf/common.sh@479 -- # killprocess 4125282 00:20:29.786 03:21:03 -- common/autotest_common.sh@936 -- # '[' -z 4125282 ']' 00:20:29.786 03:21:03 -- common/autotest_common.sh@940 -- # kill -0 4125282 00:20:29.786 03:21:03 -- common/autotest_common.sh@941 -- # uname 00:20:29.786 03:21:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:29.786 03:21:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4125282 00:20:29.786 03:21:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:29.786 03:21:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:29.786 03:21:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4125282' 00:20:29.786 killing process with pid 4125282 00:20:29.786 03:21:03 -- common/autotest_common.sh@955 -- # kill 4125282 00:20:29.786 03:21:03 -- common/autotest_common.sh@960 -- # wait 4125282 00:20:29.786 [2024-04-25 03:21:03.242053] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:20:29.786 03:21:03 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:20:29.786 03:21:03 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:20:29.786 00:20:29.786 real 1m10.832s 00:20:29.786 user 4m26.224s 00:20:29.786 sys 0m6.534s 00:20:29.786 03:21:03 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:20:29.786 03:21:03 -- common/autotest_common.sh@10 -- # set +x 00:20:29.786 ************************************ 00:20:29.786 END TEST nvmf_initiator_timeout 00:20:29.786 ************************************ 00:20:29.786 03:21:03 -- nvmf/nvmf.sh@70 -- # [[ phy == phy ]] 00:20:29.786 03:21:03 -- nvmf/nvmf.sh@71 -- # '[' rdma = tcp ']' 00:20:29.786 03:21:03 -- nvmf/nvmf.sh@77 -- # [[ rdma == \r\d\m\a ]] 00:20:29.786 03:21:03 -- nvmf/nvmf.sh@78 -- # run_test nvmf_device_removal test/nvmf/target/device_removal.sh --transport=rdma 00:20:29.786 03:21:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:29.786 03:21:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:29.786 03:21:03 -- common/autotest_common.sh@10 -- # set +x 00:20:29.786 ************************************ 00:20:29.786 START TEST nvmf_device_removal 00:20:29.786 ************************************ 00:20:29.786 03:21:03 -- common/autotest_common.sh@1111 -- # test/nvmf/target/device_removal.sh --transport=rdma 00:20:29.786 * Looking for test storage... 00:20:29.786 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:20:29.786 03:21:03 -- target/device_removal.sh@10 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/autotest_common.sh 00:20:29.786 03:21:03 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:20:29.786 03:21:03 -- common/autotest_common.sh@34 -- # set -e 00:20:29.786 03:21:03 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:20:29.786 03:21:03 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:20:29.786 03:21:03 -- common/autotest_common.sh@38 -- # '[' -z /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output ']' 00:20:29.786 03:21:03 -- common/autotest_common.sh@43 -- # [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/build_config.sh ]] 00:20:29.786 03:21:03 -- common/autotest_common.sh@44 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/build_config.sh 00:20:29.786 03:21:03 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:20:29.786 03:21:03 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:20:29.786 03:21:03 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:20:29.786 03:21:03 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:20:29.786 03:21:03 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:20:29.786 03:21:03 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:20:29.786 03:21:03 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:20:29.786 03:21:03 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:20:29.786 03:21:03 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:20:29.786 03:21:03 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:20:29.786 03:21:03 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:20:29.786 03:21:03 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:20:29.786 03:21:03 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:20:29.786 03:21:03 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:20:29.786 03:21:03 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:20:29.786 03:21:03 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:20:29.786 03:21:03 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:20:29.786 03:21:03 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:20:29.786 03:21:03 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/env_dpdk 00:20:29.786 03:21:03 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:20:29.786 03:21:03 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:20:29.786 03:21:03 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:20:29.786 03:21:03 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:20:29.786 03:21:03 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:20:29.786 03:21:03 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:20:29.786 03:21:03 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:20:29.786 03:21:03 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:20:29.786 03:21:03 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:20:29.786 03:21:03 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:20:29.786 03:21:03 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:20:29.786 03:21:03 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:20:29.786 03:21:03 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:20:29.786 03:21:03 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:20:29.786 03:21:03 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:20:29.786 03:21:03 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:20:29.786 03:21:03 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build 00:20:29.786 03:21:03 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:20:29.786 03:21:03 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:20:29.786 03:21:03 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:20:29.786 03:21:03 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:20:29.786 03:21:03 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:20:29.786 03:21:03 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:20:29.787 03:21:03 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:20:29.787 03:21:03 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:20:29.787 03:21:03 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:20:29.787 03:21:03 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:20:29.787 03:21:03 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:20:29.787 03:21:03 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:20:29.787 03:21:03 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:20:29.787 03:21:03 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:20:29.787 03:21:03 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:20:29.787 03:21:03 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:20:29.787 03:21:03 -- common/build_config.sh@53 -- # CONFIG_HAVE_EVP_MAC=y 00:20:29.787 03:21:03 -- common/build_config.sh@54 -- # CONFIG_URING_ZNS=n 00:20:29.787 03:21:03 -- common/build_config.sh@55 -- # CONFIG_WERROR=y 00:20:29.787 03:21:03 -- common/build_config.sh@56 -- # CONFIG_HAVE_LIBBSD=n 00:20:29.787 03:21:03 -- common/build_config.sh@57 -- # CONFIG_UBSAN=y 00:20:29.787 03:21:03 -- common/build_config.sh@58 -- # CONFIG_IPSEC_MB_DIR= 00:20:29.787 03:21:03 -- common/build_config.sh@59 -- # CONFIG_GOLANG=n 00:20:29.787 03:21:03 -- common/build_config.sh@60 -- # CONFIG_ISAL=y 00:20:29.787 03:21:03 -- common/build_config.sh@61 -- # CONFIG_IDXD_KERNEL=n 00:20:29.787 03:21:03 -- common/build_config.sh@62 -- # CONFIG_DPDK_LIB_DIR= 00:20:29.787 03:21:03 -- common/build_config.sh@63 -- # CONFIG_RDMA_PROV=verbs 00:20:29.787 03:21:03 -- common/build_config.sh@64 -- # CONFIG_APPS=y 00:20:29.787 03:21:03 -- common/build_config.sh@65 -- # CONFIG_SHARED=y 00:20:29.787 03:21:03 -- common/build_config.sh@66 -- # CONFIG_HAVE_KEYUTILS=n 00:20:29.787 03:21:03 -- common/build_config.sh@67 -- # CONFIG_FC_PATH= 00:20:29.787 03:21:03 -- common/build_config.sh@68 -- # CONFIG_DPDK_PKG_CONFIG=n 00:20:29.787 03:21:03 -- common/build_config.sh@69 -- # CONFIG_FC=n 00:20:29.787 03:21:03 -- common/build_config.sh@70 -- # CONFIG_AVAHI=n 00:20:29.787 03:21:03 -- common/build_config.sh@71 -- # CONFIG_FIO_PLUGIN=y 00:20:29.787 03:21:03 -- common/build_config.sh@72 -- # CONFIG_RAID5F=n 00:20:29.787 03:21:03 -- common/build_config.sh@73 -- # CONFIG_EXAMPLES=y 00:20:29.787 03:21:03 -- common/build_config.sh@74 -- # CONFIG_TESTS=y 00:20:29.787 03:21:03 -- common/build_config.sh@75 -- # CONFIG_CRYPTO_MLX5=n 00:20:29.787 03:21:03 -- common/build_config.sh@76 -- # CONFIG_MAX_LCORES= 00:20:29.787 03:21:03 -- common/build_config.sh@77 -- # CONFIG_IPSEC_MB=n 00:20:29.787 03:21:03 -- common/build_config.sh@78 -- # CONFIG_PGO_DIR= 00:20:29.787 03:21:03 -- common/build_config.sh@79 -- # CONFIG_DEBUG=y 00:20:29.787 03:21:03 -- common/build_config.sh@80 -- # CONFIG_DPDK_COMPRESSDEV=n 00:20:29.787 03:21:03 -- common/build_config.sh@81 -- # CONFIG_CROSS_PREFIX= 00:20:29.787 03:21:03 -- common/build_config.sh@82 -- # CONFIG_URING=n 00:20:29.787 03:21:03 -- common/autotest_common.sh@53 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/applications.sh 00:20:29.787 03:21:03 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/applications.sh 00:20:29.787 03:21:03 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common 00:20:29.787 03:21:03 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common 00:20:29.787 03:21:03 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:20:29.787 03:21:03 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin 00:20:29.787 03:21:03 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/app 00:20:29.787 03:21:03 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples 00:20:29.787 03:21:03 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:20:29.787 03:21:03 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:20:29.787 03:21:03 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:20:29.787 03:21:03 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:20:29.787 03:21:03 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:20:29.787 03:21:03 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:20:29.787 03:21:03 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/include/spdk/config.h ]] 00:20:29.787 03:21:03 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:20:29.787 #define SPDK_CONFIG_H 00:20:29.787 #define SPDK_CONFIG_APPS 1 00:20:29.787 #define SPDK_CONFIG_ARCH native 00:20:29.787 #undef SPDK_CONFIG_ASAN 00:20:29.787 #undef SPDK_CONFIG_AVAHI 00:20:29.787 #undef SPDK_CONFIG_CET 00:20:29.787 #define SPDK_CONFIG_COVERAGE 1 00:20:29.787 #define SPDK_CONFIG_CROSS_PREFIX 00:20:29.787 #undef SPDK_CONFIG_CRYPTO 00:20:29.787 #undef SPDK_CONFIG_CRYPTO_MLX5 00:20:29.787 #undef SPDK_CONFIG_CUSTOMOCF 00:20:29.787 #undef SPDK_CONFIG_DAOS 00:20:29.787 #define SPDK_CONFIG_DAOS_DIR 00:20:29.787 #define SPDK_CONFIG_DEBUG 1 00:20:29.787 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:20:29.787 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build 00:20:29.787 #define SPDK_CONFIG_DPDK_INC_DIR 00:20:29.787 #define SPDK_CONFIG_DPDK_LIB_DIR 00:20:29.787 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:20:29.787 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/env_dpdk 00:20:29.787 #define SPDK_CONFIG_EXAMPLES 1 00:20:29.787 #undef SPDK_CONFIG_FC 00:20:29.787 #define SPDK_CONFIG_FC_PATH 00:20:29.787 #define SPDK_CONFIG_FIO_PLUGIN 1 00:20:29.787 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:20:29.787 #undef SPDK_CONFIG_FUSE 00:20:29.787 #undef SPDK_CONFIG_FUZZER 00:20:29.787 #define SPDK_CONFIG_FUZZER_LIB 00:20:29.787 #undef SPDK_CONFIG_GOLANG 00:20:29.787 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:20:29.787 #define SPDK_CONFIG_HAVE_EVP_MAC 1 00:20:29.787 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:20:29.787 #undef SPDK_CONFIG_HAVE_KEYUTILS 00:20:29.787 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:20:29.787 #undef SPDK_CONFIG_HAVE_LIBBSD 00:20:29.787 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:20:29.787 #define SPDK_CONFIG_IDXD 1 00:20:29.787 #undef SPDK_CONFIG_IDXD_KERNEL 00:20:29.787 #undef SPDK_CONFIG_IPSEC_MB 00:20:29.787 #define SPDK_CONFIG_IPSEC_MB_DIR 00:20:29.787 #define SPDK_CONFIG_ISAL 1 00:20:29.787 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:20:29.787 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:20:29.787 #define SPDK_CONFIG_LIBDIR 00:20:29.787 #undef SPDK_CONFIG_LTO 00:20:29.787 #define SPDK_CONFIG_MAX_LCORES 00:20:29.787 #define SPDK_CONFIG_NVME_CUSE 1 00:20:29.787 #undef SPDK_CONFIG_OCF 00:20:29.787 #define SPDK_CONFIG_OCF_PATH 00:20:29.787 #define SPDK_CONFIG_OPENSSL_PATH 00:20:29.787 #undef SPDK_CONFIG_PGO_CAPTURE 00:20:29.787 #define SPDK_CONFIG_PGO_DIR 00:20:29.787 #undef SPDK_CONFIG_PGO_USE 00:20:29.787 #define SPDK_CONFIG_PREFIX /usr/local 00:20:29.787 #undef SPDK_CONFIG_RAID5F 00:20:29.787 #undef SPDK_CONFIG_RBD 00:20:29.787 #define SPDK_CONFIG_RDMA 1 00:20:29.787 #define SPDK_CONFIG_RDMA_PROV verbs 00:20:29.787 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:20:29.787 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:20:29.787 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:20:29.787 #define SPDK_CONFIG_SHARED 1 00:20:29.787 #undef SPDK_CONFIG_SMA 00:20:29.787 #define SPDK_CONFIG_TESTS 1 00:20:29.787 #undef SPDK_CONFIG_TSAN 00:20:29.787 #define SPDK_CONFIG_UBLK 1 00:20:29.787 #define SPDK_CONFIG_UBSAN 1 00:20:29.787 #undef SPDK_CONFIG_UNIT_TESTS 00:20:29.787 #undef SPDK_CONFIG_URING 00:20:29.787 #define SPDK_CONFIG_URING_PATH 00:20:29.787 #undef SPDK_CONFIG_URING_ZNS 00:20:29.787 #undef SPDK_CONFIG_USDT 00:20:29.787 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:20:29.787 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:20:29.787 #undef SPDK_CONFIG_VFIO_USER 00:20:29.787 #define SPDK_CONFIG_VFIO_USER_DIR 00:20:29.787 #define SPDK_CONFIG_VHOST 1 00:20:29.787 #define SPDK_CONFIG_VIRTIO 1 00:20:29.787 #undef SPDK_CONFIG_VTUNE 00:20:29.787 #define SPDK_CONFIG_VTUNE_DIR 00:20:29.787 #define SPDK_CONFIG_WERROR 1 00:20:29.787 #define SPDK_CONFIG_WPDK_DIR 00:20:29.787 #undef SPDK_CONFIG_XNVME 00:20:29.787 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:20:29.787 03:21:03 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:20:29.787 03:21:03 -- common/autotest_common.sh@54 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:20:29.787 03:21:03 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:29.787 03:21:03 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:29.787 03:21:03 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:29.787 03:21:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:29.787 03:21:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:29.787 03:21:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:29.787 03:21:03 -- paths/export.sh@5 -- # export PATH 00:20:29.787 03:21:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:29.787 03:21:03 -- common/autotest_common.sh@55 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/common 00:20:29.787 03:21:03 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/common 00:20:29.787 03:21:03 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm 00:20:29.787 03:21:03 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm 00:20:29.788 03:21:03 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/../../../ 00:20:29.788 03:21:03 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:20:29.788 03:21:03 -- pm/common@67 -- # TEST_TAG=N/A 00:20:29.788 03:21:03 -- pm/common@68 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/.run_test_name 00:20:29.788 03:21:03 -- pm/common@70 -- # PM_OUTPUTDIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power 00:20:29.788 03:21:03 -- pm/common@71 -- # uname -s 00:20:29.788 03:21:03 -- pm/common@71 -- # PM_OS=Linux 00:20:29.788 03:21:03 -- pm/common@73 -- # MONITOR_RESOURCES=(collect-cpu-load collect-vmstat) 00:20:29.788 03:21:03 -- pm/common@74 -- # [[ Linux == FreeBSD ]] 00:20:29.788 03:21:03 -- pm/common@76 -- # [[ Linux == Linux ]] 00:20:29.788 03:21:03 -- pm/common@76 -- # [[ ............................... != QEMU ]] 00:20:29.788 03:21:03 -- pm/common@76 -- # [[ ! -e /.dockerenv ]] 00:20:29.788 03:21:03 -- pm/common@79 -- # MONITOR_RESOURCES+=(collect-cpu-temp) 00:20:29.788 03:21:03 -- pm/common@80 -- # MONITOR_RESOURCES+=(collect-bmc-pm) 00:20:29.788 03:21:03 -- pm/common@83 -- # MONITOR_RESOURCES_PIDS=() 00:20:29.788 03:21:03 -- pm/common@83 -- # declare -A MONITOR_RESOURCES_PIDS 00:20:29.788 03:21:03 -- pm/common@85 -- # mkdir -p /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power 00:20:29.788 03:21:03 -- common/autotest_common.sh@57 -- # : 1 00:20:29.788 03:21:03 -- common/autotest_common.sh@58 -- # export RUN_NIGHTLY 00:20:29.788 03:21:03 -- common/autotest_common.sh@61 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@62 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:20:29.788 03:21:03 -- common/autotest_common.sh@63 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@64 -- # export SPDK_RUN_VALGRIND 00:20:29.788 03:21:03 -- common/autotest_common.sh@65 -- # : 1 00:20:29.788 03:21:03 -- common/autotest_common.sh@66 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:20:29.788 03:21:03 -- common/autotest_common.sh@67 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@68 -- # export SPDK_TEST_UNITTEST 00:20:29.788 03:21:03 -- common/autotest_common.sh@69 -- # : 00:20:29.788 03:21:03 -- common/autotest_common.sh@70 -- # export SPDK_TEST_AUTOBUILD 00:20:29.788 03:21:03 -- common/autotest_common.sh@71 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@72 -- # export SPDK_TEST_RELEASE_BUILD 00:20:29.788 03:21:03 -- common/autotest_common.sh@73 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@74 -- # export SPDK_TEST_ISAL 00:20:29.788 03:21:03 -- common/autotest_common.sh@75 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@76 -- # export SPDK_TEST_ISCSI 00:20:29.788 03:21:03 -- common/autotest_common.sh@77 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@78 -- # export SPDK_TEST_ISCSI_INITIATOR 00:20:29.788 03:21:03 -- common/autotest_common.sh@79 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@80 -- # export SPDK_TEST_NVME 00:20:29.788 03:21:03 -- common/autotest_common.sh@81 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@82 -- # export SPDK_TEST_NVME_PMR 00:20:29.788 03:21:03 -- common/autotest_common.sh@83 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@84 -- # export SPDK_TEST_NVME_BP 00:20:29.788 03:21:03 -- common/autotest_common.sh@85 -- # : 1 00:20:29.788 03:21:03 -- common/autotest_common.sh@86 -- # export SPDK_TEST_NVME_CLI 00:20:29.788 03:21:03 -- common/autotest_common.sh@87 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@88 -- # export SPDK_TEST_NVME_CUSE 00:20:29.788 03:21:03 -- common/autotest_common.sh@89 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@90 -- # export SPDK_TEST_NVME_FDP 00:20:29.788 03:21:03 -- common/autotest_common.sh@91 -- # : 1 00:20:29.788 03:21:03 -- common/autotest_common.sh@92 -- # export SPDK_TEST_NVMF 00:20:29.788 03:21:03 -- common/autotest_common.sh@93 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@94 -- # export SPDK_TEST_VFIOUSER 00:20:29.788 03:21:03 -- common/autotest_common.sh@95 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@96 -- # export SPDK_TEST_VFIOUSER_QEMU 00:20:29.788 03:21:03 -- common/autotest_common.sh@97 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@98 -- # export SPDK_TEST_FUZZER 00:20:29.788 03:21:03 -- common/autotest_common.sh@99 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@100 -- # export SPDK_TEST_FUZZER_SHORT 00:20:29.788 03:21:03 -- common/autotest_common.sh@101 -- # : rdma 00:20:29.788 03:21:03 -- common/autotest_common.sh@102 -- # export SPDK_TEST_NVMF_TRANSPORT 00:20:29.788 03:21:03 -- common/autotest_common.sh@103 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@104 -- # export SPDK_TEST_RBD 00:20:29.788 03:21:03 -- common/autotest_common.sh@105 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@106 -- # export SPDK_TEST_VHOST 00:20:29.788 03:21:03 -- common/autotest_common.sh@107 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@108 -- # export SPDK_TEST_BLOCKDEV 00:20:29.788 03:21:03 -- common/autotest_common.sh@109 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@110 -- # export SPDK_TEST_IOAT 00:20:29.788 03:21:03 -- common/autotest_common.sh@111 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@112 -- # export SPDK_TEST_BLOBFS 00:20:29.788 03:21:03 -- common/autotest_common.sh@113 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@114 -- # export SPDK_TEST_VHOST_INIT 00:20:29.788 03:21:03 -- common/autotest_common.sh@115 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@116 -- # export SPDK_TEST_LVOL 00:20:29.788 03:21:03 -- common/autotest_common.sh@117 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@118 -- # export SPDK_TEST_VBDEV_COMPRESS 00:20:29.788 03:21:03 -- common/autotest_common.sh@119 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@120 -- # export SPDK_RUN_ASAN 00:20:29.788 03:21:03 -- common/autotest_common.sh@121 -- # : 1 00:20:29.788 03:21:03 -- common/autotest_common.sh@122 -- # export SPDK_RUN_UBSAN 00:20:29.788 03:21:03 -- common/autotest_common.sh@123 -- # : 00:20:29.788 03:21:03 -- common/autotest_common.sh@124 -- # export SPDK_RUN_EXTERNAL_DPDK 00:20:29.788 03:21:03 -- common/autotest_common.sh@125 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@126 -- # export SPDK_RUN_NON_ROOT 00:20:29.788 03:21:03 -- common/autotest_common.sh@127 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@128 -- # export SPDK_TEST_CRYPTO 00:20:29.788 03:21:03 -- common/autotest_common.sh@129 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@130 -- # export SPDK_TEST_FTL 00:20:29.788 03:21:03 -- common/autotest_common.sh@131 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@132 -- # export SPDK_TEST_OCF 00:20:29.788 03:21:03 -- common/autotest_common.sh@133 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@134 -- # export SPDK_TEST_VMD 00:20:29.788 03:21:03 -- common/autotest_common.sh@135 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@136 -- # export SPDK_TEST_OPAL 00:20:29.788 03:21:03 -- common/autotest_common.sh@137 -- # : 00:20:29.788 03:21:03 -- common/autotest_common.sh@138 -- # export SPDK_TEST_NATIVE_DPDK 00:20:29.788 03:21:03 -- common/autotest_common.sh@139 -- # : true 00:20:29.788 03:21:03 -- common/autotest_common.sh@140 -- # export SPDK_AUTOTEST_X 00:20:29.788 03:21:03 -- common/autotest_common.sh@141 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@142 -- # export SPDK_TEST_RAID5 00:20:29.788 03:21:03 -- common/autotest_common.sh@143 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@144 -- # export SPDK_TEST_URING 00:20:29.788 03:21:03 -- common/autotest_common.sh@145 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@146 -- # export SPDK_TEST_USDT 00:20:29.788 03:21:03 -- common/autotest_common.sh@147 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@148 -- # export SPDK_TEST_USE_IGB_UIO 00:20:29.788 03:21:03 -- common/autotest_common.sh@149 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@150 -- # export SPDK_TEST_SCHEDULER 00:20:29.788 03:21:03 -- common/autotest_common.sh@151 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@152 -- # export SPDK_TEST_SCANBUILD 00:20:29.788 03:21:03 -- common/autotest_common.sh@153 -- # : e810 00:20:29.788 03:21:03 -- common/autotest_common.sh@154 -- # export SPDK_TEST_NVMF_NICS 00:20:29.788 03:21:03 -- common/autotest_common.sh@155 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@156 -- # export SPDK_TEST_SMA 00:20:29.788 03:21:03 -- common/autotest_common.sh@157 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@158 -- # export SPDK_TEST_DAOS 00:20:29.788 03:21:03 -- common/autotest_common.sh@159 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@160 -- # export SPDK_TEST_XNVME 00:20:29.788 03:21:03 -- common/autotest_common.sh@161 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@162 -- # export SPDK_TEST_ACCEL_DSA 00:20:29.788 03:21:03 -- common/autotest_common.sh@163 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@164 -- # export SPDK_TEST_ACCEL_IAA 00:20:29.788 03:21:03 -- common/autotest_common.sh@166 -- # : 00:20:29.788 03:21:03 -- common/autotest_common.sh@167 -- # export SPDK_TEST_FUZZER_TARGET 00:20:29.788 03:21:03 -- common/autotest_common.sh@168 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@169 -- # export SPDK_TEST_NVMF_MDNS 00:20:29.788 03:21:03 -- common/autotest_common.sh@170 -- # : 0 00:20:29.788 03:21:03 -- common/autotest_common.sh@171 -- # export SPDK_JSONRPC_GO_CLIENT 00:20:29.788 03:21:03 -- common/autotest_common.sh@174 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib 00:20:29.788 03:21:03 -- common/autotest_common.sh@174 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib 00:20:29.788 03:21:03 -- common/autotest_common.sh@175 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib 00:20:29.788 03:21:03 -- common/autotest_common.sh@175 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib 00:20:29.788 03:21:03 -- common/autotest_common.sh@176 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:20:29.788 03:21:03 -- common/autotest_common.sh@176 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:20:29.788 03:21:03 -- common/autotest_common.sh@177 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:20:29.789 03:21:03 -- common/autotest_common.sh@177 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:20:29.789 03:21:03 -- common/autotest_common.sh@180 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:20:29.789 03:21:03 -- common/autotest_common.sh@180 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:20:29.789 03:21:03 -- common/autotest_common.sh@184 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python 00:20:29.789 03:21:03 -- common/autotest_common.sh@184 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python 00:20:29.789 03:21:03 -- common/autotest_common.sh@188 -- # export PYTHONDONTWRITEBYTECODE=1 00:20:29.789 03:21:03 -- common/autotest_common.sh@188 -- # PYTHONDONTWRITEBYTECODE=1 00:20:29.789 03:21:03 -- common/autotest_common.sh@192 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:20:29.789 03:21:03 -- common/autotest_common.sh@192 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:20:29.789 03:21:03 -- common/autotest_common.sh@193 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:20:29.789 03:21:03 -- common/autotest_common.sh@193 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:20:29.789 03:21:03 -- common/autotest_common.sh@197 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:20:29.789 03:21:03 -- common/autotest_common.sh@198 -- # rm -rf /var/tmp/asan_suppression_file 00:20:29.789 03:21:03 -- common/autotest_common.sh@199 -- # cat 00:20:29.789 03:21:03 -- common/autotest_common.sh@225 -- # echo leak:libfuse3.so 00:20:29.789 03:21:03 -- common/autotest_common.sh@227 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:20:29.789 03:21:03 -- common/autotest_common.sh@227 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:20:29.789 03:21:03 -- common/autotest_common.sh@229 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:20:29.789 03:21:03 -- common/autotest_common.sh@229 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:20:29.789 03:21:03 -- common/autotest_common.sh@231 -- # '[' -z /var/spdk/dependencies ']' 00:20:29.789 03:21:03 -- common/autotest_common.sh@234 -- # export DEPENDENCY_DIR 00:20:29.789 03:21:03 -- common/autotest_common.sh@238 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin 00:20:29.789 03:21:03 -- common/autotest_common.sh@238 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin 00:20:29.789 03:21:03 -- common/autotest_common.sh@239 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples 00:20:29.789 03:21:03 -- common/autotest_common.sh@239 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples 00:20:29.789 03:21:03 -- common/autotest_common.sh@242 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:20:29.789 03:21:03 -- common/autotest_common.sh@242 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:20:29.789 03:21:03 -- common/autotest_common.sh@243 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:20:29.789 03:21:03 -- common/autotest_common.sh@243 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:20:29.789 03:21:03 -- common/autotest_common.sh@245 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:20:29.789 03:21:03 -- common/autotest_common.sh@245 -- # AR_TOOL=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:20:29.789 03:21:03 -- common/autotest_common.sh@248 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:20:29.789 03:21:03 -- common/autotest_common.sh@248 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:20:29.789 03:21:03 -- common/autotest_common.sh@251 -- # '[' 0 -eq 0 ']' 00:20:29.789 03:21:03 -- common/autotest_common.sh@252 -- # export valgrind= 00:20:29.789 03:21:03 -- common/autotest_common.sh@252 -- # valgrind= 00:20:29.789 03:21:03 -- common/autotest_common.sh@258 -- # uname -s 00:20:29.789 03:21:03 -- common/autotest_common.sh@258 -- # '[' Linux = Linux ']' 00:20:29.789 03:21:03 -- common/autotest_common.sh@259 -- # HUGEMEM=4096 00:20:29.789 03:21:03 -- common/autotest_common.sh@260 -- # export CLEAR_HUGE=yes 00:20:29.789 03:21:03 -- common/autotest_common.sh@260 -- # CLEAR_HUGE=yes 00:20:29.789 03:21:03 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:20:29.789 03:21:03 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:20:29.789 03:21:03 -- common/autotest_common.sh@268 -- # MAKE=make 00:20:29.789 03:21:03 -- common/autotest_common.sh@269 -- # MAKEFLAGS=-j96 00:20:29.789 03:21:03 -- common/autotest_common.sh@285 -- # export HUGEMEM=4096 00:20:29.789 03:21:03 -- common/autotest_common.sh@285 -- # HUGEMEM=4096 00:20:29.789 03:21:03 -- common/autotest_common.sh@287 -- # NO_HUGE=() 00:20:29.789 03:21:03 -- common/autotest_common.sh@288 -- # TEST_MODE= 00:20:29.789 03:21:03 -- common/autotest_common.sh@289 -- # for i in "$@" 00:20:29.789 03:21:03 -- common/autotest_common.sh@290 -- # case "$i" in 00:20:29.789 03:21:03 -- common/autotest_common.sh@295 -- # TEST_TRANSPORT=rdma 00:20:29.789 03:21:03 -- common/autotest_common.sh@307 -- # [[ -z 4136107 ]] 00:20:29.789 03:21:03 -- common/autotest_common.sh@307 -- # kill -0 4136107 00:20:29.789 03:21:03 -- common/autotest_common.sh@1666 -- # set_test_storage 2147483648 00:20:29.789 03:21:03 -- common/autotest_common.sh@317 -- # [[ -v testdir ]] 00:20:29.789 03:21:03 -- common/autotest_common.sh@319 -- # local requested_size=2147483648 00:20:29.789 03:21:03 -- common/autotest_common.sh@320 -- # local mount target_dir 00:20:29.789 03:21:03 -- common/autotest_common.sh@322 -- # local -A mounts fss sizes avails uses 00:20:29.789 03:21:03 -- common/autotest_common.sh@323 -- # local source fs size avail mount use 00:20:29.789 03:21:03 -- common/autotest_common.sh@325 -- # local storage_fallback storage_candidates 00:20:29.789 03:21:03 -- common/autotest_common.sh@327 -- # mktemp -udt spdk.XXXXXX 00:20:29.789 03:21:03 -- common/autotest_common.sh@327 -- # storage_fallback=/tmp/spdk.WCE2h5 00:20:29.789 03:21:03 -- common/autotest_common.sh@332 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:20:29.789 03:21:03 -- common/autotest_common.sh@334 -- # [[ -n '' ]] 00:20:29.789 03:21:03 -- common/autotest_common.sh@339 -- # [[ -n '' ]] 00:20:29.789 03:21:03 -- common/autotest_common.sh@344 -- # mkdir -p /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target /tmp/spdk.WCE2h5/tests/target /tmp/spdk.WCE2h5 00:20:29.789 03:21:03 -- common/autotest_common.sh@347 -- # requested_size=2214592512 00:20:29.789 03:21:03 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:20:29.789 03:21:03 -- common/autotest_common.sh@316 -- # df -T 00:20:29.789 03:21:03 -- common/autotest_common.sh@316 -- # grep -v Filesystem 00:20:29.789 03:21:03 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_devtmpfs 00:20:29.789 03:21:03 -- common/autotest_common.sh@350 -- # fss["$mount"]=devtmpfs 00:20:29.789 03:21:03 -- common/autotest_common.sh@351 -- # avails["$mount"]=67108864 00:20:29.789 03:21:03 -- common/autotest_common.sh@351 -- # sizes["$mount"]=67108864 00:20:29.789 03:21:03 -- common/autotest_common.sh@352 -- # uses["$mount"]=0 00:20:29.789 03:21:03 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:20:29.789 03:21:03 -- common/autotest_common.sh@350 -- # mounts["$mount"]=/dev/pmem0 00:20:29.789 03:21:03 -- common/autotest_common.sh@350 -- # fss["$mount"]=ext2 00:20:29.789 03:21:03 -- common/autotest_common.sh@351 -- # avails["$mount"]=940740608 00:20:29.789 03:21:03 -- common/autotest_common.sh@351 -- # sizes["$mount"]=5284429824 00:20:29.789 03:21:03 -- common/autotest_common.sh@352 -- # uses["$mount"]=4343689216 00:20:29.789 03:21:03 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:20:29.789 03:21:03 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_root 00:20:29.789 03:21:03 -- common/autotest_common.sh@350 -- # fss["$mount"]=overlay 00:20:29.789 03:21:03 -- common/autotest_common.sh@351 -- # avails["$mount"]=89575256064 00:20:29.789 03:21:03 -- common/autotest_common.sh@351 -- # sizes["$mount"]=95562719232 00:20:29.789 03:21:03 -- common/autotest_common.sh@352 -- # uses["$mount"]=5987463168 00:20:29.789 03:21:03 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:20:29.789 03:21:03 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:20:29.789 03:21:03 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:20:29.789 03:21:03 -- common/autotest_common.sh@351 -- # avails["$mount"]=47775633408 00:20:29.789 03:21:03 -- common/autotest_common.sh@351 -- # sizes["$mount"]=47781359616 00:20:29.789 03:21:03 -- common/autotest_common.sh@352 -- # uses["$mount"]=5726208 00:20:29.789 03:21:03 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:20:29.789 03:21:03 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:20:29.789 03:21:03 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:20:29.789 03:21:03 -- common/autotest_common.sh@351 -- # avails["$mount"]=19089268736 00:20:29.789 03:21:03 -- common/autotest_common.sh@351 -- # sizes["$mount"]=19112546304 00:20:29.789 03:21:03 -- common/autotest_common.sh@352 -- # uses["$mount"]=23277568 00:20:29.789 03:21:03 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:20:29.789 03:21:03 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:20:29.789 03:21:03 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:20:29.789 03:21:03 -- common/autotest_common.sh@351 -- # avails["$mount"]=47780962304 00:20:29.789 03:21:03 -- common/autotest_common.sh@351 -- # sizes["$mount"]=47781359616 00:20:29.789 03:21:03 -- common/autotest_common.sh@352 -- # uses["$mount"]=397312 00:20:29.789 03:21:03 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:20:29.789 03:21:03 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:20:29.789 03:21:03 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:20:29.789 03:21:03 -- common/autotest_common.sh@351 -- # avails["$mount"]=9556267008 00:20:29.789 03:21:03 -- common/autotest_common.sh@351 -- # sizes["$mount"]=9556271104 00:20:29.789 03:21:03 -- common/autotest_common.sh@352 -- # uses["$mount"]=4096 00:20:29.789 03:21:03 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:20:29.789 03:21:03 -- common/autotest_common.sh@355 -- # printf '* Looking for test storage...\n' 00:20:29.789 * Looking for test storage... 00:20:29.789 03:21:03 -- common/autotest_common.sh@357 -- # local target_space new_size 00:20:29.789 03:21:03 -- common/autotest_common.sh@358 -- # for target_dir in "${storage_candidates[@]}" 00:20:29.789 03:21:03 -- common/autotest_common.sh@361 -- # awk '$1 !~ /Filesystem/{print $6}' 00:20:29.789 03:21:03 -- common/autotest_common.sh@361 -- # df /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:20:29.789 03:21:03 -- common/autotest_common.sh@361 -- # mount=/ 00:20:29.789 03:21:03 -- common/autotest_common.sh@363 -- # target_space=89575256064 00:20:29.789 03:21:03 -- common/autotest_common.sh@364 -- # (( target_space == 0 || target_space < requested_size )) 00:20:29.789 03:21:03 -- common/autotest_common.sh@367 -- # (( target_space >= requested_size )) 00:20:29.789 03:21:03 -- common/autotest_common.sh@369 -- # [[ overlay == tmpfs ]] 00:20:29.790 03:21:03 -- common/autotest_common.sh@369 -- # [[ overlay == ramfs ]] 00:20:29.790 03:21:03 -- common/autotest_common.sh@369 -- # [[ / == / ]] 00:20:29.790 03:21:03 -- common/autotest_common.sh@370 -- # new_size=8202055680 00:20:29.790 03:21:03 -- common/autotest_common.sh@371 -- # (( new_size * 100 / sizes[/] > 95 )) 00:20:29.790 03:21:03 -- common/autotest_common.sh@376 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:20:29.790 03:21:03 -- common/autotest_common.sh@376 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:20:29.790 03:21:03 -- common/autotest_common.sh@377 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:20:29.790 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:20:29.790 03:21:03 -- common/autotest_common.sh@378 -- # return 0 00:20:29.790 03:21:03 -- common/autotest_common.sh@1668 -- # set -o errtrace 00:20:29.790 03:21:03 -- common/autotest_common.sh@1669 -- # shopt -s extdebug 00:20:29.790 03:21:03 -- common/autotest_common.sh@1670 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:20:29.790 03:21:03 -- common/autotest_common.sh@1672 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:20:29.790 03:21:03 -- common/autotest_common.sh@1673 -- # true 00:20:29.790 03:21:03 -- common/autotest_common.sh@1675 -- # xtrace_fd 00:20:29.790 03:21:03 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:20:29.790 03:21:03 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:20:29.790 03:21:03 -- common/autotest_common.sh@27 -- # exec 00:20:29.790 03:21:03 -- common/autotest_common.sh@29 -- # exec 00:20:29.790 03:21:03 -- common/autotest_common.sh@31 -- # xtrace_restore 00:20:29.790 03:21:03 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:20:29.790 03:21:03 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:20:29.790 03:21:03 -- common/autotest_common.sh@18 -- # set -x 00:20:29.790 03:21:03 -- target/device_removal.sh@11 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:20:29.790 03:21:03 -- nvmf/common.sh@7 -- # uname -s 00:20:29.790 03:21:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:29.790 03:21:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:29.790 03:21:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:29.790 03:21:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:29.790 03:21:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:29.790 03:21:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:29.790 03:21:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:29.790 03:21:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:29.790 03:21:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:29.790 03:21:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:29.790 03:21:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:20:29.790 03:21:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:20:29.790 03:21:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:29.790 03:21:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:29.790 03:21:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:29.790 03:21:03 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:20:29.790 03:21:03 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:20:29.790 03:21:03 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:29.790 03:21:03 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:29.790 03:21:03 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:29.790 03:21:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:29.790 03:21:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:29.790 03:21:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:29.790 03:21:03 -- paths/export.sh@5 -- # export PATH 00:20:29.790 03:21:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:29.790 03:21:03 -- nvmf/common.sh@47 -- # : 0 00:20:29.790 03:21:03 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:20:29.790 03:21:03 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:20:29.790 03:21:03 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:20:29.790 03:21:03 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:29.790 03:21:03 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:29.790 03:21:03 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:20:29.790 03:21:03 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:20:29.790 03:21:03 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:20:29.790 03:21:03 -- target/device_removal.sh@13 -- # tgt_core_mask=0x3 00:20:29.790 03:21:03 -- target/device_removal.sh@14 -- # bdevperf_core_mask=0x4 00:20:29.790 03:21:03 -- target/device_removal.sh@15 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:29.790 03:21:03 -- target/device_removal.sh@16 -- # bdevperf_rpc_pid=-1 00:20:29.790 03:21:03 -- target/device_removal.sh@18 -- # nvmftestinit 00:20:29.790 03:21:03 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:20:29.790 03:21:03 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:29.790 03:21:03 -- nvmf/common.sh@437 -- # prepare_net_devs 00:20:29.790 03:21:03 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:20:29.790 03:21:03 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:20:29.790 03:21:03 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:29.790 03:21:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:29.790 03:21:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:29.790 03:21:03 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:20:29.790 03:21:03 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:20:29.790 03:21:03 -- nvmf/common.sh@285 -- # xtrace_disable 00:20:29.790 03:21:03 -- common/autotest_common.sh@10 -- # set +x 00:20:36.354 03:21:09 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:36.354 03:21:09 -- nvmf/common.sh@291 -- # pci_devs=() 00:20:36.354 03:21:09 -- nvmf/common.sh@291 -- # local -a pci_devs 00:20:36.354 03:21:09 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:20:36.354 03:21:09 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:20:36.354 03:21:09 -- nvmf/common.sh@293 -- # pci_drivers=() 00:20:36.354 03:21:09 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:20:36.354 03:21:09 -- nvmf/common.sh@295 -- # net_devs=() 00:20:36.354 03:21:09 -- nvmf/common.sh@295 -- # local -ga net_devs 00:20:36.354 03:21:09 -- nvmf/common.sh@296 -- # e810=() 00:20:36.354 03:21:09 -- nvmf/common.sh@296 -- # local -ga e810 00:20:36.354 03:21:09 -- nvmf/common.sh@297 -- # x722=() 00:20:36.354 03:21:09 -- nvmf/common.sh@297 -- # local -ga x722 00:20:36.354 03:21:09 -- nvmf/common.sh@298 -- # mlx=() 00:20:36.354 03:21:09 -- nvmf/common.sh@298 -- # local -ga mlx 00:20:36.354 03:21:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:36.354 03:21:09 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:36.354 03:21:09 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:36.354 03:21:09 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:36.354 03:21:09 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:36.354 03:21:09 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:36.354 03:21:09 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:36.354 03:21:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:36.354 03:21:09 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:36.354 03:21:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:36.354 03:21:09 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:36.354 03:21:09 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:20:36.354 03:21:09 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:20:36.354 03:21:09 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:20:36.354 03:21:09 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:20:36.354 03:21:09 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:20:36.354 03:21:09 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:20:36.354 03:21:09 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:20:36.354 03:21:09 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:20:36.354 03:21:09 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:36.354 03:21:09 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:20:36.354 Found 0000:af:00.0 (0x8086 - 0x159b) 00:20:36.354 03:21:09 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:20:36.354 03:21:09 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:20:36.354 03:21:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:36.354 03:21:09 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:36.354 03:21:09 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:36.354 03:21:09 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:36.354 03:21:09 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:36.354 03:21:09 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:20:36.354 Found 0000:af:00.1 (0x8086 - 0x159b) 00:20:36.354 03:21:09 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:20:36.354 03:21:09 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:20:36.354 03:21:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:36.354 03:21:09 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:36.354 03:21:09 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:36.354 03:21:09 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:36.354 03:21:09 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:20:36.354 03:21:09 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:20:36.354 03:21:09 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:20:36.354 03:21:09 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:20:36.354 03:21:09 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:20:36.354 03:21:09 -- nvmf/common.sh@377 -- # modinfo irdma 00:20:36.354 03:21:09 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:20:36.354 03:21:09 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:36.354 03:21:09 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:36.354 03:21:09 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:36.354 03:21:09 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:36.354 03:21:09 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:20:36.354 Found net devices under 0000:af:00.0: cvl_0_0 00:20:36.354 03:21:09 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:36.354 03:21:09 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:36.354 03:21:09 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:36.354 03:21:09 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:36.354 03:21:09 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:36.354 03:21:09 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:20:36.354 Found net devices under 0000:af:00.1: cvl_0_1 00:20:36.354 03:21:09 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:36.354 03:21:09 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:20:36.354 03:21:09 -- nvmf/common.sh@403 -- # is_hw=yes 00:20:36.354 03:21:09 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:20:36.354 03:21:09 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:20:36.354 03:21:09 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:20:36.354 03:21:09 -- nvmf/common.sh@409 -- # rdma_device_init 00:20:36.354 03:21:09 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:20:36.354 03:21:09 -- nvmf/common.sh@58 -- # uname 00:20:36.354 03:21:09 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:20:36.354 03:21:09 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:20:36.354 03:21:09 -- nvmf/common.sh@63 -- # modprobe ib_core 00:20:36.354 03:21:09 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:20:36.354 03:21:09 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:20:36.354 03:21:09 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:20:36.354 03:21:09 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:20:36.354 03:21:09 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:20:36.354 03:21:09 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:20:36.354 03:21:09 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:20:36.354 03:21:09 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:20:36.354 03:21:09 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:36.354 03:21:09 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:36.354 03:21:09 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:36.355 03:21:09 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:36.355 03:21:09 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:36.355 03:21:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:36.355 03:21:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:36.355 03:21:09 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:20:36.355 03:21:09 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:20:36.355 03:21:09 -- nvmf/common.sh@105 -- # continue 2 00:20:36.355 03:21:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:36.355 03:21:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:36.355 03:21:09 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:20:36.355 03:21:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:36.355 03:21:09 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:20:36.355 03:21:09 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:20:36.355 03:21:09 -- nvmf/common.sh@105 -- # continue 2 00:20:36.355 03:21:09 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:36.355 03:21:09 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:20:36.355 03:21:09 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:20:36.355 03:21:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:20:36.355 03:21:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:36.355 03:21:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:36.355 03:21:09 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:20:36.355 03:21:09 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:20:36.355 03:21:09 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:20:36.355 4: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:20:36.355 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:20:36.355 altname enp175s0f0np0 00:20:36.355 altname ens801f0np0 00:20:36.355 inet 192.168.100.8/24 scope global cvl_0_0 00:20:36.355 valid_lft forever preferred_lft forever 00:20:36.355 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:20:36.355 valid_lft forever preferred_lft forever 00:20:36.355 03:21:09 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:36.355 03:21:09 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:20:36.355 03:21:09 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:20:36.355 03:21:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:20:36.355 03:21:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:36.355 03:21:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:36.355 03:21:09 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:20:36.355 03:21:09 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:20:36.355 03:21:09 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:20:36.355 5: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:20:36.355 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:20:36.355 altname enp175s0f1np1 00:20:36.355 altname ens801f1np1 00:20:36.355 inet 192.168.100.9/24 scope global cvl_0_1 00:20:36.355 valid_lft forever preferred_lft forever 00:20:36.355 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:20:36.355 valid_lft forever preferred_lft forever 00:20:36.355 03:21:09 -- nvmf/common.sh@411 -- # return 0 00:20:36.355 03:21:09 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:20:36.355 03:21:09 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:20:36.355 03:21:09 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:20:36.355 03:21:09 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:20:36.355 03:21:09 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:20:36.355 03:21:09 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:36.355 03:21:09 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:36.355 03:21:09 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:36.355 03:21:09 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:36.355 03:21:09 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:36.355 03:21:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:36.355 03:21:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:36.355 03:21:09 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:20:36.355 03:21:09 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:20:36.355 03:21:09 -- nvmf/common.sh@105 -- # continue 2 00:20:36.355 03:21:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:36.355 03:21:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:36.355 03:21:09 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:20:36.355 03:21:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:36.355 03:21:09 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:20:36.355 03:21:09 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:20:36.355 03:21:09 -- nvmf/common.sh@105 -- # continue 2 00:20:36.355 03:21:09 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:36.355 03:21:09 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:20:36.355 03:21:09 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:20:36.355 03:21:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:20:36.355 03:21:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:36.355 03:21:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:36.355 03:21:09 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:36.355 03:21:09 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:20:36.355 03:21:09 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:20:36.355 03:21:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:20:36.355 03:21:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:36.355 03:21:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:36.355 03:21:09 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:20:36.355 192.168.100.9' 00:20:36.355 03:21:09 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:20:36.355 192.168.100.9' 00:20:36.355 03:21:09 -- nvmf/common.sh@446 -- # head -n 1 00:20:36.355 03:21:09 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:20:36.355 03:21:09 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:20:36.355 192.168.100.9' 00:20:36.355 03:21:09 -- nvmf/common.sh@447 -- # tail -n +2 00:20:36.355 03:21:09 -- nvmf/common.sh@447 -- # head -n 1 00:20:36.355 03:21:09 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:20:36.355 03:21:09 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:20:36.355 03:21:09 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:20:36.355 03:21:09 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:20:36.355 03:21:09 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:20:36.355 03:21:09 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:20:36.355 03:21:09 -- target/device_removal.sh@235 -- # BOND_NAME=bond_nvmf 00:20:36.355 03:21:09 -- target/device_removal.sh@236 -- # BOND_IP=10.11.11.26 00:20:36.355 03:21:09 -- target/device_removal.sh@237 -- # BOND_MASK=24 00:20:36.355 03:21:09 -- target/device_removal.sh@311 -- # run_test nvmf_device_removal_pci_remove_no_srq test_remove_and_rescan --no-srq 00:20:36.355 03:21:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:36.355 03:21:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:36.355 03:21:09 -- common/autotest_common.sh@10 -- # set +x 00:20:36.355 ************************************ 00:20:36.355 START TEST nvmf_device_removal_pci_remove_no_srq 00:20:36.355 ************************************ 00:20:36.355 03:21:09 -- common/autotest_common.sh@1111 -- # test_remove_and_rescan --no-srq 00:20:36.355 03:21:09 -- target/device_removal.sh@128 -- # nvmfappstart -m 0x3 00:20:36.355 03:21:09 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:20:36.355 03:21:09 -- common/autotest_common.sh@710 -- # xtrace_disable 00:20:36.355 03:21:09 -- common/autotest_common.sh@10 -- # set +x 00:20:36.355 03:21:09 -- nvmf/common.sh@470 -- # nvmfpid=4139812 00:20:36.355 03:21:09 -- nvmf/common.sh@471 -- # waitforlisten 4139812 00:20:36.355 03:21:09 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:20:36.355 03:21:09 -- common/autotest_common.sh@817 -- # '[' -z 4139812 ']' 00:20:36.355 03:21:09 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:36.355 03:21:09 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:36.355 03:21:09 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:36.355 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:36.355 03:21:09 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:36.355 03:21:09 -- common/autotest_common.sh@10 -- # set +x 00:20:36.355 [2024-04-25 03:21:09.961285] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:20:36.355 [2024-04-25 03:21:09.961320] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:36.355 EAL: No free 2048 kB hugepages reported on node 1 00:20:36.355 [2024-04-25 03:21:10.022122] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:20:36.355 [2024-04-25 03:21:10.105968] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:36.355 [2024-04-25 03:21:10.106004] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:36.355 [2024-04-25 03:21:10.106011] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:36.355 [2024-04-25 03:21:10.106017] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:36.355 [2024-04-25 03:21:10.106022] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:36.355 [2024-04-25 03:21:10.106063] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:36.355 [2024-04-25 03:21:10.106065] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:36.355 03:21:10 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:36.355 03:21:10 -- common/autotest_common.sh@850 -- # return 0 00:20:36.355 03:21:10 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:20:36.355 03:21:10 -- common/autotest_common.sh@716 -- # xtrace_disable 00:20:36.355 03:21:10 -- common/autotest_common.sh@10 -- # set +x 00:20:36.355 03:21:10 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:36.355 03:21:10 -- target/device_removal.sh@130 -- # create_subsystem_and_connect --no-srq 00:20:36.355 03:21:10 -- target/device_removal.sh@45 -- # local -gA netdev_nvme_dict 00:20:36.355 03:21:10 -- target/device_removal.sh@46 -- # netdev_nvme_dict=() 00:20:36.355 03:21:10 -- target/device_removal.sh@48 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 --no-srq 00:20:36.355 03:21:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:36.355 03:21:10 -- common/autotest_common.sh@10 -- # set +x 00:20:36.355 [2024-04-25 03:21:10.817822] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0xbda7f0/0xbd9e30) succeed. 00:20:36.356 [2024-04-25 03:21:10.826416] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0xbdba60/0xbda3b0) succeed. 00:20:36.356 [2024-04-25 03:21:10.826438] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:20:36.356 03:21:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:36.356 03:21:10 -- target/device_removal.sh@49 -- # get_rdma_if_list 00:20:36.356 03:21:10 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:36.356 03:21:10 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:36.356 03:21:10 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:36.356 03:21:10 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:36.613 03:21:10 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:36.613 03:21:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:36.613 03:21:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:36.613 03:21:10 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:20:36.613 03:21:10 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:20:36.613 03:21:10 -- nvmf/common.sh@105 -- # continue 2 00:20:36.613 03:21:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:36.613 03:21:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:36.613 03:21:10 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:20:36.613 03:21:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:36.613 03:21:10 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:20:36.613 03:21:10 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:20:36.613 03:21:10 -- nvmf/common.sh@105 -- # continue 2 00:20:36.613 03:21:10 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:20:36.613 03:21:10 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev cvl_0_0 00:20:36.613 03:21:10 -- target/device_removal.sh@25 -- # local -a dev_name 00:20:36.613 03:21:10 -- target/device_removal.sh@27 -- # dev_name=cvl_0_0 00:20:36.613 03:21:10 -- target/device_removal.sh@28 -- # malloc_name=cvl_0_0 00:20:36.613 03:21:10 -- target/device_removal.sh@29 -- # get_subsystem_nqn cvl_0_0 00:20:36.613 03:21:10 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_cvl_0_0 00:20:36.613 03:21:10 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_cvl_0_0 00:20:36.613 03:21:10 -- target/device_removal.sh@30 -- # get_ip_address cvl_0_0 00:20:36.613 03:21:10 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:20:36.613 03:21:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:20:36.613 03:21:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:36.613 03:21:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:36.613 03:21:10 -- target/device_removal.sh@30 -- # ip=192.168.100.8 00:20:36.613 03:21:10 -- target/device_removal.sh@31 -- # serial=SPDK000cvl_0_0 00:20:36.614 03:21:10 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:20:36.614 03:21:10 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:20:36.614 03:21:10 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b cvl_0_0 00:20:36.614 03:21:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:36.614 03:21:10 -- common/autotest_common.sh@10 -- # set +x 00:20:36.614 03:21:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:36.614 03:21:10 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_cvl_0_0 -a -s SPDK000cvl_0_0 00:20:36.614 03:21:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:36.614 03:21:10 -- common/autotest_common.sh@10 -- # set +x 00:20:36.614 03:21:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:36.614 03:21:10 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_cvl_0_0 cvl_0_0 00:20:36.614 03:21:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:36.614 03:21:10 -- common/autotest_common.sh@10 -- # set +x 00:20:36.614 03:21:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:36.614 03:21:10 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_cvl_0_0 -t rdma -a 192.168.100.8 -s 4420 00:20:36.614 03:21:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:36.614 03:21:10 -- common/autotest_common.sh@10 -- # set +x 00:20:36.614 [2024-04-25 03:21:10.947175] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:20:36.614 03:21:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:36.614 03:21:10 -- target/device_removal.sh@41 -- # return 0 00:20:36.614 03:21:10 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=cvl_0_0 00:20:36.614 03:21:10 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:20:36.614 03:21:10 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev cvl_0_1 00:20:36.614 03:21:10 -- target/device_removal.sh@25 -- # local -a dev_name 00:20:36.614 03:21:10 -- target/device_removal.sh@27 -- # dev_name=cvl_0_1 00:20:36.614 03:21:10 -- target/device_removal.sh@28 -- # malloc_name=cvl_0_1 00:20:36.614 03:21:10 -- target/device_removal.sh@29 -- # get_subsystem_nqn cvl_0_1 00:20:36.614 03:21:10 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_cvl_0_1 00:20:36.614 03:21:10 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_cvl_0_1 00:20:36.614 03:21:10 -- target/device_removal.sh@30 -- # get_ip_address cvl_0_1 00:20:36.614 03:21:10 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:20:36.614 03:21:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:20:36.614 03:21:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:36.614 03:21:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:36.614 03:21:10 -- target/device_removal.sh@30 -- # ip=192.168.100.9 00:20:36.614 03:21:10 -- target/device_removal.sh@31 -- # serial=SPDK000cvl_0_1 00:20:36.614 03:21:10 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:20:36.614 03:21:10 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:20:36.614 03:21:10 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b cvl_0_1 00:20:36.614 03:21:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:36.614 03:21:10 -- common/autotest_common.sh@10 -- # set +x 00:20:36.614 03:21:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:36.614 03:21:11 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_cvl_0_1 -a -s SPDK000cvl_0_1 00:20:36.614 03:21:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:36.614 03:21:11 -- common/autotest_common.sh@10 -- # set +x 00:20:36.614 03:21:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:36.614 03:21:11 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_cvl_0_1 cvl_0_1 00:20:36.614 03:21:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:36.614 03:21:11 -- common/autotest_common.sh@10 -- # set +x 00:20:36.614 03:21:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:36.614 03:21:11 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_cvl_0_1 -t rdma -a 192.168.100.9 -s 4420 00:20:36.614 03:21:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:36.614 03:21:11 -- common/autotest_common.sh@10 -- # set +x 00:20:36.614 [2024-04-25 03:21:11.026049] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:20:36.614 03:21:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:36.614 03:21:11 -- target/device_removal.sh@41 -- # return 0 00:20:36.614 03:21:11 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=cvl_0_1 00:20:36.614 03:21:11 -- target/device_removal.sh@53 -- # return 0 00:20:36.614 03:21:11 -- target/device_removal.sh@132 -- # generate_io_traffic_with_bdevperf cvl_0_0 cvl_0_1 00:20:36.614 03:21:11 -- target/device_removal.sh@87 -- # dev_names=('cvl_0_0' 'cvl_0_1') 00:20:36.614 03:21:11 -- target/device_removal.sh@87 -- # local dev_names 00:20:36.614 03:21:11 -- target/device_removal.sh@89 -- # mkdir -p /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:20:36.614 03:21:11 -- target/device_removal.sh@91 -- # bdevperf_pid=4140072 00:20:36.614 03:21:11 -- target/device_removal.sh@93 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; kill -9 $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:36.614 03:21:11 -- target/device_removal.sh@90 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 90 00:20:36.614 03:21:11 -- target/device_removal.sh@94 -- # waitforlisten 4140072 /var/tmp/bdevperf.sock 00:20:36.614 03:21:11 -- common/autotest_common.sh@817 -- # '[' -z 4140072 ']' 00:20:36.614 03:21:11 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:36.614 03:21:11 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:36.614 03:21:11 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:36.614 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:36.614 03:21:11 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:36.614 03:21:11 -- common/autotest_common.sh@10 -- # set +x 00:20:37.548 03:21:11 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:37.548 03:21:11 -- common/autotest_common.sh@850 -- # return 0 00:20:37.548 03:21:11 -- target/device_removal.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_set_options -r -1 00:20:37.548 03:21:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:37.548 03:21:11 -- common/autotest_common.sh@10 -- # set +x 00:20:37.548 03:21:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:37.548 03:21:11 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:20:37.548 03:21:11 -- target/device_removal.sh@101 -- # get_subsystem_nqn cvl_0_0 00:20:37.548 03:21:11 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_cvl_0_0 00:20:37.548 03:21:11 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_cvl_0_0 00:20:37.548 03:21:11 -- target/device_removal.sh@102 -- # get_ip_address cvl_0_0 00:20:37.548 03:21:11 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:20:37.548 03:21:11 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:20:37.548 03:21:11 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:37.548 03:21:11 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:37.548 03:21:11 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.8 00:20:37.548 03:21:11 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_cvl_0_0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_cvl_0_0 -l -1 -o 1 00:20:37.548 03:21:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:37.548 03:21:11 -- common/autotest_common.sh@10 -- # set +x 00:20:37.548 Nvme_cvl_0_0n1 00:20:37.548 03:21:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:37.548 03:21:11 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:20:37.548 03:21:12 -- target/device_removal.sh@101 -- # get_subsystem_nqn cvl_0_1 00:20:37.548 03:21:12 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_cvl_0_1 00:20:37.548 03:21:12 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_cvl_0_1 00:20:37.548 03:21:12 -- target/device_removal.sh@102 -- # get_ip_address cvl_0_1 00:20:37.548 03:21:12 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:20:37.548 03:21:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:20:37.548 03:21:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:37.548 03:21:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:37.548 03:21:12 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.9 00:20:37.548 03:21:12 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_cvl_0_1 -t rdma -a 192.168.100.9 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_cvl_0_1 -l -1 -o 1 00:20:37.548 03:21:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:37.548 03:21:12 -- common/autotest_common.sh@10 -- # set +x 00:20:37.806 Nvme_cvl_0_1n1 00:20:37.806 03:21:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:37.806 03:21:12 -- target/device_removal.sh@110 -- # bdevperf_rpc_pid=4140270 00:20:37.806 03:21:12 -- target/device_removal.sh@112 -- # sleep 5 00:20:37.806 03:21:12 -- target/device_removal.sh@109 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 120 -s /var/tmp/bdevperf.sock perform_tests 00:20:43.129 03:21:17 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:20:43.129 03:21:17 -- target/device_removal.sh@135 -- # nvme_dev=cvl_0_0 00:20:43.129 03:21:17 -- target/device_removal.sh@136 -- # get_rdma_device_name cvl_0_0 00:20:43.129 03:21:17 -- target/device_removal.sh@71 -- # dev_name=cvl_0_0 00:20:43.129 03:21:17 -- target/device_removal.sh@72 -- # get_pci_dir cvl_0_0 00:20:43.129 03:21:17 -- target/device_removal.sh@61 -- # dev_name=cvl_0_0 00:20:43.129 03:21:17 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:af:00.0/net/cvl_0_0/device 00:20:43.129 03:21:17 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:ae/0000:ae:02.0/0000:af:00.0/infiniband 00:20:43.129 03:21:17 -- target/device_removal.sh@136 -- # rdma_dev_name=rocep175s0f0 00:20:43.129 03:21:17 -- target/device_removal.sh@137 -- # get_ip_address cvl_0_0 00:20:43.129 03:21:17 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:20:43.129 03:21:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:43.129 03:21:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:20:43.129 03:21:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:43.129 03:21:17 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.8 00:20:43.129 03:21:17 -- target/device_removal.sh@138 -- # get_pci_dir cvl_0_0 00:20:43.129 03:21:17 -- target/device_removal.sh@61 -- # dev_name=cvl_0_0 00:20:43.129 03:21:17 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:af:00.0/net/cvl_0_0/device 00:20:43.129 03:21:17 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:ae/0000:ae:02.0/0000:af:00.0 00:20:43.129 03:21:17 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt rocep175s0f0 00:20:43.129 03:21:17 -- target/device_removal.sh@76 -- # local rdma_dev_name=rocep175s0f0 00:20:43.129 03:21:17 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:20:43.129 03:21:17 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:20:43.129 03:21:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:43.129 03:21:17 -- target/device_removal.sh@77 -- # grep rocep175s0f0 00:20:43.129 03:21:17 -- common/autotest_common.sh@10 -- # set +x 00:20:43.129 03:21:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:43.129 rocep175s0f0 00:20:43.129 03:21:17 -- target/device_removal.sh@78 -- # return 0 00:20:43.129 03:21:17 -- target/device_removal.sh@145 -- # remove_one_nic cvl_0_0 00:20:43.129 03:21:17 -- target/device_removal.sh@66 -- # dev_name=cvl_0_0 00:20:43.129 03:21:17 -- target/device_removal.sh@67 -- # echo 1 00:20:43.129 03:21:17 -- target/device_removal.sh@67 -- # get_pci_dir cvl_0_0 00:20:43.129 03:21:17 -- target/device_removal.sh@61 -- # dev_name=cvl_0_0 00:20:43.129 03:21:17 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:af:00.0/net/cvl_0_0/device 00:20:43.129 [2024-04-25 03:21:17.202499] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:20:43.129 [2024-04-25 03:21:17.203749] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:20:43.130 [2024-04-25 03:21:17.207382] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.8:4420 on device rocep175s0f0 is being removed. 00:20:43.695 03:21:17 -- target/device_removal.sh@147 -- # seq 1 10 00:20:43.695 03:21:17 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:20:43.695 03:21:17 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt rocep175s0f0 00:20:43.696 03:21:17 -- target/device_removal.sh@76 -- # local rdma_dev_name=rocep175s0f0 00:20:43.696 03:21:17 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:20:43.696 03:21:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:43.696 03:21:17 -- common/autotest_common.sh@10 -- # set +x 00:20:43.696 03:21:17 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:20:43.696 03:21:17 -- target/device_removal.sh@77 -- # grep rocep175s0f0 00:20:43.696 03:21:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:43.696 03:21:17 -- target/device_removal.sh@78 -- # return 1 00:20:43.696 03:21:17 -- target/device_removal.sh@149 -- # break 00:20:43.696 03:21:17 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:20:43.696 03:21:17 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:20:43.696 03:21:17 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:20:43.696 03:21:17 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:20:43.696 03:21:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:43.696 03:21:17 -- common/autotest_common.sh@10 -- # set +x 00:20:43.696 03:21:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:43.696 03:21:17 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:20:43.696 03:21:17 -- target/device_removal.sh@160 -- # rescan_pci 00:20:43.696 03:21:17 -- target/device_removal.sh@57 -- # echo 1 00:20:44.262 [2024-04-25 03:21:18.514908] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device irdma0(0xbdb940/0xbd2e80) succeed. 00:20:44.262 [2024-04-25 03:21:18.514979] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.8:4420 is still failed(-1) to listen. 00:20:44.520 03:21:18 -- target/device_removal.sh@162 -- # seq 1 10 00:20:44.520 03:21:18 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:20:44.520 03:21:18 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:ae/0000:ae:02.0/0000:af:00.0/net 00:20:44.520 03:21:18 -- target/device_removal.sh@163 -- # new_net_dev=cvl_0_0 00:20:44.520 03:21:18 -- target/device_removal.sh@164 -- # [[ -z cvl_0_0 ]] 00:20:44.520 03:21:18 -- target/device_removal.sh@166 -- # [[ cvl_0_0 != \c\v\l\_\0\_\0 ]] 00:20:44.520 03:21:18 -- target/device_removal.sh@171 -- # break 00:20:44.520 03:21:18 -- target/device_removal.sh@175 -- # [[ -z cvl_0_0 ]] 00:20:44.520 03:21:18 -- target/device_removal.sh@179 -- # ip link set cvl_0_0 up 00:20:44.520 03:21:18 -- target/device_removal.sh@180 -- # get_ip_address cvl_0_0 00:20:44.520 03:21:18 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:20:44.520 03:21:18 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:20:44.520 03:21:18 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:44.520 03:21:18 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:44.520 03:21:18 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:20:44.520 03:21:18 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.8/24 dev cvl_0_0 00:20:44.520 03:21:18 -- target/device_removal.sh@186 -- # seq 1 10 00:20:44.520 [2024-04-25 03:21:18.978758] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:20:44.520 [2024-04-25 03:21:18.978786] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.8:4420 come back 00:20:44.520 [2024-04-25 03:21:18.978796] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:20:44.520 03:21:18 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:20:44.520 03:21:18 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:20:44.520 03:21:18 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:20:44.520 03:21:18 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:20:44.520 03:21:18 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:20:44.520 03:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:44.520 03:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:44.520 03:21:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:44.779 03:21:19 -- target/device_removal.sh@187 -- # ib_count=2 00:20:44.779 03:21:19 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:20:44.779 03:21:19 -- target/device_removal.sh@189 -- # break 00:20:44.779 03:21:19 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:20:44.779 03:21:19 -- target/device_removal.sh@135 -- # nvme_dev=cvl_0_1 00:20:44.779 03:21:19 -- target/device_removal.sh@136 -- # get_rdma_device_name cvl_0_1 00:20:44.779 03:21:19 -- target/device_removal.sh@71 -- # dev_name=cvl_0_1 00:20:44.779 03:21:19 -- target/device_removal.sh@72 -- # get_pci_dir cvl_0_1 00:20:44.779 03:21:19 -- target/device_removal.sh@61 -- # dev_name=cvl_0_1 00:20:44.779 03:21:19 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:af:00.1/net/cvl_0_1/device 00:20:44.779 03:21:19 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:ae/0000:ae:02.0/0000:af:00.1/infiniband 00:20:44.779 03:21:19 -- target/device_removal.sh@136 -- # rdma_dev_name=rocep175s0f1 00:20:44.779 03:21:19 -- target/device_removal.sh@137 -- # get_ip_address cvl_0_1 00:20:44.779 03:21:19 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:20:44.779 03:21:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:44.779 03:21:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:20:44.780 03:21:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:44.780 03:21:19 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.9 00:20:44.780 03:21:19 -- target/device_removal.sh@138 -- # get_pci_dir cvl_0_1 00:20:44.780 03:21:19 -- target/device_removal.sh@61 -- # dev_name=cvl_0_1 00:20:44.780 03:21:19 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:af:00.1/net/cvl_0_1/device 00:20:44.780 03:21:19 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:ae/0000:ae:02.0/0000:af:00.1 00:20:44.780 03:21:19 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt rocep175s0f1 00:20:44.780 03:21:19 -- target/device_removal.sh@76 -- # local rdma_dev_name=rocep175s0f1 00:20:44.780 03:21:19 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:20:44.780 03:21:19 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:20:44.780 03:21:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:44.780 03:21:19 -- target/device_removal.sh@77 -- # grep rocep175s0f1 00:20:44.780 03:21:19 -- common/autotest_common.sh@10 -- # set +x 00:20:44.780 03:21:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:44.780 rocep175s0f1 00:20:44.780 03:21:19 -- target/device_removal.sh@78 -- # return 0 00:20:44.780 03:21:19 -- target/device_removal.sh@145 -- # remove_one_nic cvl_0_1 00:20:44.780 03:21:19 -- target/device_removal.sh@66 -- # dev_name=cvl_0_1 00:20:44.780 03:21:19 -- target/device_removal.sh@67 -- # echo 1 00:20:44.780 03:21:19 -- target/device_removal.sh@67 -- # get_pci_dir cvl_0_1 00:20:44.780 03:21:19 -- target/device_removal.sh@61 -- # dev_name=cvl_0_1 00:20:44.780 03:21:19 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:af:00.1/net/cvl_0_1/device 00:20:44.780 [2024-04-25 03:21:19.122903] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.9:4420 on device rocep175s0f1 is being removed. 00:20:44.780 [2024-04-25 03:21:19.123134] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno No such device or address (6) 00:20:44.780 [2024-04-25 03:21:19.124729] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno No such device or address (6) 00:20:44.780 [2024-04-25 03:21:19.124740] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 100 00:20:44.780 [2024-04-25 03:21:19.124746] rdma.c: 632:nvmf_rdma_dump_qpair_contents: *ERROR*: Dumping contents of queue pair (QID 1) 00:20:44.780 [2024-04-25 03:21:19.124752] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.124757] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.124762] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.124767] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.124773] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.124779] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.124784] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.124789] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.124795] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.124800] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.124805] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.124809] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.124814] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.124819] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.124824] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.124829] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.124834] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.124838] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.124844] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.124850] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.124859] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.124868] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.124873] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.124878] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.124883] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.124888] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.124894] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.124899] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.124904] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.124908] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.124914] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.124920] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.124925] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.124930] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.124937] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.124942] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.124947] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.124951] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.124966] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.124971] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.124976] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.124981] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.124986] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.124990] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.124997] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.125002] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.125008] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.125012] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.125017] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.125022] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.125028] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.125033] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.125038] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.125043] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.125048] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.125053] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.125058] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.125063] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.125068] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.125073] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.125079] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.125085] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.125091] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.125098] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.125102] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.125107] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.125112] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.125117] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.125122] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.125126] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.125131] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.125136] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.125142] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.125147] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.125151] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.125156] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.125161] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.125165] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.125171] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.125175] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.125180] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.125185] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.125190] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.125195] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.125200] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.125205] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.125210] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.125215] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.125219] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.125225] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.125229] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.125234] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.780 [2024-04-25 03:21:19.125239] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.780 [2024-04-25 03:21:19.125244] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125250] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125254] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125259] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125264] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125269] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125274] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125279] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125284] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125288] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125293] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125300] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125306] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125311] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125316] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125321] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125326] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125330] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125335] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125340] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125345] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125350] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125354] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125360] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125365] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125370] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125375] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125382] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125387] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125392] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125397] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125401] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125406] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125411] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125416] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125421] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125426] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125431] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125436] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125440] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125445] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125451] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125456] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125461] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125465] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125471] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125476] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125480] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125486] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125492] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125497] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125501] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125507] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125514] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125519] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125524] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125529] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125533] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125538] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125543] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125548] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125553] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125558] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125564] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125569] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125574] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125579] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125584] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125588] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125594] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125599] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125604] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125609] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125613] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125619] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125624] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125629] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125634] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125638] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125643] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125649] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125654] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125658] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125664] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125668] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125673] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125678] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125683] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125688] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125694] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125704] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125709] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125714] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125719] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125724] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125731] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125737] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125742] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125747] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125752] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125758] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125764] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125770] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125775] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125781] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:44.781 [2024-04-25 03:21:19.125786] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:20:44.781 [2024-04-25 03:21:19.125792] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:20:45.347 03:21:19 -- target/device_removal.sh@147 -- # seq 1 10 00:20:45.347 03:21:19 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:20:45.347 03:21:19 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt rocep175s0f1 00:20:45.347 03:21:19 -- target/device_removal.sh@76 -- # local rdma_dev_name=rocep175s0f1 00:20:45.347 03:21:19 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:20:45.347 03:21:19 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:20:45.347 03:21:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:45.347 03:21:19 -- common/autotest_common.sh@10 -- # set +x 00:20:45.347 03:21:19 -- target/device_removal.sh@77 -- # grep rocep175s0f1 00:20:45.347 03:21:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:45.347 03:21:19 -- target/device_removal.sh@78 -- # return 1 00:20:45.347 03:21:19 -- target/device_removal.sh@149 -- # break 00:20:45.347 03:21:19 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:20:45.347 03:21:19 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:20:45.347 03:21:19 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:20:45.347 03:21:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:45.347 03:21:19 -- common/autotest_common.sh@10 -- # set +x 00:20:45.347 03:21:19 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:20:45.347 03:21:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:45.347 03:21:19 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:20:45.347 03:21:19 -- target/device_removal.sh@160 -- # rescan_pci 00:20:45.347 03:21:19 -- target/device_removal.sh@57 -- # echo 1 00:20:45.913 [2024-04-25 03:21:20.338914] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device irdma0(0xbd32c0/0xce5740) succeed. 00:20:45.913 [2024-04-25 03:21:20.338965] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.9:4420 is still failed(-1) to listen. 00:20:45.913 [2024-04-25 03:21:20.338980] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: port active 00:20:46.479 03:21:20 -- target/device_removal.sh@162 -- # seq 1 10 00:20:46.479 03:21:20 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:20:46.479 03:21:20 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:ae/0000:ae:02.0/0000:af:00.1/net 00:20:46.479 03:21:20 -- target/device_removal.sh@163 -- # new_net_dev=cvl_0_1 00:20:46.479 03:21:20 -- target/device_removal.sh@164 -- # [[ -z cvl_0_1 ]] 00:20:46.479 03:21:20 -- target/device_removal.sh@166 -- # [[ cvl_0_1 != \c\v\l\_\0\_\1 ]] 00:20:46.479 03:21:20 -- target/device_removal.sh@171 -- # break 00:20:46.479 03:21:20 -- target/device_removal.sh@175 -- # [[ -z cvl_0_1 ]] 00:20:46.479 03:21:20 -- target/device_removal.sh@179 -- # ip link set cvl_0_1 up 00:20:46.479 03:21:20 -- target/device_removal.sh@180 -- # get_ip_address cvl_0_1 00:20:46.479 03:21:20 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:20:46.479 03:21:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:20:46.479 03:21:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:46.479 03:21:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:46.479 03:21:20 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:20:46.479 03:21:20 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.9/24 dev cvl_0_1 00:20:46.479 03:21:20 -- target/device_removal.sh@186 -- # seq 1 10 00:20:46.479 03:21:20 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:20:46.479 03:21:20 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:20:46.479 03:21:20 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:20:46.479 [2024-04-25 03:21:20.780544] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:20:46.479 [2024-04-25 03:21:20.780569] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.9:4420 come back 00:20:46.479 [2024-04-25 03:21:20.780578] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:20:46.479 03:21:20 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:20:46.479 03:21:20 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:20:46.479 03:21:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:46.479 03:21:20 -- common/autotest_common.sh@10 -- # set +x 00:20:46.479 03:21:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:46.479 03:21:20 -- target/device_removal.sh@187 -- # ib_count=2 00:20:46.479 03:21:20 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:20:46.479 03:21:20 -- target/device_removal.sh@189 -- # break 00:20:46.479 03:21:20 -- target/device_removal.sh@200 -- # stop_bdevperf 00:20:46.479 03:21:20 -- target/device_removal.sh@116 -- # wait 4140270 00:22:22.921 0 00:22:22.921 03:22:42 -- target/device_removal.sh@118 -- # killprocess 4140072 00:22:22.921 03:22:42 -- common/autotest_common.sh@936 -- # '[' -z 4140072 ']' 00:22:22.921 03:22:42 -- common/autotest_common.sh@940 -- # kill -0 4140072 00:22:22.921 03:22:42 -- common/autotest_common.sh@941 -- # uname 00:22:22.921 03:22:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:22.921 03:22:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4140072 00:22:22.921 03:22:42 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:22:22.921 03:22:42 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:22:22.921 03:22:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4140072' 00:22:22.921 killing process with pid 4140072 00:22:22.921 03:22:42 -- common/autotest_common.sh@955 -- # kill 4140072 00:22:22.921 03:22:42 -- common/autotest_common.sh@960 -- # wait 4140072 00:22:22.921 03:22:42 -- target/device_removal.sh@119 -- # bdevperf_pid= 00:22:22.921 03:22:42 -- target/device_removal.sh@121 -- # cat /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/try.txt 00:22:22.921 [2024-04-25 03:21:11.077571] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:22:22.922 [2024-04-25 03:21:11.077616] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4140072 ] 00:22:22.922 EAL: No free 2048 kB hugepages reported on node 1 00:22:22.922 [2024-04-25 03:21:11.131136] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:22.922 [2024-04-25 03:21:11.206263] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:22.922 Running I/O for 90 seconds... 00:22:22.922 [2024-04-25 03:21:17.202679] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:22:22.922 [2024-04-25 03:21:17.202712] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.922 [2024-04-25 03:21:17.202722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32538 cdw0:16 sqhd:f3b9 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.202731] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.922 [2024-04-25 03:21:17.202738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32538 cdw0:16 sqhd:f3b9 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.202745] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.922 [2024-04-25 03:21:17.202751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32538 cdw0:16 sqhd:f3b9 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.202757] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.922 [2024-04-25 03:21:17.202764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32538 cdw0:16 sqhd:f3b9 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.203134] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:22:22.922 [2024-04-25 03:21:17.203145] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_0] in failed state. 00:22:22.922 [2024-04-25 03:21:17.203170] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:22:22.922 [2024-04-25 03:21:17.206531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:209072 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772c000 len:0x1000 key:0x53ab9d41 00:22:22.922 [2024-04-25 03:21:17.206552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.206564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:209080 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772e000 len:0x1000 key:0x53ab9d41 00:22:22.922 [2024-04-25 03:21:17.206572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.206583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:209088 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007730000 len:0x1000 key:0x53ab9d41 00:22:22.922 [2024-04-25 03:21:17.206589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.206598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:209096 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007732000 len:0x1000 key:0x53ab9d41 00:22:22.922 [2024-04-25 03:21:17.206604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.206612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:209104 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007734000 len:0x1000 key:0x53ab9d41 00:22:22.922 [2024-04-25 03:21:17.206624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.206632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:209112 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007736000 len:0x1000 key:0x53ab9d41 00:22:22.922 [2024-04-25 03:21:17.206639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.206648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:209120 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007738000 len:0x1000 key:0x53ab9d41 00:22:22.922 [2024-04-25 03:21:17.206655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.206662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:209128 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773a000 len:0x1000 key:0x53ab9d41 00:22:22.922 [2024-04-25 03:21:17.206669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.206676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:209136 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773c000 len:0x1000 key:0x53ab9d41 00:22:22.922 [2024-04-25 03:21:17.206682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.206690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:209144 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773e000 len:0x1000 key:0x53ab9d41 00:22:22.922 [2024-04-25 03:21:17.206697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.206705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:209152 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007740000 len:0x1000 key:0x53ab9d41 00:22:22.922 [2024-04-25 03:21:17.206712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.206719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:209160 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007742000 len:0x1000 key:0x53ab9d41 00:22:22.922 [2024-04-25 03:21:17.206726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.206733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:209168 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007744000 len:0x1000 key:0x53ab9d41 00:22:22.922 [2024-04-25 03:21:17.206741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.206749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:209176 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007746000 len:0x1000 key:0x53ab9d41 00:22:22.922 [2024-04-25 03:21:17.206756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.206763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:209184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007748000 len:0x1000 key:0x53ab9d41 00:22:22.922 [2024-04-25 03:21:17.206770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.206778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:209192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000774a000 len:0x1000 key:0x53ab9d41 00:22:22.922 [2024-04-25 03:21:17.206786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.206794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:209200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000774c000 len:0x1000 key:0x53ab9d41 00:22:22.922 [2024-04-25 03:21:17.206800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.206808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:209208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000774e000 len:0x1000 key:0x53ab9d41 00:22:22.922 [2024-04-25 03:21:17.206815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.206823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:209216 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007750000 len:0x1000 key:0x53ab9d41 00:22:22.922 [2024-04-25 03:21:17.206830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.206838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:209224 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007752000 len:0x1000 key:0x53ab9d41 00:22:22.922 [2024-04-25 03:21:17.206844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.206852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:209232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007754000 len:0x1000 key:0x53ab9d41 00:22:22.922 [2024-04-25 03:21:17.206865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.206873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:209240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007756000 len:0x1000 key:0x53ab9d41 00:22:22.922 [2024-04-25 03:21:17.206880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.206888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:209248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007758000 len:0x1000 key:0x53ab9d41 00:22:22.922 [2024-04-25 03:21:17.206895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.206904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:209256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000775a000 len:0x1000 key:0x53ab9d41 00:22:22.922 [2024-04-25 03:21:17.206911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.206919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:209264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000775c000 len:0x1000 key:0x53ab9d41 00:22:22.922 [2024-04-25 03:21:17.206926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.206934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:209272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000775e000 len:0x1000 key:0x53ab9d41 00:22:22.922 [2024-04-25 03:21:17.206940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.206948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:209280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007760000 len:0x1000 key:0x53ab9d41 00:22:22.922 [2024-04-25 03:21:17.206954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.922 [2024-04-25 03:21:17.206963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:209288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007762000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.206970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.206977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:209296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007764000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.206985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.206993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:209304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007766000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.206999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:209312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007768000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:209320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000776a000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:209328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000776c000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:209336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000776e000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:209344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007770000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:209352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007772000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:209360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007774000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:209368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007776000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:209376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007778000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:209384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000777a000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:209392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000777c000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:209400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000777e000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:209408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007780000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:209416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007782000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:209424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007784000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:209432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007786000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:209440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007788000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:209448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000778a000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:209456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000778c000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:209464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000778e000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:209472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007790000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:209480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007792000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:209488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007794000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:209496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007796000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:209504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007798000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:209512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000779a000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:209520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000779c000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:209528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000779e000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:209536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a0000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:209544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a2000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:209552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a4000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.923 [2024-04-25 03:21:17.207464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:209560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a6000 len:0x1000 key:0x53ab9d41 00:22:22.923 [2024-04-25 03:21:17.207471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:209568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a8000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:209576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077aa000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:209584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ac000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:209592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ae000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:209600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b0000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:209608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b2000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:209616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b4000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:209624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b6000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:209632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b8000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:209640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ba000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:209648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077bc000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:209656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077be000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:209664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c0000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:209672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c2000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:209680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c4000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:209688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c6000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:209696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c8000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:209704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ca000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:209712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077cc000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:209720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ce000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:209728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d0000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:209736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d2000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:209744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d4000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:209752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d6000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:209760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d8000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:209768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077da000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:209776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077dc000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:209784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077de000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:209792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e0000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:209800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e2000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:209808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e4000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:209816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e6000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:209824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e8000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:209832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ea000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.207987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:209840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ec000 len:0x1000 key:0x53ab9d41 00:22:22.924 [2024-04-25 03:21:17.207993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.924 [2024-04-25 03:21:17.208001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:209848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ee000 len:0x1000 key:0x53ab9d41 00:22:22.925 [2024-04-25 03:21:17.208008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:209856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f0000 len:0x1000 key:0x53ab9d41 00:22:22.925 [2024-04-25 03:21:17.208022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:209864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f2000 len:0x1000 key:0x53ab9d41 00:22:22.925 [2024-04-25 03:21:17.208036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:209872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f4000 len:0x1000 key:0x53ab9d41 00:22:22.925 [2024-04-25 03:21:17.208051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:209880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f6000 len:0x1000 key:0x53ab9d41 00:22:22.925 [2024-04-25 03:21:17.208066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:209888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f8000 len:0x1000 key:0x53ab9d41 00:22:22.925 [2024-04-25 03:21:17.208080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:209896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077fa000 len:0x1000 key:0x53ab9d41 00:22:22.925 [2024-04-25 03:21:17.208094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:209904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077fc000 len:0x1000 key:0x53ab9d41 00:22:22.925 [2024-04-25 03:21:17.208110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:209912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077fe000 len:0x1000 key:0x53ab9d41 00:22:22.925 [2024-04-25 03:21:17.208124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:209920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.925 [2024-04-25 03:21:17.208138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:209928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.925 [2024-04-25 03:21:17.208153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:209936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.925 [2024-04-25 03:21:17.208167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:209944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.925 [2024-04-25 03:21:17.208180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:209952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.925 [2024-04-25 03:21:17.208195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:209960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.925 [2024-04-25 03:21:17.208209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:209968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.925 [2024-04-25 03:21:17.208222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:209976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.925 [2024-04-25 03:21:17.208238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:209984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.925 [2024-04-25 03:21:17.208252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:209992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.925 [2024-04-25 03:21:17.208265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:210000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.925 [2024-04-25 03:21:17.208279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:210008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.925 [2024-04-25 03:21:17.208296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:210016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.925 [2024-04-25 03:21:17.208310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:210024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.925 [2024-04-25 03:21:17.208323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:210032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.925 [2024-04-25 03:21:17.208337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:210040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.925 [2024-04-25 03:21:17.208351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:210048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.925 [2024-04-25 03:21:17.208364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:210056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.925 [2024-04-25 03:21:17.208378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:210064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.925 [2024-04-25 03:21:17.208392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:210072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.925 [2024-04-25 03:21:17.208405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.208414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:210080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.925 [2024-04-25 03:21:17.208420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.221162] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:22:22.925 [2024-04-25 03:21:17.221174] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:22:22.925 [2024-04-25 03:21:17.221180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:210088 len:8 PRP1 0x0 PRP2 0x0 00:22:22.925 [2024-04-25 03:21:17.221187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.925 [2024-04-25 03:21:17.223044] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_0] resetting controller 00:22:22.925 [2024-04-25 03:21:17.223352] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:22:22.925 [2024-04-25 03:21:17.223365] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:22:22.925 [2024-04-25 03:21:17.223370] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:22:22.925 [2024-04-25 03:21:17.223383] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:22:22.925 [2024-04-25 03:21:17.223389] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_0] in failed state. 00:22:22.925 [2024-04-25 03:21:17.223399] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_0] Ctrlr is in error state 00:22:22.925 [2024-04-25 03:21:17.223405] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_0] controller reinitialization failed 00:22:22.925 [2024-04-25 03:21:17.223412] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_0] already in failed state 00:22:22.925 [2024-04-25 03:21:17.223428] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.925 [2024-04-25 03:21:17.223435] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_0] resetting controller 00:22:22.925 [2024-04-25 03:21:19.124295] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno No such device or address (6) 00:22:22.926 [2024-04-25 03:21:19.124326] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.926 [2024-04-25 03:21:19.124336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32538 cdw0:6 sqhd:f3b9 p:0 m:0 dnr:0 00:22:22.926 [2024-04-25 03:21:19.124345] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.926 [2024-04-25 03:21:19.124351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32538 cdw0:6 sqhd:f3b9 p:0 m:0 dnr:0 00:22:22.926 [2024-04-25 03:21:19.124358] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.926 [2024-04-25 03:21:19.124366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32538 cdw0:6 sqhd:f3b9 p:0 m:0 dnr:0 00:22:22.926 [2024-04-25 03:21:19.124373] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.926 [2024-04-25 03:21:19.124379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32538 cdw0:6 sqhd:f3b9 p:0 m:0 dnr:0 00:22:22.926 [2024-04-25 03:21:19.124692] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:22:22.926 [2024-04-25 03:21:19.124706] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_1] in failed state. 00:22:22.926 [2024-04-25 03:21:19.124841] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno No such device or address (6) 00:22:22.926 [2024-04-25 03:21:19.125727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:222312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079e4000 len:0x1000 key:0xaf284f59 00:22:22.926 [2024-04-25 03:21:19.125738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.926 [2024-04-25 03:21:19.125751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:222320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079e2000 len:0x1000 key:0xaf284f59 00:22:22.926 [2024-04-25 03:21:19.125759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.926 [2024-04-25 03:21:19.125772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:222328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079e0000 len:0x1000 key:0xaf284f59 00:22:22.926 [2024-04-25 03:21:19.125779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.926 [2024-04-25 03:21:19.125789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:222336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079de000 len:0x1000 key:0xaf284f59 00:22:22.926 [2024-04-25 03:21:19.125797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.926 [2024-04-25 03:21:19.125806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:222344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079dc000 len:0x1000 key:0xaf284f59 00:22:22.926 [2024-04-25 03:21:19.125812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.926 [2024-04-25 03:21:19.125820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:222352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079da000 len:0x1000 key:0xaf284f59 00:22:22.926 [2024-04-25 03:21:19.125826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.926 [2024-04-25 03:21:19.125834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:222360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d8000 len:0x1000 key:0xaf284f59 00:22:22.926 [2024-04-25 03:21:19.125841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.926 [2024-04-25 03:21:19.125849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:222368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d6000 len:0x1000 key:0xaf284f59 00:22:22.926 [2024-04-25 03:21:19.125861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.926 [2024-04-25 03:21:19.125869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:222376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d4000 len:0x1000 key:0xaf284f59 00:22:22.926 [2024-04-25 03:21:19.125875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.926 [2024-04-25 03:21:19.125883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:222384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d2000 len:0x1000 key:0xaf284f59 00:22:22.926 [2024-04-25 03:21:19.125889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.926 [2024-04-25 03:21:19.125897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:222392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d0000 len:0x1000 key:0xaf284f59 00:22:22.926 [2024-04-25 03:21:19.125903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.926 [2024-04-25 03:21:19.125911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:222400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ce000 len:0x1000 key:0xaf284f59 00:22:22.926 [2024-04-25 03:21:19.125918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.926 [2024-04-25 03:21:19.125926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:222408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079cc000 len:0x1000 key:0xaf284f59 00:22:22.926 [2024-04-25 03:21:19.125932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.926 [2024-04-25 03:21:19.125940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:222416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ca000 len:0x1000 key:0xaf284f59 00:22:22.926 [2024-04-25 03:21:19.125948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.926 [2024-04-25 03:21:19.125956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:222424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079c8000 len:0x1000 key:0xaf284f59 00:22:22.926 [2024-04-25 03:21:19.125962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.926 [2024-04-25 03:21:19.125970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:222432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079c6000 len:0x1000 key:0xaf284f59 00:22:22.926 [2024-04-25 03:21:19.125977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.926 [2024-04-25 03:21:19.125985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:222440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079c4000 len:0x1000 key:0xaf284f59 00:22:22.926 [2024-04-25 03:21:19.125991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.926 [2024-04-25 03:21:19.125999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:222448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079c2000 len:0x1000 key:0xaf284f59 00:22:22.926 [2024-04-25 03:21:19.126005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.926 [2024-04-25 03:21:19.126013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:222456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079c0000 len:0x1000 key:0xaf284f59 00:22:22.926 [2024-04-25 03:21:19.126020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.926 [2024-04-25 03:21:19.126028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:222464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079be000 len:0x1000 key:0xaf284f59 00:22:22.926 [2024-04-25 03:21:19.126034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.926 [2024-04-25 03:21:19.126041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:222472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079bc000 len:0x1000 key:0xaf284f59 00:22:22.926 [2024-04-25 03:21:19.126048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.926 [2024-04-25 03:21:19.126056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:222480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ba000 len:0x1000 key:0xaf284f59 00:22:22.926 [2024-04-25 03:21:19.126063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.926 [2024-04-25 03:21:19.126072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:222488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b8000 len:0x1000 key:0xaf284f59 00:22:22.926 [2024-04-25 03:21:19.126078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:222496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b6000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:222504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b4000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:222512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b2000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:222520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b0000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:222528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ae000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:222536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ac000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:222544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079aa000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:222552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a8000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:222560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a6000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:222568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a4000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:222576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a2000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:222584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a0000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:222592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000799e000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:222600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000799c000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:222608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000799a000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:222616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007998000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:222624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007996000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:222632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007994000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:222640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007992000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:222648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007990000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:222656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000798e000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:222664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000798c000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:222672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000798a000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:222680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007988000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:222688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007986000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:222696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007984000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:222704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007982000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:222712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007980000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:222720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000797e000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:222728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000797c000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:222736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000797a000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:222744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007978000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:222752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007976000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:222760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007974000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:222768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007972000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.927 [2024-04-25 03:21:19.126602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:222776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007970000 len:0x1000 key:0xaf284f59 00:22:22.927 [2024-04-25 03:21:19.126608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.126616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:222784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000796e000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.126622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.126630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:222792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000796c000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.126636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.126644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:222800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000796a000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.126650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.126658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:222808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007968000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.126664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.126672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:222816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007966000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.126679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.126687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:222824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007964000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.126693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.126705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:222832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007962000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.126712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.126719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:222840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007960000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.126726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.126733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:222848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000795e000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.126739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.126747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:222856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000795c000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.126753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.126762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:222864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000795a000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.126768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.126776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:222872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007958000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.126782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.126790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:222880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007956000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.126796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.126804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:222888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007954000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.126810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.126818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:222896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007952000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.126824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.126832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:222904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007950000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.126838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.126845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:222912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000794e000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.126852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.126864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:222920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000794c000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.126871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.126878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:222928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000794a000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.126887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.126895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:222936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007948000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.126901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.126909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:222944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007946000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.126915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.126924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:222952 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007944000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.126930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.126939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:222960 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007942000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.126946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.126954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:222968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007940000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.126962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.126970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:222976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000793e000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.126976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.126984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:222984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000793c000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.126990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.126998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:222992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000793a000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.127004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.127012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:223000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007938000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.127018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.127026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:223008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007936000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.127032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.127040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:223016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007934000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.127046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.127054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:223024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007932000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.127061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.127068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:223032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007930000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.127075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.127084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:223040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000792e000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.127090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.127098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:223048 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000792c000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.127104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.127112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:223056 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000792a000 len:0x1000 key:0xaf284f59 00:22:22.928 [2024-04-25 03:21:19.127118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.928 [2024-04-25 03:21:19.127126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:223064 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007928000 len:0x1000 key:0xaf284f59 00:22:22.929 [2024-04-25 03:21:19.127132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.127140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:223072 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007926000 len:0x1000 key:0xaf284f59 00:22:22.929 [2024-04-25 03:21:19.127146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.127155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:223080 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007924000 len:0x1000 key:0xaf284f59 00:22:22.929 [2024-04-25 03:21:19.127161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.127169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:223088 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007922000 len:0x1000 key:0xaf284f59 00:22:22.929 [2024-04-25 03:21:19.127177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.127184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:223096 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007920000 len:0x1000 key:0xaf284f59 00:22:22.929 [2024-04-25 03:21:19.127190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.127198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:223104 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000791e000 len:0x1000 key:0xaf284f59 00:22:22.929 [2024-04-25 03:21:19.127206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.127214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:223112 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000791c000 len:0x1000 key:0xaf284f59 00:22:22.929 [2024-04-25 03:21:19.127220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.127227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:223120 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000791a000 len:0x1000 key:0xaf284f59 00:22:22.929 [2024-04-25 03:21:19.127234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.127241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:223128 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007918000 len:0x1000 key:0xaf284f59 00:22:22.929 [2024-04-25 03:21:19.127249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.127257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:223136 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007916000 len:0x1000 key:0xaf284f59 00:22:22.929 [2024-04-25 03:21:19.127263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.127271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:223144 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007914000 len:0x1000 key:0xaf284f59 00:22:22.929 [2024-04-25 03:21:19.141992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.142003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:223152 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007912000 len:0x1000 key:0xaf284f59 00:22:22.929 [2024-04-25 03:21:19.142010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.142019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:223160 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007910000 len:0x1000 key:0xaf284f59 00:22:22.929 [2024-04-25 03:21:19.142026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.142034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:223168 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000790e000 len:0x1000 key:0xaf284f59 00:22:22.929 [2024-04-25 03:21:19.142041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.142048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:223176 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000790c000 len:0x1000 key:0xaf284f59 00:22:22.929 [2024-04-25 03:21:19.142055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.142063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:223184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000790a000 len:0x1000 key:0xaf284f59 00:22:22.929 [2024-04-25 03:21:19.142069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.142077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:223192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007908000 len:0x1000 key:0xaf284f59 00:22:22.929 [2024-04-25 03:21:19.142083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.142091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:223200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007906000 len:0x1000 key:0xaf284f59 00:22:22.929 [2024-04-25 03:21:19.142098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.142105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:223208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007904000 len:0x1000 key:0xaf284f59 00:22:22.929 [2024-04-25 03:21:19.142112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.142120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:223216 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007902000 len:0x1000 key:0xaf284f59 00:22:22.929 [2024-04-25 03:21:19.142128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.142137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:223224 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007900000 len:0x1000 key:0xaf284f59 00:22:22.929 [2024-04-25 03:21:19.142143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.142151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:223232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.929 [2024-04-25 03:21:19.142157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.142165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:223240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.929 [2024-04-25 03:21:19.142172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.142180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:223248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.929 [2024-04-25 03:21:19.142186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.142194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:223256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.929 [2024-04-25 03:21:19.142200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.142207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:223264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.929 [2024-04-25 03:21:19.142213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.142220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:223272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.929 [2024-04-25 03:21:19.142227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.142234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:223280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.929 [2024-04-25 03:21:19.142241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.142248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:223288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.929 [2024-04-25 03:21:19.142254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.142261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:223296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.929 [2024-04-25 03:21:19.142267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.142275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:223304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.929 [2024-04-25 03:21:19.142281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.142288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:223312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.929 [2024-04-25 03:21:19.142296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.142303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:223320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:22.929 [2024-04-25 03:21:19.142309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32538 cdw0:ad199f20 sqhd:b530 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.155024] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:22:22.929 [2024-04-25 03:21:19.155036] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:22:22.929 [2024-04-25 03:21:19.155042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:223328 len:8 PRP1 0x0 PRP2 0x0 00:22:22.929 [2024-04-25 03:21:19.155048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.929 [2024-04-25 03:21:19.155090] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_1] resetting controller 00:22:22.929 [2024-04-25 03:21:19.155388] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:22:22.929 [2024-04-25 03:21:19.155398] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:22:22.929 [2024-04-25 03:21:19.155404] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:22:22.929 [2024-04-25 03:21:19.155416] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:22:22.929 [2024-04-25 03:21:19.155422] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_1] in failed state. 00:22:22.930 [2024-04-25 03:21:19.155433] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_1] Ctrlr is in error state 00:22:22.930 [2024-04-25 03:21:19.155440] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_1] controller reinitialization failed 00:22:22.930 [2024-04-25 03:21:19.155446] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_1] already in failed state 00:22:22.930 [2024-04-25 03:21:19.155464] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.930 [2024-04-25 03:21:19.155471] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_1] resetting controller 00:22:22.930 [2024-04-25 03:21:19.228456] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:22:22.930 [2024-04-25 03:21:19.228466] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:22:22.930 [2024-04-25 03:21:19.228479] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:22:22.930 [2024-04-25 03:21:19.228485] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_0] in failed state. 00:22:22.930 [2024-04-25 03:21:19.228511] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_0] Ctrlr is in error state 00:22:22.930 [2024-04-25 03:21:19.228517] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_0] controller reinitialization failed 00:22:22.930 [2024-04-25 03:21:19.228523] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_0] already in failed state 00:22:22.930 [2024-04-25 03:21:19.228536] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.930 [2024-04-25 03:21:19.228542] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_0] resetting controller 00:22:22.930 [2024-04-25 03:21:20.285025] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:22:22.930 [2024-04-25 03:21:21.160507] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:22:22.930 [2024-04-25 03:21:21.160535] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:22:22.930 [2024-04-25 03:21:21.160575] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:22:22.930 [2024-04-25 03:21:21.160583] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_1] in failed state. 00:22:22.930 [2024-04-25 03:21:21.160594] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_1] Ctrlr is in error state 00:22:22.930 [2024-04-25 03:21:21.160600] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_1] controller reinitialization failed 00:22:22.930 [2024-04-25 03:21:21.160608] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_1] already in failed state 00:22:22.930 [2024-04-25 03:21:21.160624] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.930 [2024-04-25 03:21:21.160632] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_1] resetting controller 00:22:22.930 [2024-04-25 03:21:22.217640] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:22:22.930 00:22:22.930 Latency(us) 00:22:22.930 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:22.930 Job: Nvme_cvl_0_0n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:22:22.930 Verification LBA range: start 0x0 length 0x8000 00:22:22.930 Nvme_cvl_0_0n1 : 90.01 11503.84 44.94 0.00 0.00 11106.96 2090.91 4042510.14 00:22:22.930 Job: Nvme_cvl_0_1n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:22:22.930 Verification LBA range: start 0x0 length 0x8000 00:22:22.930 Nvme_cvl_0_1n1 : 90.01 11428.93 44.64 0.00 0.00 11179.67 2309.36 4058488.44 00:22:22.930 =================================================================================================================== 00:22:22.930 Total : 22932.77 89.58 0.00 0.00 11143.19 2090.91 4058488.44 00:22:22.930 Received shutdown signal, test time was about 90.000000 seconds 00:22:22.930 00:22:22.930 Latency(us) 00:22:22.930 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:22.930 =================================================================================================================== 00:22:22.930 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:22:22.930 03:22:42 -- target/device_removal.sh@123 -- # trap - SIGINT SIGTERM EXIT 00:22:22.930 03:22:42 -- target/device_removal.sh@124 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/try.txt 00:22:22.930 03:22:42 -- target/device_removal.sh@202 -- # killprocess 4139812 00:22:22.930 03:22:42 -- common/autotest_common.sh@936 -- # '[' -z 4139812 ']' 00:22:22.930 03:22:42 -- common/autotest_common.sh@940 -- # kill -0 4139812 00:22:22.930 03:22:42 -- common/autotest_common.sh@941 -- # uname 00:22:22.930 03:22:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:22.930 03:22:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4139812 00:22:22.930 03:22:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:22.930 03:22:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:22.930 03:22:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4139812' 00:22:22.930 killing process with pid 4139812 00:22:22.930 03:22:42 -- common/autotest_common.sh@955 -- # kill 4139812 00:22:22.930 03:22:42 -- common/autotest_common.sh@960 -- # wait 4139812 00:22:22.930 [2024-04-25 03:22:42.797128] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:22:22.930 03:22:43 -- target/device_removal.sh@203 -- # nvmfpid= 00:22:22.930 03:22:43 -- target/device_removal.sh@205 -- # return 0 00:22:22.930 00:22:22.930 real 1m33.159s 00:22:22.930 user 4m37.222s 00:22:22.930 sys 0m1.666s 00:22:22.930 03:22:43 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:22:22.930 03:22:43 -- common/autotest_common.sh@10 -- # set +x 00:22:22.930 ************************************ 00:22:22.930 END TEST nvmf_device_removal_pci_remove_no_srq 00:22:22.930 ************************************ 00:22:22.930 03:22:43 -- target/device_removal.sh@312 -- # run_test nvmf_device_removal_pci_remove test_remove_and_rescan 00:22:22.930 03:22:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:22.930 03:22:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:22.930 03:22:43 -- common/autotest_common.sh@10 -- # set +x 00:22:22.930 ************************************ 00:22:22.930 START TEST nvmf_device_removal_pci_remove 00:22:22.930 ************************************ 00:22:22.930 03:22:43 -- common/autotest_common.sh@1111 -- # test_remove_and_rescan 00:22:22.930 03:22:43 -- target/device_removal.sh@128 -- # nvmfappstart -m 0x3 00:22:22.930 03:22:43 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:22:22.930 03:22:43 -- common/autotest_common.sh@710 -- # xtrace_disable 00:22:22.930 03:22:43 -- common/autotest_common.sh@10 -- # set +x 00:22:22.930 03:22:43 -- nvmf/common.sh@470 -- # nvmfpid=4155092 00:22:22.930 03:22:43 -- nvmf/common.sh@471 -- # waitforlisten 4155092 00:22:22.930 03:22:43 -- common/autotest_common.sh@817 -- # '[' -z 4155092 ']' 00:22:22.930 03:22:43 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:22.930 03:22:43 -- common/autotest_common.sh@822 -- # local max_retries=100 00:22:22.930 03:22:43 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:22.930 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:22.930 03:22:43 -- common/autotest_common.sh@826 -- # xtrace_disable 00:22:22.930 03:22:43 -- common/autotest_common.sh@10 -- # set +x 00:22:22.930 03:22:43 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:22:22.930 [2024-04-25 03:22:43.261881] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:22:22.930 [2024-04-25 03:22:43.261920] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:22.930 EAL: No free 2048 kB hugepages reported on node 1 00:22:22.930 [2024-04-25 03:22:43.321718] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:22:22.930 [2024-04-25 03:22:43.397671] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:22.930 [2024-04-25 03:22:43.397704] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:22.930 [2024-04-25 03:22:43.397711] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:22:22.930 [2024-04-25 03:22:43.397716] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:22:22.930 [2024-04-25 03:22:43.397722] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:22.930 [2024-04-25 03:22:43.397777] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:22.930 [2024-04-25 03:22:43.397779] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:22.930 03:22:44 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:22:22.930 03:22:44 -- common/autotest_common.sh@850 -- # return 0 00:22:22.930 03:22:44 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:22:22.930 03:22:44 -- common/autotest_common.sh@716 -- # xtrace_disable 00:22:22.930 03:22:44 -- common/autotest_common.sh@10 -- # set +x 00:22:22.930 03:22:44 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:22.930 03:22:44 -- target/device_removal.sh@130 -- # create_subsystem_and_connect 00:22:22.930 03:22:44 -- target/device_removal.sh@45 -- # local -gA netdev_nvme_dict 00:22:22.930 03:22:44 -- target/device_removal.sh@46 -- # netdev_nvme_dict=() 00:22:22.930 03:22:44 -- target/device_removal.sh@48 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:22:22.930 03:22:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:22.930 03:22:44 -- common/autotest_common.sh@10 -- # set +x 00:22:22.930 [2024-04-25 03:22:44.102137] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x6757f0/0x674e30) succeed. 00:22:22.930 [2024-04-25 03:22:44.110742] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x676a60/0x6753b0) succeed. 00:22:22.930 [2024-04-25 03:22:44.110763] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:22:22.930 03:22:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:22.930 03:22:44 -- target/device_removal.sh@49 -- # get_rdma_if_list 00:22:22.930 03:22:44 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:22:22.930 03:22:44 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:22:22.930 03:22:44 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:22:22.931 03:22:44 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:22:22.931 03:22:44 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:22:22.931 03:22:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:22.931 03:22:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:22.931 03:22:44 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:22:22.931 03:22:44 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:22:22.931 03:22:44 -- nvmf/common.sh@105 -- # continue 2 00:22:22.931 03:22:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:22.931 03:22:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:22.931 03:22:44 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:22:22.931 03:22:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:22.931 03:22:44 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:22:22.931 03:22:44 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:22:22.931 03:22:44 -- nvmf/common.sh@105 -- # continue 2 00:22:22.931 03:22:44 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:22:22.931 03:22:44 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev cvl_0_0 00:22:22.931 03:22:44 -- target/device_removal.sh@25 -- # local -a dev_name 00:22:22.931 03:22:44 -- target/device_removal.sh@27 -- # dev_name=cvl_0_0 00:22:22.931 03:22:44 -- target/device_removal.sh@28 -- # malloc_name=cvl_0_0 00:22:22.931 03:22:44 -- target/device_removal.sh@29 -- # get_subsystem_nqn cvl_0_0 00:22:22.931 03:22:44 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_cvl_0_0 00:22:22.931 03:22:44 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_cvl_0_0 00:22:22.931 03:22:44 -- target/device_removal.sh@30 -- # get_ip_address cvl_0_0 00:22:22.931 03:22:44 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:22:22.931 03:22:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:22:22.931 03:22:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:22.931 03:22:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:22.931 03:22:44 -- target/device_removal.sh@30 -- # ip=192.168.100.8 00:22:22.931 03:22:44 -- target/device_removal.sh@31 -- # serial=SPDK000cvl_0_0 00:22:22.931 03:22:44 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:22:22.931 03:22:44 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:22:22.931 03:22:44 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b cvl_0_0 00:22:22.931 03:22:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:22.931 03:22:44 -- common/autotest_common.sh@10 -- # set +x 00:22:22.931 03:22:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:22.931 03:22:44 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_cvl_0_0 -a -s SPDK000cvl_0_0 00:22:22.931 03:22:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:22.931 03:22:44 -- common/autotest_common.sh@10 -- # set +x 00:22:22.931 03:22:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:22.931 03:22:44 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_cvl_0_0 cvl_0_0 00:22:22.931 03:22:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:22.931 03:22:44 -- common/autotest_common.sh@10 -- # set +x 00:22:22.931 03:22:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:22.931 03:22:44 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_cvl_0_0 -t rdma -a 192.168.100.8 -s 4420 00:22:22.931 03:22:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:22.931 03:22:44 -- common/autotest_common.sh@10 -- # set +x 00:22:22.931 [2024-04-25 03:22:44.239559] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:22:22.931 03:22:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:22.931 03:22:44 -- target/device_removal.sh@41 -- # return 0 00:22:22.931 03:22:44 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=cvl_0_0 00:22:22.931 03:22:44 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:22:22.931 03:22:44 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev cvl_0_1 00:22:22.931 03:22:44 -- target/device_removal.sh@25 -- # local -a dev_name 00:22:22.931 03:22:44 -- target/device_removal.sh@27 -- # dev_name=cvl_0_1 00:22:22.931 03:22:44 -- target/device_removal.sh@28 -- # malloc_name=cvl_0_1 00:22:22.931 03:22:44 -- target/device_removal.sh@29 -- # get_subsystem_nqn cvl_0_1 00:22:22.931 03:22:44 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_cvl_0_1 00:22:22.931 03:22:44 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_cvl_0_1 00:22:22.931 03:22:44 -- target/device_removal.sh@30 -- # get_ip_address cvl_0_1 00:22:22.931 03:22:44 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:22:22.931 03:22:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:22:22.931 03:22:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:22.931 03:22:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:22.931 03:22:44 -- target/device_removal.sh@30 -- # ip=192.168.100.9 00:22:22.931 03:22:44 -- target/device_removal.sh@31 -- # serial=SPDK000cvl_0_1 00:22:22.931 03:22:44 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:22:22.931 03:22:44 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:22:22.931 03:22:44 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b cvl_0_1 00:22:22.931 03:22:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:22.931 03:22:44 -- common/autotest_common.sh@10 -- # set +x 00:22:22.931 03:22:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:22.931 03:22:44 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_cvl_0_1 -a -s SPDK000cvl_0_1 00:22:22.931 03:22:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:22.931 03:22:44 -- common/autotest_common.sh@10 -- # set +x 00:22:22.931 03:22:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:22.931 03:22:44 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_cvl_0_1 cvl_0_1 00:22:22.931 03:22:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:22.931 03:22:44 -- common/autotest_common.sh@10 -- # set +x 00:22:22.931 03:22:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:22.931 03:22:44 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_cvl_0_1 -t rdma -a 192.168.100.9 -s 4420 00:22:22.931 03:22:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:22.931 03:22:44 -- common/autotest_common.sh@10 -- # set +x 00:22:22.931 [2024-04-25 03:22:44.314507] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:22:22.931 03:22:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:22.931 03:22:44 -- target/device_removal.sh@41 -- # return 0 00:22:22.931 03:22:44 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=cvl_0_1 00:22:22.931 03:22:44 -- target/device_removal.sh@53 -- # return 0 00:22:22.931 03:22:44 -- target/device_removal.sh@132 -- # generate_io_traffic_with_bdevperf cvl_0_0 cvl_0_1 00:22:22.931 03:22:44 -- target/device_removal.sh@87 -- # dev_names=('cvl_0_0' 'cvl_0_1') 00:22:22.931 03:22:44 -- target/device_removal.sh@87 -- # local dev_names 00:22:22.931 03:22:44 -- target/device_removal.sh@89 -- # mkdir -p /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:22:22.931 03:22:44 -- target/device_removal.sh@91 -- # bdevperf_pid=4155352 00:22:22.931 03:22:44 -- target/device_removal.sh@93 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; kill -9 $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:22.931 03:22:44 -- target/device_removal.sh@90 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 90 00:22:22.931 03:22:44 -- target/device_removal.sh@94 -- # waitforlisten 4155352 /var/tmp/bdevperf.sock 00:22:22.931 03:22:44 -- common/autotest_common.sh@817 -- # '[' -z 4155352 ']' 00:22:22.931 03:22:44 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:22.931 03:22:44 -- common/autotest_common.sh@822 -- # local max_retries=100 00:22:22.931 03:22:44 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:22.931 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:22.931 03:22:44 -- common/autotest_common.sh@826 -- # xtrace_disable 00:22:22.931 03:22:44 -- common/autotest_common.sh@10 -- # set +x 00:22:22.931 03:22:45 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:22:22.931 03:22:45 -- common/autotest_common.sh@850 -- # return 0 00:22:22.931 03:22:45 -- target/device_removal.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_set_options -r -1 00:22:22.931 03:22:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:22.931 03:22:45 -- common/autotest_common.sh@10 -- # set +x 00:22:22.931 03:22:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:22.931 03:22:45 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:22:22.931 03:22:45 -- target/device_removal.sh@101 -- # get_subsystem_nqn cvl_0_0 00:22:22.931 03:22:45 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_cvl_0_0 00:22:22.931 03:22:45 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_cvl_0_0 00:22:22.931 03:22:45 -- target/device_removal.sh@102 -- # get_ip_address cvl_0_0 00:22:22.931 03:22:45 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:22:22.931 03:22:45 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:22:22.931 03:22:45 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:22.931 03:22:45 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:22.931 03:22:45 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.8 00:22:22.931 03:22:45 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_cvl_0_0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_cvl_0_0 -l -1 -o 1 00:22:22.931 03:22:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:22.931 03:22:45 -- common/autotest_common.sh@10 -- # set +x 00:22:22.931 Nvme_cvl_0_0n1 00:22:22.931 03:22:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:22.932 03:22:45 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:22:22.932 03:22:45 -- target/device_removal.sh@101 -- # get_subsystem_nqn cvl_0_1 00:22:22.932 03:22:45 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_cvl_0_1 00:22:22.932 03:22:45 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_cvl_0_1 00:22:22.932 03:22:45 -- target/device_removal.sh@102 -- # get_ip_address cvl_0_1 00:22:22.932 03:22:45 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:22:22.932 03:22:45 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:22:22.932 03:22:45 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:22.932 03:22:45 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:22.932 03:22:45 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.9 00:22:22.932 03:22:45 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_cvl_0_1 -t rdma -a 192.168.100.9 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_cvl_0_1 -l -1 -o 1 00:22:22.932 03:22:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:22.932 03:22:45 -- common/autotest_common.sh@10 -- # set +x 00:22:22.932 Nvme_cvl_0_1n1 00:22:22.932 03:22:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:22.932 03:22:45 -- target/device_removal.sh@110 -- # bdevperf_rpc_pid=4155590 00:22:22.932 03:22:45 -- target/device_removal.sh@112 -- # sleep 5 00:22:22.932 03:22:45 -- target/device_removal.sh@109 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 120 -s /var/tmp/bdevperf.sock perform_tests 00:22:22.932 03:22:50 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:22:22.932 03:22:50 -- target/device_removal.sh@135 -- # nvme_dev=cvl_0_0 00:22:22.932 03:22:50 -- target/device_removal.sh@136 -- # get_rdma_device_name cvl_0_0 00:22:22.932 03:22:50 -- target/device_removal.sh@71 -- # dev_name=cvl_0_0 00:22:22.932 03:22:50 -- target/device_removal.sh@72 -- # get_pci_dir cvl_0_0 00:22:22.932 03:22:50 -- target/device_removal.sh@61 -- # dev_name=cvl_0_0 00:22:22.932 03:22:50 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:af:00.0/net/cvl_0_0/device 00:22:22.932 03:22:50 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:ae/0000:ae:02.0/0000:af:00.0/infiniband 00:22:22.932 03:22:50 -- target/device_removal.sh@136 -- # rdma_dev_name=rocep175s0f0 00:22:22.932 03:22:50 -- target/device_removal.sh@137 -- # get_ip_address cvl_0_0 00:22:22.932 03:22:50 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:22:22.932 03:22:50 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:22:22.932 03:22:50 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:22.932 03:22:50 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:22.932 03:22:50 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.8 00:22:22.932 03:22:50 -- target/device_removal.sh@138 -- # get_pci_dir cvl_0_0 00:22:22.932 03:22:50 -- target/device_removal.sh@61 -- # dev_name=cvl_0_0 00:22:22.932 03:22:50 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:af:00.0/net/cvl_0_0/device 00:22:22.932 03:22:50 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:ae/0000:ae:02.0/0000:af:00.0 00:22:22.932 03:22:50 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt rocep175s0f0 00:22:22.932 03:22:50 -- target/device_removal.sh@76 -- # local rdma_dev_name=rocep175s0f0 00:22:22.932 03:22:50 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:22:22.932 03:22:50 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:22:22.932 03:22:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:22.932 03:22:50 -- common/autotest_common.sh@10 -- # set +x 00:22:22.932 03:22:50 -- target/device_removal.sh@77 -- # grep rocep175s0f0 00:22:22.932 03:22:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:22.932 rocep175s0f0 00:22:22.932 03:22:50 -- target/device_removal.sh@78 -- # return 0 00:22:22.932 03:22:50 -- target/device_removal.sh@145 -- # remove_one_nic cvl_0_0 00:22:22.932 03:22:50 -- target/device_removal.sh@66 -- # dev_name=cvl_0_0 00:22:22.932 03:22:50 -- target/device_removal.sh@67 -- # echo 1 00:22:22.932 03:22:50 -- target/device_removal.sh@67 -- # get_pci_dir cvl_0_0 00:22:22.932 03:22:50 -- target/device_removal.sh@61 -- # dev_name=cvl_0_0 00:22:22.932 03:22:50 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:af:00.0/net/cvl_0_0/device 00:22:22.932 [2024-04-25 03:22:50.492077] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:22:22.932 [2024-04-25 03:22:50.492319] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.8:4420 on device rocep175s0f0 is being removed. 00:22:22.932 [2024-04-25 03:22:50.492395] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:22:22.932 [2024-04-25 03:22:50.493104] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 65 00:22:22.932 [2024-04-25 03:22:50.493114] rdma.c: 632:nvmf_rdma_dump_qpair_contents: *ERROR*: Dumping contents of queue pair (QID 1) 00:22:22.932 [2024-04-25 03:22:50.493120] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493125] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493131] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493136] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493141] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493146] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493151] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493155] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493160] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493165] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493170] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493175] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493181] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493186] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493191] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493195] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493200] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493204] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493209] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493214] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493219] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493224] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493229] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493234] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493239] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493244] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493249] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493254] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493259] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493264] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493269] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493274] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493279] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493283] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493288] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493293] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493299] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493304] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493311] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493317] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493322] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493326] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493332] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493336] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493341] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493345] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493350] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493355] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493360] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493365] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493369] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493374] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493381] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493386] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493391] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493396] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493402] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493406] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493411] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493416] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493421] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493425] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493430] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493435] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493440] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.932 [2024-04-25 03:22:50.493444] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.932 [2024-04-25 03:22:50.493450] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493455] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493460] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493465] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493470] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493475] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493481] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493485] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493490] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493495] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493500] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493505] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493510] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493515] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493521] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493526] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493531] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493537] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493542] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493547] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493552] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.933 [2024-04-25 03:22:50.493556] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.933 [2024-04-25 03:22:50.493561] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493566] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493571] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493577] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493582] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493587] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493592] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493597] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493602] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493607] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493613] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493618] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493624] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493629] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493633] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493638] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493643] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493647] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493652] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493656] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493661] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493666] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493671] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493675] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493680] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493685] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493690] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493694] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493699] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493703] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493708] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493713] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493720] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493724] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493731] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493735] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493741] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493745] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493750] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493755] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 [2024-04-25 03:22:50.493760] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:22.933 [2024-04-25 03:22:50.493765] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:22.933 03:22:51 -- target/device_removal.sh@147 -- # seq 1 10 00:22:22.933 03:22:51 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:22:22.933 03:22:51 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt rocep175s0f0 00:22:22.933 03:22:51 -- target/device_removal.sh@76 -- # local rdma_dev_name=rocep175s0f0 00:22:22.933 03:22:51 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:22:22.933 03:22:51 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:22:22.933 03:22:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:22.933 03:22:51 -- target/device_removal.sh@77 -- # grep rocep175s0f0 00:22:22.933 03:22:51 -- common/autotest_common.sh@10 -- # set +x 00:22:22.933 03:22:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:22.933 03:22:51 -- target/device_removal.sh@78 -- # return 1 00:22:22.933 03:22:51 -- target/device_removal.sh@149 -- # break 00:22:22.933 03:22:51 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:22:22.933 03:22:51 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:22:22.933 03:22:51 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:22:22.933 03:22:51 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:22:22.933 03:22:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:22.933 03:22:51 -- common/autotest_common.sh@10 -- # set +x 00:22:22.933 03:22:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:22.933 03:22:51 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:22:22.933 03:22:51 -- target/device_removal.sh@160 -- # rescan_pci 00:22:22.933 03:22:51 -- target/device_removal.sh@57 -- # echo 1 00:22:22.933 [2024-04-25 03:22:51.716637] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device irdma0(0x676940/0x66de80) succeed. 00:22:22.933 [2024-04-25 03:22:51.716696] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.8:4420 is still failed(-1) to listen. 00:22:22.933 [2024-04-25 03:22:51.716712] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: port active 00:22:22.933 [2024-04-25 03:22:51.716721] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: port active 00:22:22.933 03:22:52 -- target/device_removal.sh@162 -- # seq 1 10 00:22:22.933 03:22:52 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:22:22.933 03:22:52 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:ae/0000:ae:02.0/0000:af:00.0/net 00:22:22.933 03:22:52 -- target/device_removal.sh@163 -- # new_net_dev=cvl_0_0 00:22:22.933 03:22:52 -- target/device_removal.sh@164 -- # [[ -z cvl_0_0 ]] 00:22:22.933 03:22:52 -- target/device_removal.sh@166 -- # [[ cvl_0_0 != \c\v\l\_\0\_\0 ]] 00:22:22.933 03:22:52 -- target/device_removal.sh@171 -- # break 00:22:22.933 03:22:52 -- target/device_removal.sh@175 -- # [[ -z cvl_0_0 ]] 00:22:22.933 03:22:52 -- target/device_removal.sh@179 -- # ip link set cvl_0_0 up 00:22:22.933 03:22:52 -- target/device_removal.sh@180 -- # get_ip_address cvl_0_0 00:22:22.933 03:22:52 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:22:22.933 03:22:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:22:22.933 03:22:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:22.933 03:22:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:22.933 03:22:52 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:22:22.933 03:22:52 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.8/24 dev cvl_0_0 00:22:22.933 [2024-04-25 03:22:52.211402] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:22:22.933 [2024-04-25 03:22:52.211431] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.8:4420 come back 00:22:22.933 [2024-04-25 03:22:52.211444] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:22:22.933 03:22:52 -- target/device_removal.sh@186 -- # seq 1 10 00:22:22.933 03:22:52 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:22:22.933 03:22:52 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:22:22.933 03:22:52 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:22:22.933 03:22:52 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:22:22.933 03:22:52 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:22:22.933 03:22:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:22.933 03:22:52 -- common/autotest_common.sh@10 -- # set +x 00:22:22.933 03:22:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:22.933 03:22:52 -- target/device_removal.sh@187 -- # ib_count=2 00:22:22.933 03:22:52 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:22:22.933 03:22:52 -- target/device_removal.sh@189 -- # break 00:22:22.933 03:22:52 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:22:22.933 03:22:52 -- target/device_removal.sh@135 -- # nvme_dev=cvl_0_1 00:22:22.933 03:22:52 -- target/device_removal.sh@136 -- # get_rdma_device_name cvl_0_1 00:22:22.933 03:22:52 -- target/device_removal.sh@71 -- # dev_name=cvl_0_1 00:22:22.933 03:22:52 -- target/device_removal.sh@72 -- # get_pci_dir cvl_0_1 00:22:22.933 03:22:52 -- target/device_removal.sh@61 -- # dev_name=cvl_0_1 00:22:22.933 03:22:52 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:af:00.1/net/cvl_0_1/device 00:22:22.933 03:22:52 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:ae/0000:ae:02.0/0000:af:00.1/infiniband 00:22:22.934 03:22:52 -- target/device_removal.sh@136 -- # rdma_dev_name=rocep175s0f1 00:22:22.934 03:22:52 -- target/device_removal.sh@137 -- # get_ip_address cvl_0_1 00:22:22.934 03:22:52 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:22:22.934 03:22:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:22:22.934 03:22:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:22.934 03:22:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:22.934 03:22:52 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.9 00:22:22.934 03:22:52 -- target/device_removal.sh@138 -- # get_pci_dir cvl_0_1 00:22:22.934 03:22:52 -- target/device_removal.sh@61 -- # dev_name=cvl_0_1 00:22:22.934 03:22:52 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:af:00.1/net/cvl_0_1/device 00:22:22.934 03:22:52 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:ae/0000:ae:02.0/0000:af:00.1 00:22:22.934 03:22:52 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt rocep175s0f1 00:22:22.934 03:22:52 -- target/device_removal.sh@76 -- # local rdma_dev_name=rocep175s0f1 00:22:22.934 03:22:52 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:22:22.934 03:22:52 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:22:22.934 03:22:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:22.934 03:22:52 -- common/autotest_common.sh@10 -- # set +x 00:22:22.934 03:22:52 -- target/device_removal.sh@77 -- # grep rocep175s0f1 00:22:22.934 03:22:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:22.934 rocep175s0f1 00:22:22.934 03:22:52 -- target/device_removal.sh@78 -- # return 0 00:22:22.934 03:22:52 -- target/device_removal.sh@145 -- # remove_one_nic cvl_0_1 00:22:22.934 03:22:52 -- target/device_removal.sh@66 -- # dev_name=cvl_0_1 00:22:22.934 03:22:52 -- target/device_removal.sh@67 -- # echo 1 00:22:22.934 03:22:52 -- target/device_removal.sh@67 -- # get_pci_dir cvl_0_1 00:22:22.934 03:22:52 -- target/device_removal.sh@61 -- # dev_name=cvl_0_1 00:22:22.934 03:22:52 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:af:00.1/net/cvl_0_1/device 00:22:22.934 [2024-04-25 03:22:52.354343] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.9:4420 on device rocep175s0f1 is being removed. 00:22:22.934 [2024-04-25 03:22:52.354567] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno No such device or address (6) 00:22:22.934 [2024-04-25 03:22:52.355563] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno No such device or address (6) 00:22:22.934 [2024-04-25 03:22:52.355575] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 97 00:22:22.934 [2024-04-25 03:22:52.355581] rdma.c: 632:nvmf_rdma_dump_qpair_contents: *ERROR*: Dumping contents of queue pair (QID 1) 00:22:22.934 [2024-04-25 03:22:52.355589] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355594] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355599] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355605] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355609] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355614] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355619] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355623] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355628] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355633] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355638] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355643] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355648] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355653] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355658] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355663] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355667] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355672] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355677] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355681] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355686] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355690] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355695] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355700] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355704] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355709] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355714] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355719] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355723] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355728] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355750] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355755] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355760] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355765] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355771] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355775] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355780] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355785] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355790] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355794] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355799] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355804] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355810] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355815] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355821] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355826] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355831] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355836] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355841] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355846] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355851] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355860] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355865] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355870] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355875] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355879] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355884] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355889] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355894] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355899] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355905] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355910] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355915] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355919] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355924] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355929] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355934] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355939] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355944] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355949] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355954] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355959] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355963] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355968] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355974] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355979] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355984] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355988] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.355993] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.355997] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.356002] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.356007] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.356012] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.356018] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.356023] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.356028] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.934 [2024-04-25 03:22:52.356033] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.934 [2024-04-25 03:22:52.356038] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356043] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356047] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356052] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356057] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356061] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356066] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356071] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356075] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356080] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356085] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356090] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356094] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356099] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356105] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356110] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356115] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356119] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356124] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356130] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356135] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356140] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356145] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356149] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356154] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356159] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356164] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356169] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356174] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356180] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356184] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356189] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356194] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356199] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356204] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356210] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356215] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356220] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356226] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356231] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356236] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356241] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356251] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356257] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356262] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356266] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356272] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356277] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356282] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356291] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356296] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356301] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356306] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356311] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356316] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356321] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356326] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356331] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356336] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356341] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356346] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356351] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356356] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356361] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356367] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356372] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356377] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356382] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356387] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356392] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356396] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356401] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356406] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356411] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356418] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356423] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356429] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356434] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356439] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356444] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356450] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356455] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356463] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356468] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356472] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356477] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356482] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356487] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356492] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356498] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356502] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356507] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356512] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356517] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356522] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356526] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356531] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356537] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356542] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356548] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.935 [2024-04-25 03:22:52.356554] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.935 [2024-04-25 03:22:52.356559] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.936 [2024-04-25 03:22:52.356565] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.936 [2024-04-25 03:22:52.356570] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.936 [2024-04-25 03:22:52.356575] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.936 [2024-04-25 03:22:52.356582] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:22:22.936 [2024-04-25 03:22:52.356590] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:22:22.936 03:22:52 -- target/device_removal.sh@147 -- # seq 1 10 00:22:22.936 03:22:52 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:22:22.936 03:22:52 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt rocep175s0f1 00:22:22.936 03:22:52 -- target/device_removal.sh@76 -- # local rdma_dev_name=rocep175s0f1 00:22:22.936 03:22:52 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:22:22.936 03:22:52 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:22:22.936 03:22:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:22.936 03:22:52 -- common/autotest_common.sh@10 -- # set +x 00:22:22.936 03:22:52 -- target/device_removal.sh@77 -- # grep rocep175s0f1 00:22:22.936 03:22:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:22.936 03:22:53 -- target/device_removal.sh@78 -- # return 1 00:22:22.936 03:22:53 -- target/device_removal.sh@149 -- # break 00:22:22.936 03:22:53 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:22:22.936 03:22:53 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:22:22.936 03:22:53 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:22:22.936 03:22:53 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:22:22.936 03:22:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:22.936 03:22:53 -- common/autotest_common.sh@10 -- # set +x 00:22:22.936 03:22:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:22.936 03:22:53 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:22:22.936 03:22:53 -- target/device_removal.sh@160 -- # rescan_pci 00:22:22.936 03:22:53 -- target/device_removal.sh@57 -- # echo 1 00:22:22.936 [2024-04-25 03:22:53.548146] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device irdma0(0x780890/0x66e270) succeed. 00:22:22.936 [2024-04-25 03:22:53.548243] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.9:4420 is still failed(-1) to listen. 00:22:22.936 [2024-04-25 03:22:53.548288] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: port active 00:22:22.936 03:22:53 -- target/device_removal.sh@162 -- # seq 1 10 00:22:22.936 03:22:53 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:22:22.936 03:22:53 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:ae/0000:ae:02.0/0000:af:00.1/net 00:22:22.936 03:22:53 -- target/device_removal.sh@163 -- # new_net_dev=cvl_0_1 00:22:22.936 03:22:53 -- target/device_removal.sh@164 -- # [[ -z cvl_0_1 ]] 00:22:22.936 03:22:53 -- target/device_removal.sh@166 -- # [[ cvl_0_1 != \c\v\l\_\0\_\1 ]] 00:22:22.936 03:22:53 -- target/device_removal.sh@171 -- # break 00:22:22.936 03:22:53 -- target/device_removal.sh@175 -- # [[ -z cvl_0_1 ]] 00:22:22.936 03:22:53 -- target/device_removal.sh@179 -- # ip link set cvl_0_1 up 00:22:22.936 03:22:53 -- target/device_removal.sh@180 -- # get_ip_address cvl_0_1 00:22:22.936 03:22:53 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:22:22.936 03:22:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:22:22.936 03:22:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:22.936 03:22:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:22.936 03:22:53 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:22:22.936 03:22:53 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.9/24 dev cvl_0_1 00:22:22.936 03:22:53 -- target/device_removal.sh@186 -- # seq 1 10 00:22:22.936 [2024-04-25 03:22:53.980299] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:22:22.936 [2024-04-25 03:22:53.980322] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.9:4420 come back 00:22:22.936 [2024-04-25 03:22:53.980331] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:22:22.936 03:22:53 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:22:22.936 03:22:53 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:22:22.936 03:22:53 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:22:22.936 03:22:53 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:22:22.936 03:22:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:22.936 03:22:53 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:22:22.936 03:22:53 -- common/autotest_common.sh@10 -- # set +x 00:22:22.936 03:22:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:22.936 03:22:54 -- target/device_removal.sh@187 -- # ib_count=2 00:22:22.936 03:22:54 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:22:22.936 03:22:54 -- target/device_removal.sh@189 -- # break 00:22:22.936 03:22:54 -- target/device_removal.sh@200 -- # stop_bdevperf 00:22:22.936 03:22:54 -- target/device_removal.sh@116 -- # wait 4155590 00:23:44.402 0 00:23:44.402 03:24:15 -- target/device_removal.sh@118 -- # killprocess 4155352 00:23:44.402 03:24:15 -- common/autotest_common.sh@936 -- # '[' -z 4155352 ']' 00:23:44.402 03:24:15 -- common/autotest_common.sh@940 -- # kill -0 4155352 00:23:44.402 03:24:15 -- common/autotest_common.sh@941 -- # uname 00:23:44.402 03:24:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:44.402 03:24:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4155352 00:23:44.402 03:24:15 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:23:44.402 03:24:15 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:23:44.402 03:24:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4155352' 00:23:44.402 killing process with pid 4155352 00:23:44.402 03:24:15 -- common/autotest_common.sh@955 -- # kill 4155352 00:23:44.402 03:24:15 -- common/autotest_common.sh@960 -- # wait 4155352 00:23:44.402 03:24:15 -- target/device_removal.sh@119 -- # bdevperf_pid= 00:23:44.402 03:24:15 -- target/device_removal.sh@121 -- # cat /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/try.txt 00:23:44.402 [2024-04-25 03:22:44.365114] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:23:44.402 [2024-04-25 03:22:44.365160] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4155352 ] 00:23:44.402 EAL: No free 2048 kB hugepages reported on node 1 00:23:44.402 [2024-04-25 03:22:44.418850] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:44.402 [2024-04-25 03:22:44.493551] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:44.402 Running I/O for 90 seconds... 00:23:44.402 [2024-04-25 03:22:50.493219] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:23:44.402 [2024-04-25 03:22:50.494008] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:23:44.402 [2024-04-25 03:22:50.494028] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:44.402 [2024-04-25 03:22:50.494037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32701 cdw0:16 sqhd:f3b9 p:0 m:0 dnr:0 00:23:44.402 [2024-04-25 03:22:50.494045] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:44.402 [2024-04-25 03:22:50.494053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32701 cdw0:16 sqhd:f3b9 p:0 m:0 dnr:0 00:23:44.402 [2024-04-25 03:22:50.494061] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:44.402 [2024-04-25 03:22:50.494067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32701 cdw0:16 sqhd:f3b9 p:0 m:0 dnr:0 00:23:44.402 [2024-04-25 03:22:50.494075] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:23:44.402 [2024-04-25 03:22:50.494081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32701 cdw0:16 sqhd:f3b9 p:0 m:0 dnr:0 00:23:44.402 [2024-04-25 03:22:50.494173] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:23:44.402 [2024-04-25 03:22:50.494183] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_0] in failed state. 00:23:44.402 [2024-04-25 03:22:50.495337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:204792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.402 [2024-04-25 03:22:50.495352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.402 [2024-04-25 03:22:50.495365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:203776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077fe000 len:0x1000 key:0xc6174cc9 00:23:44.402 [2024-04-25 03:22:50.495373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.402 [2024-04-25 03:22:50.495381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:203784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077fc000 len:0x1000 key:0xc6174cc9 00:23:44.402 [2024-04-25 03:22:50.495388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.402 [2024-04-25 03:22:50.495396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:203792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077fa000 len:0x1000 key:0xc6174cc9 00:23:44.402 [2024-04-25 03:22:50.495403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:203800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f8000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:203808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f6000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:203816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f4000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:203824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f2000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:203832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f0000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:203840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ee000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:203848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ec000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:203856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ea000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:203864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e8000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:203872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e6000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:203880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e4000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:203888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e2000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:203896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e0000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:203904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077de000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:203912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077dc000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:203920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077da000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:203928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d8000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:203936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d6000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:203944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d4000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:203952 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d2000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:203960 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d0000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:203968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ce000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:203976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077cc000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:203984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ca000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:203992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c8000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:204000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c6000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:204008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c4000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:204016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c2000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:204024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c0000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:204032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077be000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:204040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077bc000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:204048 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ba000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.403 [2024-04-25 03:22:50.495891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:204056 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b8000 len:0x1000 key:0xc6174cc9 00:23:44.403 [2024-04-25 03:22:50.495898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.495906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:204064 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b6000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.495912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.495922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:204072 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b4000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.495929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.495938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:204080 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b2000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.495944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.495953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:204088 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b0000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.495976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.495985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:204096 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ae000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.495992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.496001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:204104 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ac000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.496007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.496016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:204112 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077aa000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.496022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.496031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:204120 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a8000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.496038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.496046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:204128 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a6000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.496054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.496063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:204136 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a4000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.496070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.496078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:204144 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a2000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.496085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.496094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:204152 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a0000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.496101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.496111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:204160 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000779e000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.496117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.496127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:204168 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000779c000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.496134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.496142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:204176 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000779a000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.496149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.496158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:204184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007798000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.496166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.496175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:204192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007796000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.496182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.496190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:204200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007794000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.496197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.496207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:204208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007792000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.496214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.496223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:204216 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007790000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.496229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.496251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:204224 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000778e000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.496258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.496265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:204232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000778c000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.496272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.496280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:204240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000778a000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.496287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.496295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:204248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007788000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.496304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.496313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:204256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007786000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.496319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.496328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:204264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007784000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.496334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.496342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:204272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007782000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.496349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.496357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:204280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007780000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.496363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.496370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:204288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000777e000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.496379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.496387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:204296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000777c000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.496393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.496402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:204304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000777a000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.496408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.496416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:204312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007778000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.496423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.404 [2024-04-25 03:22:50.496431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:204320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007776000 len:0x1000 key:0xc6174cc9 00:23:44.404 [2024-04-25 03:22:50.496438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:204328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007774000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:204336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007772000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:204344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007770000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:204352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000776e000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:204360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000776c000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:204368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000776a000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:204376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007768000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:204384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007766000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:204392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007764000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:204400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007762000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:204408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007760000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:204416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000775e000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:204424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000775c000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:204432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000775a000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:204440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007758000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:204448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007756000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:204456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007754000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:204464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007752000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:204472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007750000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:204480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000774e000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:204488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000774c000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:204496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000774a000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:204504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007748000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:204512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007746000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:204520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007744000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:204528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007742000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:204536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007740000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:204544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773e000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:204552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773c000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:204560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773a000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.496926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:204568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007738000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.496933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.507466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:204576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007736000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.507476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.507486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:204584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007734000 len:0x1000 key:0xc6174cc9 00:23:44.405 [2024-04-25 03:22:50.507494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.405 [2024-04-25 03:22:50.507504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:204592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007732000 len:0x1000 key:0xc6174cc9 00:23:44.406 [2024-04-25 03:22:50.507512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.406 [2024-04-25 03:22:50.507520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:204600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007730000 len:0x1000 key:0xc6174cc9 00:23:44.406 [2024-04-25 03:22:50.507527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.406 [2024-04-25 03:22:50.507537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:204608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772e000 len:0x1000 key:0xc6174cc9 00:23:44.406 [2024-04-25 03:22:50.507544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.406 [2024-04-25 03:22:50.507553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:204616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772c000 len:0x1000 key:0xc6174cc9 00:23:44.406 [2024-04-25 03:22:50.507559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.406 [2024-04-25 03:22:50.507567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:204624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772a000 len:0x1000 key:0xc6174cc9 00:23:44.406 [2024-04-25 03:22:50.507574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.406 [2024-04-25 03:22:50.507583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:204632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007728000 len:0x1000 key:0xc6174cc9 00:23:44.406 [2024-04-25 03:22:50.507589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.406 [2024-04-25 03:22:50.507597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:204640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007726000 len:0x1000 key:0xc6174cc9 00:23:44.406 [2024-04-25 03:22:50.507605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.406 [2024-04-25 03:22:50.507613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:204648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007724000 len:0x1000 key:0xc6174cc9 00:23:44.406 [2024-04-25 03:22:50.507620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.406 [2024-04-25 03:22:50.507629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:204656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007722000 len:0x1000 key:0xc6174cc9 00:23:44.406 [2024-04-25 03:22:50.507636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.406 [2024-04-25 03:22:50.507644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:204664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007720000 len:0x1000 key:0xc6174cc9 00:23:44.406 [2024-04-25 03:22:50.507651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.406 [2024-04-25 03:22:50.507661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:204672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771e000 len:0x1000 key:0xc6174cc9 00:23:44.406 [2024-04-25 03:22:50.507667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.406 [2024-04-25 03:22:50.507676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:204680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771c000 len:0x1000 key:0xc6174cc9 00:23:44.406 [2024-04-25 03:22:50.507682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.406 [2024-04-25 03:22:50.507691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:204688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771a000 len:0x1000 key:0xc6174cc9 00:23:44.406 [2024-04-25 03:22:50.507697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.406 [2024-04-25 03:22:50.507709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:204696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007718000 len:0x1000 key:0xc6174cc9 00:23:44.406 [2024-04-25 03:22:50.507716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.406 [2024-04-25 03:22:50.507724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:204704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007716000 len:0x1000 key:0xc6174cc9 00:23:44.406 [2024-04-25 03:22:50.507731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.406 [2024-04-25 03:22:50.507739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:204712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007714000 len:0x1000 key:0xc6174cc9 00:23:44.406 [2024-04-25 03:22:50.507746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.406 [2024-04-25 03:22:50.507755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:204720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007712000 len:0x1000 key:0xc6174cc9 00:23:44.406 [2024-04-25 03:22:50.507761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.406 [2024-04-25 03:22:50.507769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:204728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007710000 len:0x1000 key:0xc6174cc9 00:23:44.406 [2024-04-25 03:22:50.507776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.406 [2024-04-25 03:22:50.507784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:204736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770e000 len:0x1000 key:0xc6174cc9 00:23:44.406 [2024-04-25 03:22:50.507791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.406 [2024-04-25 03:22:50.507799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:204744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770c000 len:0x1000 key:0xc6174cc9 00:23:44.406 [2024-04-25 03:22:50.507805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.406 [2024-04-25 03:22:50.507813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:204752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770a000 len:0x1000 key:0xc6174cc9 00:23:44.406 [2024-04-25 03:22:50.507820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.406 [2024-04-25 03:22:50.507828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:204760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007708000 len:0x1000 key:0xc6174cc9 00:23:44.406 [2024-04-25 03:22:50.507834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.406 [2024-04-25 03:22:50.507843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:204768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007706000 len:0x1000 key:0xc6174cc9 00:23:44.406 [2024-04-25 03:22:50.507849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.406 [2024-04-25 03:22:50.507862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:204776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007704000 len:0x1000 key:0xc6174cc9 00:23:44.406 [2024-04-25 03:22:50.507869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.406 [2024-04-25 03:22:50.520753] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:23:44.406 [2024-04-25 03:22:50.520764] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:23:44.406 [2024-04-25 03:22:50.520771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:204784 len:8 PRP1 0x0 PRP2 0x0 00:23:44.406 [2024-04-25 03:22:50.520777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:44.406 [2024-04-25 03:22:50.523367] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_0] resetting controller 00:23:44.406 [2024-04-25 03:22:50.523680] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:23:44.406 [2024-04-25 03:22:50.523693] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:23:44.406 [2024-04-25 03:22:50.523699] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:23:44.406 [2024-04-25 03:22:50.523713] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:23:44.406 [2024-04-25 03:22:50.523719] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_0] in failed state. 00:23:44.406 [2024-04-25 03:22:50.523748] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_0] Ctrlr is in error state 00:23:44.406 [2024-04-25 03:22:50.523755] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_0] controller reinitialization failed 00:23:44.406 [2024-04-25 03:22:50.523762] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_0] already in failed state 00:23:44.406 [2024-04-25 03:22:50.523778] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:44.406 [2024-04-25 03:22:50.523785] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_0] resetting controller 00:23:44.406 [2024-04-25 03:22:52.352767] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno No such device or address (6) 00:23:44.406 [2024-04-25 03:22:52.352799] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:44.406 [2024-04-25 03:22:52.352808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32701 cdw0:6 sqhd:f3b9 p:0 m:0 dnr:0 00:23:44.406 [2024-04-25 03:22:52.352816] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:44.406 [2024-04-25 03:22:52.352823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32701 cdw0:6 sqhd:f3b9 p:0 m:0 dnr:0 00:23:44.406 [2024-04-25 03:22:52.352830] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:44.406 [2024-04-25 03:22:52.352836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32701 cdw0:6 sqhd:f3b9 p:0 m:0 dnr:0 00:23:44.406 [2024-04-25 03:22:52.352843] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:23:44.407 [2024-04-25 03:22:52.352849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32701 cdw0:6 sqhd:f3b9 p:0 m:0 dnr:0 00:23:44.407 [2024-04-25 03:22:52.355451] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:23:44.407 [2024-04-25 03:22:52.355468] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_1] in failed state. 00:23:44.407 [2024-04-25 03:22:52.355638] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno No such device or address (6) 00:23:44.407 [2024-04-25 03:22:52.356530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:197672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.407 [2024-04-25 03:22:52.356545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.407 [2024-04-25 03:22:52.356558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:197680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.407 [2024-04-25 03:22:52.356566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.407 [2024-04-25 03:22:52.356575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:197688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.407 [2024-04-25 03:22:52.356582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.407 [2024-04-25 03:22:52.356591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:197696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.407 [2024-04-25 03:22:52.356599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.407 [2024-04-25 03:22:52.356606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:197704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.407 [2024-04-25 03:22:52.356612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.407 [2024-04-25 03:22:52.356620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:197712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.407 [2024-04-25 03:22:52.356626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.407 [2024-04-25 03:22:52.356634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:197720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.407 [2024-04-25 03:22:52.356640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.407 [2024-04-25 03:22:52.356647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:197728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.407 [2024-04-25 03:22:52.356653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.407 [2024-04-25 03:22:52.356661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:197736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.407 [2024-04-25 03:22:52.356667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.407 [2024-04-25 03:22:52.356675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:197744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.407 [2024-04-25 03:22:52.356681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.407 [2024-04-25 03:22:52.356689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:197752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.407 [2024-04-25 03:22:52.356695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.407 [2024-04-25 03:22:52.356702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:197760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.407 [2024-04-25 03:22:52.356708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.407 [2024-04-25 03:22:52.356716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:197768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.407 [2024-04-25 03:22:52.356724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.407 [2024-04-25 03:22:52.356731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:197776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.407 [2024-04-25 03:22:52.356737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.407 [2024-04-25 03:22:52.356744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:197784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.407 [2024-04-25 03:22:52.356750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.407 [2024-04-25 03:22:52.356758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:197792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.407 [2024-04-25 03:22:52.356764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.407 [2024-04-25 03:22:52.356772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:197800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.407 [2024-04-25 03:22:52.356779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.407 [2024-04-25 03:22:52.356787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:197808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.407 [2024-04-25 03:22:52.356793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.407 [2024-04-25 03:22:52.356801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:197816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.407 [2024-04-25 03:22:52.356807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.407 [2024-04-25 03:22:52.356815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:197824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.407 [2024-04-25 03:22:52.356821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.407 [2024-04-25 03:22:52.356828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:197832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.407 [2024-04-25 03:22:52.356835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.407 [2024-04-25 03:22:52.356842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:197840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.407 [2024-04-25 03:22:52.356848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.407 [2024-04-25 03:22:52.356861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:197848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.407 [2024-04-25 03:22:52.356867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.407 [2024-04-25 03:22:52.356875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:197856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.356882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.356889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:197864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.356895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.356904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:197872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.356911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.356918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:197880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.356924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.356932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:197888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.356938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.356946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:197896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.356952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.356960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:197904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.356966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.356973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:197912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.356979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.356987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:197920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.356993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.357000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:197928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.357007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.357014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:197936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.357026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.357035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:197944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.357041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.357053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:197952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.357060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.357067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:197960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.357074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.357084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:197968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.357090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.357097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:197976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.357103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.357111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:197984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.357117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.357125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:197992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.357131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.357139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:198000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.357145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.357153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:198008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.357159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.357167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:198016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.357173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.357180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:198024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.357187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.357194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:198032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.357200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.357207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:198040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.357213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.357221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:198048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.357227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.357235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:198056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.357241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.357251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:198064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.357257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.357265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:198072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.357271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.357279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:198080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.357285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.357293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:198088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.357298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.357306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:198096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.357312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.357319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:198104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.357325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.357333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:198112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.357339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.408 [2024-04-25 03:22:52.357346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:198120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.408 [2024-04-25 03:22:52.357352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:198128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:198136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:198144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:198152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:198160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:198168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:198176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:198184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:198192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:198200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:198208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:198216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:198224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:198232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:198240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:198248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:198256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:198264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:198272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:198280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:198288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:198296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:198304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:198312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:198320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:198328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:198336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:198344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:198352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:198360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:198368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:198376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:198384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:198392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:198400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.409 [2024-04-25 03:22:52.357847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.409 [2024-04-25 03:22:52.357861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:198408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.357867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.357875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:198416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.357881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.357888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:198424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.357895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.357902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:198432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.357908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.357916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:198440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.357924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.357933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:198448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.357939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.357948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:198456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.357954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.357962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:198464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.357968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.357976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:198472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.357982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.357989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:198480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.357995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.358003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:198488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.358009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.358017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:198496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.358023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.358031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:198504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.358037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.358044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:198512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.358050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.358058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:198520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.358064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.358071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:198528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.358077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.358085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:198536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.358091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.358098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:198544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.358104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.358113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:198552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.358119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.358128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:198560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.358134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.358141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:198568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.358150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.358158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:198576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.358164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.358171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:198584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.358178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.358185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:198592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.358191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.358199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:198600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.358205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.358212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:198608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.358219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.358227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:198616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.358234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.358241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:198624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.358248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.358256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:198632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.358262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.358269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:198640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.358275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.358283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:198648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:44.410 [2024-04-25 03:22:52.358290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.358298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:197632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079fe000 len:0x1000 key:0x771a19a9 00:23:44.410 [2024-04-25 03:22:52.358305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.358313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:197640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079fc000 len:0x1000 key:0x771a19a9 00:23:44.410 [2024-04-25 03:22:52.358319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.358327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:197648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079fa000 len:0x1000 key:0x771a19a9 00:23:44.410 [2024-04-25 03:22:52.358333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.358341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:197656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079f8000 len:0x1000 key:0x771a19a9 00:23:44.410 [2024-04-25 03:22:52.358348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32701 cdw0:1b53ea80 sqhd:b530 p:0 m:0 dnr:0 00:23:44.410 [2024-04-25 03:22:52.371069] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:23:44.410 [2024-04-25 03:22:52.371080] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:23:44.410 [2024-04-25 03:22:52.371086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:197664 len:8 PRP1 0x0 PRP2 0x0 00:23:44.411 [2024-04-25 03:22:52.371093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:44.411 [2024-04-25 03:22:52.371135] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_1] resetting controller 00:23:44.411 [2024-04-25 03:22:52.371421] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:23:44.411 [2024-04-25 03:22:52.371431] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:23:44.411 [2024-04-25 03:22:52.371436] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:23:44.411 [2024-04-25 03:22:52.371450] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:23:44.411 [2024-04-25 03:22:52.371457] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_1] in failed state. 00:23:44.411 [2024-04-25 03:22:52.371469] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_1] Ctrlr is in error state 00:23:44.411 [2024-04-25 03:22:52.371475] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_1] controller reinitialization failed 00:23:44.411 [2024-04-25 03:22:52.371482] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_1] already in failed state 00:23:44.411 [2024-04-25 03:22:52.371500] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:44.411 [2024-04-25 03:22:52.371507] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_1] resetting controller 00:23:44.411 [2024-04-25 03:22:52.486748] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -101) 00:23:44.411 [2024-04-25 03:22:52.486766] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:23:44.411 [2024-04-25 03:22:52.486776] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:23:44.411 [2024-04-25 03:22:52.486792] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:23:44.411 [2024-04-25 03:22:52.486799] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_0] in failed state. 00:23:44.411 [2024-04-25 03:22:52.486808] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_0] Ctrlr is in error state 00:23:44.411 [2024-04-25 03:22:52.486815] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_0] controller reinitialization failed 00:23:44.411 [2024-04-25 03:22:52.486821] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_0] already in failed state 00:23:44.411 [2024-04-25 03:22:52.486836] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:44.411 [2024-04-25 03:22:52.486843] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_0] resetting controller 00:23:44.411 [2024-04-25 03:22:53.550782] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:23:44.411 [2024-04-25 03:22:54.376520] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:23:44.411 [2024-04-25 03:22:54.376543] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:23:44.411 [2024-04-25 03:22:54.376582] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:23:44.411 [2024-04-25 03:22:54.376590] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_1] in failed state. 00:23:44.411 [2024-04-25 03:22:54.376601] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_1] Ctrlr is in error state 00:23:44.411 [2024-04-25 03:22:54.376607] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_1] controller reinitialization failed 00:23:44.411 [2024-04-25 03:22:54.376614] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_1] already in failed state 00:23:44.411 [2024-04-25 03:22:54.376632] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:23:44.411 [2024-04-25 03:22:54.376639] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_1] resetting controller 00:23:44.411 [2024-04-25 03:22:55.435951] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:23:44.411 00:23:44.411 Latency(us) 00:23:44.411 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:44.411 Job: Nvme_cvl_0_0n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:23:44.411 Verification LBA range: start 0x0 length 0x8000 00:23:44.411 Nvme_cvl_0_0n1 : 90.01 11394.71 44.51 0.00 0.00 11213.84 2262.55 4058488.44 00:23:44.411 Job: Nvme_cvl_0_1n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:23:44.411 Verification LBA range: start 0x0 length 0x8000 00:23:44.411 Nvme_cvl_0_1n1 : 90.01 11343.72 44.31 0.00 0.00 11263.85 2137.72 4042510.14 00:23:44.411 =================================================================================================================== 00:23:44.411 Total : 22738.43 88.82 0.00 0.00 11238.79 2137.72 4058488.44 00:23:44.411 Received shutdown signal, test time was about 90.000000 seconds 00:23:44.411 00:23:44.411 Latency(us) 00:23:44.411 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:44.411 =================================================================================================================== 00:23:44.411 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:23:44.411 03:24:15 -- target/device_removal.sh@123 -- # trap - SIGINT SIGTERM EXIT 00:23:44.411 03:24:15 -- target/device_removal.sh@124 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/try.txt 00:23:44.411 03:24:15 -- target/device_removal.sh@202 -- # killprocess 4155092 00:23:44.411 03:24:15 -- common/autotest_common.sh@936 -- # '[' -z 4155092 ']' 00:23:44.411 03:24:15 -- common/autotest_common.sh@940 -- # kill -0 4155092 00:23:44.411 03:24:15 -- common/autotest_common.sh@941 -- # uname 00:23:44.411 03:24:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:44.411 03:24:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4155092 00:23:44.411 03:24:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:44.411 03:24:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:44.411 03:24:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4155092' 00:23:44.411 killing process with pid 4155092 00:23:44.411 03:24:16 -- common/autotest_common.sh@955 -- # kill 4155092 00:23:44.411 03:24:16 -- common/autotest_common.sh@960 -- # wait 4155092 00:23:44.411 [2024-04-25 03:24:16.069861] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:23:44.411 03:24:16 -- target/device_removal.sh@203 -- # nvmfpid= 00:23:44.411 03:24:16 -- target/device_removal.sh@205 -- # return 0 00:23:44.411 00:23:44.411 real 1m33.130s 00:23:44.411 user 4m37.104s 00:23:44.411 sys 0m1.649s 00:23:44.411 03:24:16 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:23:44.411 03:24:16 -- common/autotest_common.sh@10 -- # set +x 00:23:44.411 ************************************ 00:23:44.411 END TEST nvmf_device_removal_pci_remove 00:23:44.411 ************************************ 00:23:44.411 03:24:16 -- target/device_removal.sh@317 -- # nvmftestfini 00:23:44.411 03:24:16 -- nvmf/common.sh@477 -- # nvmfcleanup 00:23:44.411 03:24:16 -- nvmf/common.sh@117 -- # sync 00:23:44.411 03:24:16 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:23:44.411 03:24:16 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:23:44.411 03:24:16 -- nvmf/common.sh@120 -- # set +e 00:23:44.411 03:24:16 -- nvmf/common.sh@121 -- # for i in {1..20} 00:23:44.411 03:24:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:23:44.411 rmmod nvme_rdma 00:23:44.411 rmmod nvme_fabrics 00:23:44.411 03:24:16 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:23:44.411 03:24:16 -- nvmf/common.sh@124 -- # set -e 00:23:44.411 03:24:16 -- nvmf/common.sh@125 -- # return 0 00:23:44.411 03:24:16 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:23:44.411 03:24:16 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:23:44.411 03:24:16 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:23:44.411 03:24:16 -- target/device_removal.sh@318 -- # clean_bond_device 00:23:44.411 03:24:16 -- target/device_removal.sh@240 -- # ip link 00:23:44.411 03:24:16 -- target/device_removal.sh@240 -- # grep bond_nvmf 00:23:44.411 00:23:44.411 real 3m12.786s 00:23:44.411 user 9m16.257s 00:23:44.411 sys 0m8.029s 00:23:44.411 03:24:16 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:23:44.411 03:24:16 -- common/autotest_common.sh@10 -- # set +x 00:23:44.411 ************************************ 00:23:44.411 END TEST nvmf_device_removal 00:23:44.411 ************************************ 00:23:44.411 03:24:16 -- nvmf/nvmf.sh@79 -- # run_test nvmf_srq_overwhelm /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/srq_overwhelm.sh --transport=rdma 00:23:44.411 03:24:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:44.411 03:24:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:44.411 03:24:16 -- common/autotest_common.sh@10 -- # set +x 00:23:44.411 ************************************ 00:23:44.411 START TEST nvmf_srq_overwhelm 00:23:44.411 ************************************ 00:23:44.411 03:24:16 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/srq_overwhelm.sh --transport=rdma 00:23:44.411 * Looking for test storage... 00:23:44.411 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:23:44.411 03:24:16 -- target/srq_overwhelm.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:23:44.412 03:24:16 -- nvmf/common.sh@7 -- # uname -s 00:23:44.412 03:24:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:44.412 03:24:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:44.412 03:24:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:44.412 03:24:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:44.412 03:24:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:44.412 03:24:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:44.412 03:24:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:44.412 03:24:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:44.412 03:24:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:44.412 03:24:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:44.412 03:24:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:23:44.412 03:24:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:23:44.412 03:24:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:44.412 03:24:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:44.412 03:24:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:44.412 03:24:16 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:23:44.412 03:24:16 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:23:44.412 03:24:16 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:44.412 03:24:16 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:44.412 03:24:16 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:44.412 03:24:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:44.412 03:24:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:44.412 03:24:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:44.412 03:24:16 -- paths/export.sh@5 -- # export PATH 00:23:44.412 03:24:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:44.412 03:24:16 -- nvmf/common.sh@47 -- # : 0 00:23:44.412 03:24:16 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:23:44.412 03:24:16 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:23:44.412 03:24:16 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:23:44.412 03:24:16 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:44.412 03:24:16 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:44.412 03:24:16 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:23:44.412 03:24:16 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:23:44.412 03:24:16 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:23:44.412 03:24:16 -- target/srq_overwhelm.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:44.412 03:24:16 -- target/srq_overwhelm.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:44.412 03:24:16 -- target/srq_overwhelm.sh@13 -- # NVME_CONNECT='nvme connect -i 16' 00:23:44.412 03:24:16 -- target/srq_overwhelm.sh@15 -- # nvmftestinit 00:23:44.412 03:24:16 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:23:44.412 03:24:16 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:44.412 03:24:16 -- nvmf/common.sh@437 -- # prepare_net_devs 00:23:44.412 03:24:16 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:23:44.412 03:24:16 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:23:44.412 03:24:16 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:44.412 03:24:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:44.412 03:24:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:44.412 03:24:16 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:23:44.412 03:24:16 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:23:44.412 03:24:16 -- nvmf/common.sh@285 -- # xtrace_disable 00:23:44.412 03:24:16 -- common/autotest_common.sh@10 -- # set +x 00:23:48.605 03:24:22 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:48.605 03:24:22 -- nvmf/common.sh@291 -- # pci_devs=() 00:23:48.605 03:24:22 -- nvmf/common.sh@291 -- # local -a pci_devs 00:23:48.605 03:24:22 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:23:48.605 03:24:22 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:23:48.605 03:24:22 -- nvmf/common.sh@293 -- # pci_drivers=() 00:23:48.605 03:24:22 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:23:48.605 03:24:22 -- nvmf/common.sh@295 -- # net_devs=() 00:23:48.605 03:24:22 -- nvmf/common.sh@295 -- # local -ga net_devs 00:23:48.605 03:24:22 -- nvmf/common.sh@296 -- # e810=() 00:23:48.605 03:24:22 -- nvmf/common.sh@296 -- # local -ga e810 00:23:48.605 03:24:22 -- nvmf/common.sh@297 -- # x722=() 00:23:48.605 03:24:22 -- nvmf/common.sh@297 -- # local -ga x722 00:23:48.605 03:24:22 -- nvmf/common.sh@298 -- # mlx=() 00:23:48.605 03:24:22 -- nvmf/common.sh@298 -- # local -ga mlx 00:23:48.605 03:24:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:48.605 03:24:22 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:48.605 03:24:22 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:48.605 03:24:22 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:48.605 03:24:22 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:48.605 03:24:22 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:48.605 03:24:22 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:48.605 03:24:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:48.605 03:24:22 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:48.605 03:24:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:48.606 03:24:22 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:48.606 03:24:22 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:23:48.606 03:24:22 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:23:48.606 03:24:22 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:23:48.606 03:24:22 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:23:48.606 03:24:22 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:23:48.606 03:24:22 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:23:48.606 03:24:22 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:23:48.606 03:24:22 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:23:48.606 03:24:22 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:23:48.606 03:24:22 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:23:48.606 Found 0000:af:00.0 (0x8086 - 0x159b) 00:23:48.606 03:24:22 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:23:48.606 03:24:22 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:23:48.606 03:24:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:48.606 03:24:22 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:48.606 03:24:22 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:23:48.606 03:24:22 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:23:48.606 03:24:22 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:23:48.606 03:24:22 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:23:48.606 Found 0000:af:00.1 (0x8086 - 0x159b) 00:23:48.606 03:24:22 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:23:48.606 03:24:22 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:23:48.606 03:24:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:48.606 03:24:22 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:48.606 03:24:22 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:23:48.606 03:24:22 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:23:48.606 03:24:22 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:23:48.606 03:24:22 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:23:48.606 03:24:22 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:23:48.606 03:24:22 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:23:48.606 03:24:22 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:23:48.606 03:24:22 -- nvmf/common.sh@377 -- # modinfo irdma 00:23:48.606 03:24:22 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:23:48.606 03:24:22 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:23:48.606 03:24:22 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:48.606 03:24:22 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:23:48.606 03:24:22 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:48.606 03:24:22 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:23:48.606 Found net devices under 0000:af:00.0: cvl_0_0 00:23:48.606 03:24:22 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:23:48.606 03:24:22 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:23:48.606 03:24:22 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:48.606 03:24:22 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:23:48.606 03:24:22 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:48.606 03:24:22 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:23:48.606 Found net devices under 0000:af:00.1: cvl_0_1 00:23:48.606 03:24:22 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:23:48.606 03:24:22 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:23:48.606 03:24:22 -- nvmf/common.sh@403 -- # is_hw=yes 00:23:48.606 03:24:22 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:23:48.606 03:24:22 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:23:48.606 03:24:22 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:23:48.606 03:24:22 -- nvmf/common.sh@409 -- # rdma_device_init 00:23:48.606 03:24:22 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:23:48.606 03:24:22 -- nvmf/common.sh@58 -- # uname 00:23:48.606 03:24:22 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:23:48.606 03:24:22 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:23:48.606 03:24:22 -- nvmf/common.sh@63 -- # modprobe ib_core 00:23:48.606 03:24:22 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:23:48.606 03:24:22 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:23:48.606 03:24:22 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:23:48.606 03:24:22 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:23:48.606 03:24:22 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:23:48.606 03:24:22 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:23:48.606 03:24:22 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:23:48.606 03:24:22 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:23:48.606 03:24:22 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:23:48.606 03:24:22 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:23:48.606 03:24:22 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:23:48.606 03:24:22 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:23:48.606 03:24:22 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:23:48.606 03:24:22 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:48.606 03:24:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:48.606 03:24:22 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:23:48.606 03:24:22 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:23:48.606 03:24:22 -- nvmf/common.sh@105 -- # continue 2 00:23:48.606 03:24:22 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:48.606 03:24:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:48.606 03:24:22 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:23:48.606 03:24:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:48.606 03:24:22 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:23:48.606 03:24:22 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:23:48.606 03:24:22 -- nvmf/common.sh@105 -- # continue 2 00:23:48.606 03:24:22 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:23:48.606 03:24:22 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:23:48.606 03:24:22 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:23:48.606 03:24:22 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:23:48.606 03:24:22 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:48.606 03:24:22 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:48.606 03:24:22 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:23:48.606 03:24:22 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:23:48.606 03:24:22 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:23:48.606 50: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:23:48.606 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:23:48.606 altname enp175s0f0np0 00:23:48.606 altname ens801f0np0 00:23:48.606 inet 192.168.100.8/24 scope global cvl_0_0 00:23:48.606 valid_lft forever preferred_lft forever 00:23:48.606 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:23:48.606 valid_lft forever preferred_lft forever 00:23:48.606 03:24:22 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:23:48.606 03:24:22 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:23:48.606 03:24:22 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:23:48.606 03:24:22 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:23:48.607 03:24:22 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:48.607 03:24:22 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:48.607 03:24:22 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:23:48.607 03:24:22 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:23:48.607 03:24:22 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:23:48.607 51: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:23:48.607 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:23:48.607 altname enp175s0f1np1 00:23:48.607 altname ens801f1np1 00:23:48.607 inet 192.168.100.9/24 scope global cvl_0_1 00:23:48.607 valid_lft forever preferred_lft forever 00:23:48.607 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:23:48.607 valid_lft forever preferred_lft forever 00:23:48.607 03:24:22 -- nvmf/common.sh@411 -- # return 0 00:23:48.607 03:24:22 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:23:48.607 03:24:22 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:23:48.607 03:24:22 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:23:48.607 03:24:22 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:23:48.607 03:24:22 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:23:48.607 03:24:22 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:23:48.607 03:24:22 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:23:48.607 03:24:22 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:23:48.607 03:24:22 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:23:48.607 03:24:22 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:23:48.607 03:24:22 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:48.607 03:24:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:48.607 03:24:22 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:23:48.607 03:24:22 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:23:48.607 03:24:22 -- nvmf/common.sh@105 -- # continue 2 00:23:48.607 03:24:22 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:48.607 03:24:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:48.607 03:24:22 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:23:48.607 03:24:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:48.607 03:24:22 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:23:48.607 03:24:22 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:23:48.607 03:24:22 -- nvmf/common.sh@105 -- # continue 2 00:23:48.607 03:24:22 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:23:48.607 03:24:22 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:23:48.607 03:24:22 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:23:48.607 03:24:22 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:23:48.607 03:24:22 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:48.607 03:24:22 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:48.607 03:24:22 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:23:48.607 03:24:22 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:23:48.607 03:24:22 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:23:48.607 03:24:22 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:23:48.607 03:24:22 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:48.607 03:24:22 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:48.607 03:24:22 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:23:48.607 192.168.100.9' 00:23:48.607 03:24:22 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:23:48.607 192.168.100.9' 00:23:48.607 03:24:22 -- nvmf/common.sh@446 -- # head -n 1 00:23:48.607 03:24:22 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:23:48.607 03:24:22 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:23:48.607 192.168.100.9' 00:23:48.607 03:24:22 -- nvmf/common.sh@447 -- # tail -n +2 00:23:48.607 03:24:22 -- nvmf/common.sh@447 -- # head -n 1 00:23:48.607 03:24:22 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:23:48.607 03:24:22 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:23:48.607 03:24:22 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:23:48.607 03:24:22 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:23:48.607 03:24:22 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:23:48.607 03:24:22 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:23:48.607 03:24:22 -- target/srq_overwhelm.sh@17 -- # nvmfappstart -m 0xF 00:23:48.607 03:24:22 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:23:48.607 03:24:22 -- common/autotest_common.sh@710 -- # xtrace_disable 00:23:48.607 03:24:22 -- common/autotest_common.sh@10 -- # set +x 00:23:48.607 03:24:22 -- nvmf/common.sh@470 -- # nvmfpid=4174402 00:23:48.607 03:24:22 -- nvmf/common.sh@471 -- # waitforlisten 4174402 00:23:48.607 03:24:22 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:48.607 03:24:22 -- common/autotest_common.sh@817 -- # '[' -z 4174402 ']' 00:23:48.607 03:24:22 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:48.607 03:24:22 -- common/autotest_common.sh@822 -- # local max_retries=100 00:23:48.607 03:24:22 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:48.607 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:48.607 03:24:22 -- common/autotest_common.sh@826 -- # xtrace_disable 00:23:48.607 03:24:22 -- common/autotest_common.sh@10 -- # set +x 00:23:48.607 [2024-04-25 03:24:22.740714] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:23:48.607 [2024-04-25 03:24:22.740759] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:48.607 EAL: No free 2048 kB hugepages reported on node 1 00:23:48.607 [2024-04-25 03:24:22.801146] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:48.607 [2024-04-25 03:24:22.870815] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:48.607 [2024-04-25 03:24:22.870860] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:48.607 [2024-04-25 03:24:22.870867] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:23:48.607 [2024-04-25 03:24:22.870872] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:23:48.607 [2024-04-25 03:24:22.870877] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:48.607 [2024-04-25 03:24:22.870952] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:48.607 [2024-04-25 03:24:22.871048] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:48.607 [2024-04-25 03:24:22.871119] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:48.607 [2024-04-25 03:24:22.871119] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:49.173 03:24:23 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:23:49.173 03:24:23 -- common/autotest_common.sh@850 -- # return 0 00:23:49.173 03:24:23 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:23:49.174 03:24:23 -- common/autotest_common.sh@716 -- # xtrace_disable 00:23:49.174 03:24:23 -- common/autotest_common.sh@10 -- # set +x 00:23:49.174 03:24:23 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:49.174 03:24:23 -- target/srq_overwhelm.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -s 1024 00:23:49.174 03:24:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:49.174 03:24:23 -- common/autotest_common.sh@10 -- # set +x 00:23:49.174 [2024-04-25 03:24:23.587516] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x15f7ea0/0x15f74e0) succeed. 00:23:49.174 [2024-04-25 03:24:23.597580] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x15f9210/0x15f7a60) succeed. 00:23:49.174 [2024-04-25 03:24:23.597603] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:23:49.174 03:24:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:49.174 03:24:23 -- target/srq_overwhelm.sh@22 -- # seq 0 5 00:23:49.174 03:24:23 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:23:49.174 03:24:23 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK00000000000000 00:23:49.174 03:24:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:49.174 03:24:23 -- common/autotest_common.sh@10 -- # set +x 00:23:49.174 03:24:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:49.174 03:24:23 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:49.174 03:24:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:49.174 03:24:23 -- common/autotest_common.sh@10 -- # set +x 00:23:49.174 Malloc0 00:23:49.174 03:24:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:49.174 03:24:23 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Malloc0 00:23:49.174 03:24:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:49.174 03:24:23 -- common/autotest_common.sh@10 -- # set +x 00:23:49.174 03:24:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:49.174 03:24:23 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:23:49.174 03:24:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:49.174 03:24:23 -- common/autotest_common.sh@10 -- # set +x 00:23:49.174 [2024-04-25 03:24:23.660625] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:23:49.174 03:24:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:49.174 03:24:23 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode0 -a 192.168.100.8 -s 4420 00:23:49.432 03:24:23 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme0n1 00:23:49.432 03:24:23 -- common/autotest_common.sh@1221 -- # local i=0 00:23:49.432 03:24:23 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:23:49.432 03:24:23 -- common/autotest_common.sh@1222 -- # grep -q -w nvme0n1 00:23:49.432 03:24:23 -- common/autotest_common.sh@1228 -- # grep -q -w nvme0n1 00:23:49.432 03:24:23 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:23:49.432 03:24:23 -- common/autotest_common.sh@1232 -- # return 0 00:23:49.432 03:24:23 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:23:49.432 03:24:23 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:49.432 03:24:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:49.432 03:24:23 -- common/autotest_common.sh@10 -- # set +x 00:23:49.432 03:24:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:49.432 03:24:23 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:23:49.432 03:24:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:49.432 03:24:23 -- common/autotest_common.sh@10 -- # set +x 00:23:49.432 Malloc1 00:23:49.432 03:24:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:49.432 03:24:23 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:23:49.432 03:24:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:49.432 03:24:23 -- common/autotest_common.sh@10 -- # set +x 00:23:49.691 03:24:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:49.691 03:24:23 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:23:49.691 03:24:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:49.691 03:24:23 -- common/autotest_common.sh@10 -- # set +x 00:23:49.691 03:24:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:49.691 03:24:23 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:23:49.691 03:24:24 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme1n1 00:23:49.691 03:24:24 -- common/autotest_common.sh@1221 -- # local i=0 00:23:49.691 03:24:24 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:23:49.691 03:24:24 -- common/autotest_common.sh@1222 -- # grep -q -w nvme1n1 00:23:49.691 03:24:24 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:23:49.691 03:24:24 -- common/autotest_common.sh@1228 -- # grep -q -w nvme1n1 00:23:49.691 03:24:24 -- common/autotest_common.sh@1232 -- # return 0 00:23:49.691 03:24:24 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:23:49.691 03:24:24 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:23:49.691 03:24:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:49.691 03:24:24 -- common/autotest_common.sh@10 -- # set +x 00:23:49.691 03:24:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:49.691 03:24:24 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:23:49.691 03:24:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:49.691 03:24:24 -- common/autotest_common.sh@10 -- # set +x 00:23:49.949 Malloc2 00:23:49.949 03:24:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:49.949 03:24:24 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:23:49.949 03:24:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:49.949 03:24:24 -- common/autotest_common.sh@10 -- # set +x 00:23:49.949 03:24:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:49.949 03:24:24 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:23:49.949 03:24:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:49.949 03:24:24 -- common/autotest_common.sh@10 -- # set +x 00:23:49.949 03:24:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:49.949 03:24:24 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode2 -a 192.168.100.8 -s 4420 00:23:49.949 03:24:24 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme2n1 00:23:49.949 03:24:24 -- common/autotest_common.sh@1221 -- # local i=0 00:23:49.949 03:24:24 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:23:49.949 03:24:24 -- common/autotest_common.sh@1222 -- # grep -q -w nvme2n1 00:23:49.949 03:24:24 -- common/autotest_common.sh@1228 -- # grep -q -w nvme2n1 00:23:49.949 03:24:24 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:23:49.949 03:24:24 -- common/autotest_common.sh@1232 -- # return 0 00:23:49.949 03:24:24 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:23:49.949 03:24:24 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:23:49.949 03:24:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:49.949 03:24:24 -- common/autotest_common.sh@10 -- # set +x 00:23:50.207 03:24:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:50.207 03:24:24 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:23:50.207 03:24:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:50.207 03:24:24 -- common/autotest_common.sh@10 -- # set +x 00:23:50.207 Malloc3 00:23:50.207 03:24:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:50.207 03:24:24 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:23:50.207 03:24:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:50.207 03:24:24 -- common/autotest_common.sh@10 -- # set +x 00:23:50.207 03:24:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:50.207 03:24:24 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t rdma -a 192.168.100.8 -s 4420 00:23:50.207 03:24:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:50.207 03:24:24 -- common/autotest_common.sh@10 -- # set +x 00:23:50.207 03:24:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:50.207 03:24:24 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode3 -a 192.168.100.8 -s 4420 00:23:50.207 03:24:24 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme3n1 00:23:50.207 03:24:24 -- common/autotest_common.sh@1221 -- # local i=0 00:23:50.207 03:24:24 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:23:50.207 03:24:24 -- common/autotest_common.sh@1222 -- # grep -q -w nvme3n1 00:23:50.207 03:24:24 -- common/autotest_common.sh@1228 -- # grep -q -w nvme3n1 00:23:50.207 03:24:24 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:23:50.465 03:24:24 -- common/autotest_common.sh@1232 -- # return 0 00:23:50.465 03:24:24 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:23:50.465 03:24:24 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:23:50.465 03:24:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:50.465 03:24:24 -- common/autotest_common.sh@10 -- # set +x 00:23:50.465 03:24:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:50.465 03:24:24 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:23:50.465 03:24:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:50.465 03:24:24 -- common/autotest_common.sh@10 -- # set +x 00:23:50.465 Malloc4 00:23:50.465 03:24:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:50.465 03:24:24 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:23:50.465 03:24:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:50.465 03:24:24 -- common/autotest_common.sh@10 -- # set +x 00:23:50.465 03:24:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:50.465 03:24:24 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t rdma -a 192.168.100.8 -s 4420 00:23:50.465 03:24:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:50.465 03:24:24 -- common/autotest_common.sh@10 -- # set +x 00:23:50.465 03:24:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:50.465 03:24:24 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode4 -a 192.168.100.8 -s 4420 00:23:50.724 03:24:24 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme4n1 00:23:50.724 03:24:24 -- common/autotest_common.sh@1221 -- # local i=0 00:23:50.724 03:24:24 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:23:50.724 03:24:24 -- common/autotest_common.sh@1222 -- # grep -q -w nvme4n1 00:23:50.724 03:24:24 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:23:50.724 03:24:24 -- common/autotest_common.sh@1228 -- # grep -q -w nvme4n1 00:23:50.724 03:24:24 -- common/autotest_common.sh@1232 -- # return 0 00:23:50.724 03:24:24 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:23:50.724 03:24:24 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK00000000000005 00:23:50.724 03:24:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:50.724 03:24:24 -- common/autotest_common.sh@10 -- # set +x 00:23:50.724 03:24:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:50.724 03:24:25 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:23:50.724 03:24:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:50.724 03:24:25 -- common/autotest_common.sh@10 -- # set +x 00:23:50.724 Malloc5 00:23:50.724 03:24:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:50.724 03:24:25 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:23:50.724 03:24:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:50.724 03:24:25 -- common/autotest_common.sh@10 -- # set +x 00:23:50.724 03:24:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:50.724 03:24:25 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t rdma -a 192.168.100.8 -s 4420 00:23:50.724 03:24:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:50.724 03:24:25 -- common/autotest_common.sh@10 -- # set +x 00:23:50.724 03:24:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:50.724 03:24:25 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode5 -a 192.168.100.8 -s 4420 00:23:50.983 03:24:25 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme5n1 00:23:50.983 03:24:25 -- common/autotest_common.sh@1221 -- # local i=0 00:23:50.983 03:24:25 -- common/autotest_common.sh@1222 -- # grep -q -w nvme5n1 00:23:50.983 03:24:25 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:23:50.983 03:24:25 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:23:50.983 03:24:25 -- common/autotest_common.sh@1228 -- # grep -q -w nvme5n1 00:23:50.983 03:24:25 -- common/autotest_common.sh@1232 -- # return 0 00:23:50.983 03:24:25 -- target/srq_overwhelm.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 1048576 -d 128 -t read -r 10 -n 13 00:23:50.983 [global] 00:23:50.983 thread=1 00:23:50.983 invalidate=1 00:23:50.983 rw=read 00:23:50.983 time_based=1 00:23:50.983 runtime=10 00:23:50.983 ioengine=libaio 00:23:50.983 direct=1 00:23:50.983 bs=1048576 00:23:50.983 iodepth=128 00:23:50.983 norandommap=1 00:23:50.983 numjobs=13 00:23:50.983 00:23:50.983 [job0] 00:23:50.983 filename=/dev/nvme0n1 00:23:50.983 [job1] 00:23:50.983 filename=/dev/nvme2n1 00:23:50.983 [job2] 00:23:50.983 filename=/dev/nvme3n1 00:23:50.983 [job3] 00:23:50.983 filename=/dev/nvme4n1 00:23:50.983 [job4] 00:23:50.983 filename=/dev/nvme5n1 00:23:50.983 [job5] 00:23:50.983 filename=/dev/nvme6n1 00:23:50.983 Could not set queue depth (nvme0n1) 00:23:50.983 Could not set queue depth (nvme2n1) 00:23:50.983 Could not set queue depth (nvme3n1) 00:23:50.983 Could not set queue depth (nvme4n1) 00:23:50.983 Could not set queue depth (nvme5n1) 00:23:50.983 Could not set queue depth (nvme6n1) 00:23:51.241 job0: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:23:51.241 ... 00:23:51.241 job1: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:23:51.241 ... 00:23:51.241 job2: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:23:51.241 ... 00:23:51.241 job3: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:23:51.241 ... 00:23:51.241 job4: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:23:51.241 ... 00:23:51.241 job5: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:23:51.241 ... 00:23:51.241 fio-3.35 00:23:51.241 Starting 78 threads 00:24:03.442 00:24:03.442 job0: (groupid=0, jobs=1): err= 0: pid=4175082: Thu Apr 25 03:24:36 2024 00:24:03.442 read: IOPS=51, BW=51.2MiB/s (53.6MB/s)(517MiB/10105msec) 00:24:03.442 slat (usec): min=89, max=161257, avg=19339.80, stdev=20001.18 00:24:03.442 clat (msec): min=103, max=3373, avg=2203.14, stdev=726.64 00:24:03.442 lat (msec): min=105, max=3388, avg=2222.48, stdev=727.12 00:24:03.442 clat percentiles (msec): 00:24:03.442 | 1.00th=[ 171], 5.00th=[ 489], 10.00th=[ 969], 20.00th=[ 1955], 00:24:03.442 | 30.00th=[ 2089], 40.00th=[ 2165], 50.00th=[ 2265], 60.00th=[ 2467], 00:24:03.442 | 70.00th=[ 2601], 80.00th=[ 2735], 90.00th=[ 2970], 95.00th=[ 3205], 00:24:03.442 | 99.00th=[ 3339], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], 00:24:03.442 | 99.99th=[ 3373] 00:24:03.442 bw ( KiB/s): min=22528, max=77824, per=1.04%, avg=53240.60, stdev=14645.03, samples=15 00:24:03.443 iops : min= 22, max= 76, avg=51.93, stdev=14.30, samples=15 00:24:03.443 lat (msec) : 250=1.55%, 500=3.87%, 750=2.13%, 1000=2.51%, 2000=12.57% 00:24:03.443 lat (msec) : >=2000=77.37% 00:24:03.443 cpu : usr=0.02%, sys=1.06%, ctx=1724, majf=0, minf=32769 00:24:03.443 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.5%, 16=3.1%, 32=6.2%, >=64=87.8% 00:24:03.443 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.443 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:24:03.443 issued rwts: total=517,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.443 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.443 job0: (groupid=0, jobs=1): err= 0: pid=4175083: Thu Apr 25 03:24:36 2024 00:24:03.443 read: IOPS=48, BW=48.6MiB/s (51.0MB/s)(491MiB/10102msec) 00:24:03.443 slat (usec): min=378, max=120579, avg=20384.17, stdev=22618.90 00:24:03.443 clat (msec): min=91, max=2972, avg=2294.42, stdev=648.69 00:24:03.443 lat (msec): min=170, max=3031, avg=2314.80, stdev=648.45 00:24:03.443 clat percentiles (msec): 00:24:03.443 | 1.00th=[ 192], 5.00th=[ 651], 10.00th=[ 1167], 20.00th=[ 2106], 00:24:03.443 | 30.00th=[ 2467], 40.00th=[ 2500], 50.00th=[ 2534], 60.00th=[ 2567], 00:24:03.443 | 70.00th=[ 2635], 80.00th=[ 2668], 90.00th=[ 2735], 95.00th=[ 2802], 00:24:03.443 | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2970], 99.95th=[ 2970], 00:24:03.443 | 99.99th=[ 2970] 00:24:03.443 bw ( KiB/s): min= 8175, max=59392, per=0.91%, avg=46590.94, stdev=12073.49, samples=16 00:24:03.443 iops : min= 7, max= 58, avg=45.44, stdev=12.00, samples=16 00:24:03.443 lat (msec) : 100=0.20%, 250=0.81%, 500=3.05%, 750=2.24%, 1000=2.44% 00:24:03.443 lat (msec) : 2000=10.18%, >=2000=81.06% 00:24:03.443 cpu : usr=0.00%, sys=1.07%, ctx=1634, majf=0, minf=32769 00:24:03.443 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.3%, 32=6.5%, >=64=87.2% 00:24:03.443 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.443 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:24:03.443 issued rwts: total=491,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.443 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.443 job0: (groupid=0, jobs=1): err= 0: pid=4175084: Thu Apr 25 03:24:36 2024 00:24:03.443 read: IOPS=54, BW=54.9MiB/s (57.5MB/s)(554MiB/10100msec) 00:24:03.443 slat (usec): min=42, max=163211, avg=18062.73, stdev=21092.14 00:24:03.443 clat (msec): min=90, max=2773, avg=2145.57, stdev=552.88 00:24:03.443 lat (msec): min=101, max=2781, avg=2163.63, stdev=550.90 00:24:03.443 clat percentiles (msec): 00:24:03.443 | 1.00th=[ 186], 5.00th=[ 718], 10.00th=[ 1603], 20.00th=[ 1770], 00:24:03.443 | 30.00th=[ 2056], 40.00th=[ 2265], 50.00th=[ 2366], 60.00th=[ 2433], 00:24:03.443 | 70.00th=[ 2500], 80.00th=[ 2534], 90.00th=[ 2567], 95.00th=[ 2635], 00:24:03.443 | 99.00th=[ 2702], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], 00:24:03.443 | 99.99th=[ 2769] 00:24:03.443 bw ( KiB/s): min= 8192, max=108544, per=1.00%, avg=51440.94, stdev=21083.99, samples=17 00:24:03.443 iops : min= 8, max= 106, avg=50.24, stdev=20.59, samples=17 00:24:03.443 lat (msec) : 100=0.18%, 250=1.44%, 500=1.44%, 750=2.17%, 1000=1.26% 00:24:03.443 lat (msec) : 2000=21.30%, >=2000=72.20% 00:24:03.443 cpu : usr=0.01%, sys=1.10%, ctx=1550, majf=0, minf=32769 00:24:03.443 IO depths : 1=0.2%, 2=0.4%, 4=0.7%, 8=1.4%, 16=2.9%, 32=5.8%, >=64=88.6% 00:24:03.443 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.443 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.443 issued rwts: total=554,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.443 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.443 job0: (groupid=0, jobs=1): err= 0: pid=4175085: Thu Apr 25 03:24:36 2024 00:24:03.443 read: IOPS=65, BW=65.6MiB/s (68.7MB/s)(661MiB/10083msec) 00:24:03.443 slat (usec): min=32, max=113856, avg=15136.25, stdev=18422.19 00:24:03.443 clat (msec): min=74, max=2975, avg=1757.32, stdev=618.23 00:24:03.443 lat (msec): min=82, max=2998, avg=1772.46, stdev=619.16 00:24:03.443 clat percentiles (msec): 00:24:03.443 | 1.00th=[ 97], 5.00th=[ 827], 10.00th=[ 1167], 20.00th=[ 1284], 00:24:03.443 | 30.00th=[ 1351], 40.00th=[ 1452], 50.00th=[ 1703], 60.00th=[ 1838], 00:24:03.443 | 70.00th=[ 2198], 80.00th=[ 2366], 90.00th=[ 2635], 95.00th=[ 2769], 00:24:03.443 | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2970], 99.95th=[ 2970], 00:24:03.443 | 99.99th=[ 2970] 00:24:03.443 bw ( KiB/s): min=22528, max=124928, per=1.33%, avg=68332.88, stdev=32339.70, samples=16 00:24:03.443 iops : min= 22, max= 122, avg=66.69, stdev=31.61, samples=16 00:24:03.443 lat (msec) : 100=1.06%, 250=0.76%, 500=1.66%, 750=1.21%, 1000=0.91% 00:24:03.443 lat (msec) : 2000=60.67%, >=2000=33.74% 00:24:03.443 cpu : usr=0.00%, sys=1.08%, ctx=1569, majf=0, minf=32769 00:24:03.443 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.4%, 32=4.8%, >=64=90.5% 00:24:03.443 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.443 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.443 issued rwts: total=661,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.443 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.443 job0: (groupid=0, jobs=1): err= 0: pid=4175086: Thu Apr 25 03:24:36 2024 00:24:03.443 read: IOPS=142, BW=142MiB/s (149MB/s)(1439MiB/10103msec) 00:24:03.443 slat (usec): min=33, max=34483, avg=6946.93, stdev=6504.05 00:24:03.443 clat (msec): min=102, max=1038, avg=858.68, stdev=136.99 00:24:03.443 lat (msec): min=104, max=1047, avg=865.62, stdev=137.17 00:24:03.443 clat percentiles (msec): 00:24:03.443 | 1.00th=[ 194], 5.00th=[ 558], 10.00th=[ 810], 20.00th=[ 844], 00:24:03.443 | 30.00th=[ 877], 40.00th=[ 885], 50.00th=[ 894], 60.00th=[ 902], 00:24:03.443 | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 927], 95.00th=[ 953], 00:24:03.443 | 99.00th=[ 1028], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], 00:24:03.443 | 99.99th=[ 1036] 00:24:03.443 bw ( KiB/s): min=38912, max=163840, per=2.75%, avg=141404.26, stdev=25932.88, samples=19 00:24:03.443 iops : min= 38, max= 160, avg=138.05, stdev=25.32, samples=19 00:24:03.443 lat (msec) : 250=1.81%, 500=2.50%, 750=2.78%, 1000=90.41%, 2000=2.50% 00:24:03.443 cpu : usr=0.04%, sys=1.72%, ctx=1435, majf=0, minf=32769 00:24:03.443 IO depths : 1=0.1%, 2=0.1%, 4=0.3%, 8=0.6%, 16=1.1%, 32=2.2%, >=64=95.6% 00:24:03.443 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.443 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:03.443 issued rwts: total=1439,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.443 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.443 job0: (groupid=0, jobs=1): err= 0: pid=4175087: Thu Apr 25 03:24:36 2024 00:24:03.443 read: IOPS=54, BW=54.6MiB/s (57.2MB/s)(551MiB/10093msec) 00:24:03.443 slat (usec): min=30, max=118482, avg=18157.32, stdev=23072.75 00:24:03.443 clat (msec): min=86, max=2941, avg=2053.75, stdev=593.63 00:24:03.443 lat (msec): min=111, max=2956, avg=2071.90, stdev=593.49 00:24:03.443 clat percentiles (msec): 00:24:03.443 | 1.00th=[ 190], 5.00th=[ 718], 10.00th=[ 1267], 20.00th=[ 1653], 00:24:03.443 | 30.00th=[ 1871], 40.00th=[ 1972], 50.00th=[ 2165], 60.00th=[ 2265], 00:24:03.443 | 70.00th=[ 2433], 80.00th=[ 2567], 90.00th=[ 2735], 95.00th=[ 2802], 00:24:03.443 | 99.00th=[ 2903], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], 00:24:03.443 | 99.99th=[ 2937] 00:24:03.443 bw ( KiB/s): min=24576, max=112640, per=1.06%, avg=54272.00, stdev=21178.08, samples=16 00:24:03.443 iops : min= 24, max= 110, avg=53.00, stdev=20.68, samples=16 00:24:03.443 lat (msec) : 100=0.18%, 250=1.09%, 500=1.45%, 750=2.54%, 1000=1.81% 00:24:03.443 lat (msec) : 2000=35.03%, >=2000=57.89% 00:24:03.443 cpu : usr=0.00%, sys=0.96%, ctx=1531, majf=0, minf=32769 00:24:03.443 IO depths : 1=0.2%, 2=0.4%, 4=0.7%, 8=1.5%, 16=2.9%, 32=5.8%, >=64=88.6% 00:24:03.443 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.443 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.443 issued rwts: total=551,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.444 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.444 job0: (groupid=0, jobs=1): err= 0: pid=4175088: Thu Apr 25 03:24:36 2024 00:24:03.444 read: IOPS=55, BW=55.9MiB/s (58.6MB/s)(562MiB/10061msec) 00:24:03.444 slat (usec): min=29, max=115411, avg=17873.57, stdev=21574.46 00:24:03.444 clat (msec): min=13, max=2543, avg=1997.18, stdev=611.32 00:24:03.444 lat (msec): min=63, max=2565, avg=2015.05, stdev=611.59 00:24:03.444 clat percentiles (msec): 00:24:03.444 | 1.00th=[ 70], 5.00th=[ 334], 10.00th=[ 902], 20.00th=[ 1905], 00:24:03.444 | 30.00th=[ 2106], 40.00th=[ 2165], 50.00th=[ 2198], 60.00th=[ 2265], 00:24:03.444 | 70.00th=[ 2333], 80.00th=[ 2366], 90.00th=[ 2433], 95.00th=[ 2467], 00:24:03.444 | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2534], 99.95th=[ 2534], 00:24:03.444 | 99.99th=[ 2534] 00:24:03.444 bw ( KiB/s): min=14336, max=83968, per=1.05%, avg=53922.73, stdev=15911.13, samples=15 00:24:03.444 iops : min= 14, max= 82, avg=52.60, stdev=15.52, samples=15 00:24:03.444 lat (msec) : 20=0.18%, 100=2.67%, 250=1.07%, 500=2.49%, 750=2.14% 00:24:03.444 lat (msec) : 1000=2.14%, 2000=12.10%, >=2000=77.22% 00:24:03.444 cpu : usr=0.01%, sys=0.96%, ctx=1595, majf=0, minf=32769 00:24:03.444 IO depths : 1=0.2%, 2=0.4%, 4=0.7%, 8=1.4%, 16=2.8%, 32=5.7%, >=64=88.8% 00:24:03.444 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.444 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.444 issued rwts: total=562,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.444 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.444 job0: (groupid=0, jobs=1): err= 0: pid=4175089: Thu Apr 25 03:24:36 2024 00:24:03.444 read: IOPS=46, BW=46.8MiB/s (49.1MB/s)(472MiB/10084msec) 00:24:03.444 slat (usec): min=36, max=109027, avg=21193.38, stdev=20247.08 00:24:03.444 clat (msec): min=79, max=3282, avg=2373.82, stdev=661.63 00:24:03.444 lat (msec): min=99, max=3317, avg=2395.01, stdev=659.12 00:24:03.444 clat percentiles (msec): 00:24:03.444 | 1.00th=[ 197], 5.00th=[ 776], 10.00th=[ 1318], 20.00th=[ 2106], 00:24:03.444 | 30.00th=[ 2265], 40.00th=[ 2433], 50.00th=[ 2534], 60.00th=[ 2635], 00:24:03.444 | 70.00th=[ 2769], 80.00th=[ 2869], 90.00th=[ 3004], 95.00th=[ 3071], 00:24:03.444 | 99.00th=[ 3239], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3272], 00:24:03.444 | 99.99th=[ 3272] 00:24:03.444 bw ( KiB/s): min= 2048, max=71680, per=0.86%, avg=44160.00, stdev=18071.50, samples=16 00:24:03.444 iops : min= 2, max= 70, avg=43.13, stdev=17.65, samples=16 00:24:03.444 lat (msec) : 100=0.42%, 250=0.64%, 500=1.69%, 750=2.12%, 1000=1.69% 00:24:03.444 lat (msec) : 2000=9.53%, >=2000=83.90% 00:24:03.444 cpu : usr=0.01%, sys=0.98%, ctx=1745, majf=0, minf=32769 00:24:03.444 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.7%, 16=3.4%, 32=6.8%, >=64=86.7% 00:24:03.444 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.444 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:24:03.444 issued rwts: total=472,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.444 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.444 job0: (groupid=0, jobs=1): err= 0: pid=4175090: Thu Apr 25 03:24:36 2024 00:24:03.444 read: IOPS=98, BW=98.5MiB/s (103MB/s)(990MiB/10055msec) 00:24:03.444 slat (usec): min=40, max=96414, avg=10098.26, stdev=17803.63 00:24:03.444 clat (msec): min=53, max=2230, avg=1199.96, stdev=510.96 00:24:03.444 lat (msec): min=55, max=2243, avg=1210.06, stdev=513.30 00:24:03.444 clat percentiles (msec): 00:24:03.444 | 1.00th=[ 68], 5.00th=[ 309], 10.00th=[ 575], 20.00th=[ 760], 00:24:03.444 | 30.00th=[ 885], 40.00th=[ 1036], 50.00th=[ 1183], 60.00th=[ 1267], 00:24:03.444 | 70.00th=[ 1502], 80.00th=[ 1770], 90.00th=[ 1888], 95.00th=[ 2039], 00:24:03.444 | 99.00th=[ 2165], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], 00:24:03.444 | 99.99th=[ 2232] 00:24:03.444 bw ( KiB/s): min= 6144, max=188416, per=1.91%, avg=98190.22, stdev=54414.32, samples=18 00:24:03.444 iops : min= 6, max= 184, avg=95.89, stdev=53.14, samples=18 00:24:03.444 lat (msec) : 100=1.21%, 250=3.03%, 500=4.65%, 750=10.10%, 1000=16.57% 00:24:03.444 lat (msec) : 2000=58.59%, >=2000=5.86% 00:24:03.444 cpu : usr=0.04%, sys=1.29%, ctx=1618, majf=0, minf=32769 00:24:03.444 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.6%, 32=3.2%, >=64=93.6% 00:24:03.444 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.444 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:03.444 issued rwts: total=990,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.444 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.444 job0: (groupid=0, jobs=1): err= 0: pid=4175091: Thu Apr 25 03:24:36 2024 00:24:03.444 read: IOPS=51, BW=51.0MiB/s (53.5MB/s)(516MiB/10108msec) 00:24:03.444 slat (usec): min=28, max=117786, avg=19411.86, stdev=20280.81 00:24:03.444 clat (msec): min=89, max=3219, avg=2159.07, stdev=666.64 00:24:03.444 lat (msec): min=142, max=3223, avg=2178.48, stdev=666.56 00:24:03.444 clat percentiles (msec): 00:24:03.444 | 1.00th=[ 241], 5.00th=[ 609], 10.00th=[ 1133], 20.00th=[ 1871], 00:24:03.444 | 30.00th=[ 2039], 40.00th=[ 2165], 50.00th=[ 2265], 60.00th=[ 2366], 00:24:03.444 | 70.00th=[ 2433], 80.00th=[ 2601], 90.00th=[ 3071], 95.00th=[ 3138], 00:24:03.444 | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], 00:24:03.444 | 99.99th=[ 3205] 00:24:03.444 bw ( KiB/s): min=38912, max=104448, per=1.10%, avg=56758.86, stdev=16313.52, samples=14 00:24:03.444 iops : min= 38, max= 102, avg=55.43, stdev=15.93, samples=14 00:24:03.444 lat (msec) : 100=0.19%, 250=0.97%, 500=2.33%, 750=2.71%, 1000=2.52% 00:24:03.444 lat (msec) : 2000=18.80%, >=2000=72.48% 00:24:03.444 cpu : usr=0.03%, sys=0.93%, ctx=1590, majf=0, minf=32769 00:24:03.444 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.1%, 32=6.2%, >=64=87.8% 00:24:03.444 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.444 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:24:03.444 issued rwts: total=516,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.444 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.444 job0: (groupid=0, jobs=1): err= 0: pid=4175092: Thu Apr 25 03:24:36 2024 00:24:03.444 read: IOPS=95, BW=95.0MiB/s (99.6MB/s)(955MiB/10052msec) 00:24:03.444 slat (usec): min=35, max=116738, avg=10494.37, stdev=23181.78 00:24:03.444 clat (msec): min=26, max=2875, avg=1253.23, stdev=665.99 00:24:03.444 lat (msec): min=55, max=2888, avg=1263.72, stdev=669.55 00:24:03.444 clat percentiles (msec): 00:24:03.444 | 1.00th=[ 110], 5.00th=[ 676], 10.00th=[ 743], 20.00th=[ 776], 00:24:03.444 | 30.00th=[ 827], 40.00th=[ 877], 50.00th=[ 1003], 60.00th=[ 1083], 00:24:03.444 | 70.00th=[ 1217], 80.00th=[ 2022], 90.00th=[ 2400], 95.00th=[ 2635], 00:24:03.444 | 99.00th=[ 2802], 99.50th=[ 2836], 99.90th=[ 2869], 99.95th=[ 2869], 00:24:03.444 | 99.99th=[ 2869] 00:24:03.444 bw ( KiB/s): min=38912, max=176128, per=1.85%, avg=94930.82, stdev=51112.58, samples=17 00:24:03.444 iops : min= 38, max= 172, avg=92.71, stdev=49.91, samples=17 00:24:03.445 lat (msec) : 50=0.10%, 100=0.84%, 250=1.15%, 500=1.68%, 750=9.21% 00:24:03.445 lat (msec) : 1000=36.96%, 2000=29.32%, >=2000=20.73% 00:24:03.445 cpu : usr=0.05%, sys=1.35%, ctx=1370, majf=0, minf=32769 00:24:03.445 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.7%, 32=3.4%, >=64=93.4% 00:24:03.445 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.445 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:03.445 issued rwts: total=955,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.445 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.445 job0: (groupid=0, jobs=1): err= 0: pid=4175093: Thu Apr 25 03:24:36 2024 00:24:03.445 read: IOPS=52, BW=52.3MiB/s (54.8MB/s)(529MiB/10118msec) 00:24:03.445 slat (usec): min=68, max=182967, avg=18949.20, stdev=20228.76 00:24:03.445 clat (msec): min=91, max=2896, avg=2207.80, stdev=515.65 00:24:03.445 lat (msec): min=162, max=2942, avg=2226.75, stdev=513.19 00:24:03.445 clat percentiles (msec): 00:24:03.445 | 1.00th=[ 300], 5.00th=[ 944], 10.00th=[ 1401], 20.00th=[ 2022], 00:24:03.445 | 30.00th=[ 2265], 40.00th=[ 2333], 50.00th=[ 2366], 60.00th=[ 2433], 00:24:03.445 | 70.00th=[ 2467], 80.00th=[ 2534], 90.00th=[ 2601], 95.00th=[ 2635], 00:24:03.445 | 99.00th=[ 2802], 99.50th=[ 2869], 99.90th=[ 2903], 99.95th=[ 2903], 00:24:03.445 | 99.99th=[ 2903] 00:24:03.445 bw ( KiB/s): min=28672, max=77824, per=1.00%, avg=51320.56, stdev=12652.19, samples=16 00:24:03.445 iops : min= 28, max= 76, avg=50.06, stdev=12.32, samples=16 00:24:03.445 lat (msec) : 100=0.19%, 250=0.38%, 500=1.51%, 750=1.13%, 1000=2.08% 00:24:03.445 lat (msec) : 2000=11.53%, >=2000=83.18% 00:24:03.445 cpu : usr=0.01%, sys=1.03%, ctx=1675, majf=0, minf=32769 00:24:03.445 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.5%, 16=3.0%, 32=6.0%, >=64=88.1% 00:24:03.445 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.445 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.445 issued rwts: total=529,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.445 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.445 job0: (groupid=0, jobs=1): err= 0: pid=4175094: Thu Apr 25 03:24:36 2024 00:24:03.445 read: IOPS=50, BW=50.3MiB/s (52.8MB/s)(507MiB/10075msec) 00:24:03.445 slat (usec): min=34, max=108609, avg=19726.08, stdev=20736.20 00:24:03.445 clat (msec): min=71, max=3224, avg=2124.31, stdev=648.02 00:24:03.445 lat (msec): min=75, max=3242, avg=2144.04, stdev=648.81 00:24:03.445 clat percentiles (msec): 00:24:03.445 | 1.00th=[ 186], 5.00th=[ 567], 10.00th=[ 1053], 20.00th=[ 1921], 00:24:03.445 | 30.00th=[ 2005], 40.00th=[ 2123], 50.00th=[ 2232], 60.00th=[ 2400], 00:24:03.445 | 70.00th=[ 2500], 80.00th=[ 2567], 90.00th=[ 2668], 95.00th=[ 3071], 00:24:03.445 | 99.00th=[ 3138], 99.50th=[ 3205], 99.90th=[ 3239], 99.95th=[ 3239], 00:24:03.445 | 99.99th=[ 3239] 00:24:03.445 bw ( KiB/s): min=32768, max=87888, per=1.08%, avg=55539.79, stdev=12523.50, samples=14 00:24:03.445 iops : min= 32, max= 85, avg=54.14, stdev=12.08, samples=14 00:24:03.445 lat (msec) : 100=0.59%, 250=0.99%, 500=2.56%, 750=2.56%, 1000=2.76% 00:24:03.445 lat (msec) : 2000=19.33%, >=2000=71.20% 00:24:03.445 cpu : usr=0.03%, sys=0.89%, ctx=1664, majf=0, minf=32769 00:24:03.445 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.2%, 32=6.3%, >=64=87.6% 00:24:03.445 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.445 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:24:03.445 issued rwts: total=507,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.445 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.445 job1: (groupid=0, jobs=1): err= 0: pid=4175095: Thu Apr 25 03:24:36 2024 00:24:03.445 read: IOPS=63, BW=63.1MiB/s (66.2MB/s)(635MiB/10064msec) 00:24:03.445 slat (usec): min=46, max=107021, avg=15773.36, stdev=20167.43 00:24:03.445 clat (msec): min=45, max=2940, avg=1732.60, stdev=723.96 00:24:03.445 lat (msec): min=71, max=2947, avg=1748.37, stdev=726.36 00:24:03.445 clat percentiles (msec): 00:24:03.445 | 1.00th=[ 148], 5.00th=[ 634], 10.00th=[ 802], 20.00th=[ 986], 00:24:03.445 | 30.00th=[ 1267], 40.00th=[ 1418], 50.00th=[ 1737], 60.00th=[ 2089], 00:24:03.445 | 70.00th=[ 2366], 80.00th=[ 2467], 90.00th=[ 2601], 95.00th=[ 2769], 00:24:03.445 | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2937], 99.95th=[ 2937], 00:24:03.445 | 99.99th=[ 2937] 00:24:03.445 bw ( KiB/s): min=36864, max=208896, per=1.35%, avg=69168.60, stdev=45819.13, samples=15 00:24:03.445 iops : min= 36, max= 204, avg=67.53, stdev=44.75, samples=15 00:24:03.445 lat (msec) : 50=0.16%, 100=0.63%, 250=0.94%, 500=1.89%, 750=3.78% 00:24:03.445 lat (msec) : 1000=13.39%, 2000=36.54%, >=2000=42.68% 00:24:03.445 cpu : usr=0.02%, sys=0.93%, ctx=1646, majf=0, minf=32769 00:24:03.445 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.3%, 16=2.5%, 32=5.0%, >=64=90.1% 00:24:03.445 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.445 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.445 issued rwts: total=635,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.445 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.445 job1: (groupid=0, jobs=1): err= 0: pid=4175096: Thu Apr 25 03:24:36 2024 00:24:03.445 read: IOPS=25, BW=25.6MiB/s (26.9MB/s)(259MiB/10109msec) 00:24:03.445 slat (usec): min=88, max=417448, avg=38791.27, stdev=49888.80 00:24:03.445 clat (msec): min=60, max=6568, avg=3797.47, stdev=2177.42 00:24:03.445 lat (msec): min=117, max=6619, avg=3836.26, stdev=2181.73 00:24:03.445 clat percentiles (msec): 00:24:03.445 | 1.00th=[ 118], 5.00th=[ 220], 10.00th=[ 351], 20.00th=[ 835], 00:24:03.445 | 30.00th=[ 2534], 40.00th=[ 4396], 50.00th=[ 4665], 60.00th=[ 5067], 00:24:03.445 | 70.00th=[ 5470], 80.00th=[ 5671], 90.00th=[ 6141], 95.00th=[ 6342], 00:24:03.445 | 99.00th=[ 6544], 99.50th=[ 6544], 99.90th=[ 6544], 99.95th=[ 6544], 00:24:03.445 | 99.99th=[ 6544] 00:24:03.445 bw ( KiB/s): min= 4096, max=77824, per=0.47%, avg=24389.82, stdev=21054.69, samples=11 00:24:03.445 iops : min= 4, max= 76, avg=23.82, stdev=20.56, samples=11 00:24:03.445 lat (msec) : 100=0.39%, 250=5.79%, 500=6.95%, 750=5.79%, 1000=1.93% 00:24:03.445 lat (msec) : 2000=8.49%, >=2000=70.66% 00:24:03.445 cpu : usr=0.00%, sys=0.99%, ctx=1698, majf=0, minf=32769 00:24:03.445 IO depths : 1=0.4%, 2=0.8%, 4=1.5%, 8=3.1%, 16=6.2%, 32=12.4%, >=64=75.7% 00:24:03.445 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.445 complete : 0=0.0%, 4=99.2%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.8% 00:24:03.445 issued rwts: total=259,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.445 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.445 job1: (groupid=0, jobs=1): err= 0: pid=4175097: Thu Apr 25 03:24:36 2024 00:24:03.445 read: IOPS=46, BW=46.6MiB/s (48.9MB/s)(470MiB/10081msec) 00:24:03.445 slat (usec): min=33, max=115139, avg=21362.63, stdev=23172.56 00:24:03.445 clat (msec): min=38, max=3353, avg=2369.09, stdev=964.43 00:24:03.445 lat (msec): min=98, max=3420, avg=2390.46, stdev=967.61 00:24:03.445 clat percentiles (msec): 00:24:03.445 | 1.00th=[ 129], 5.00th=[ 409], 10.00th=[ 584], 20.00th=[ 1418], 00:24:03.445 | 30.00th=[ 2198], 40.00th=[ 2567], 50.00th=[ 2769], 60.00th=[ 2970], 00:24:03.445 | 70.00th=[ 3037], 80.00th=[ 3138], 90.00th=[ 3205], 95.00th=[ 3272], 00:24:03.445 | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], 00:24:03.445 | 99.99th=[ 3339] 00:24:03.445 bw ( KiB/s): min=22528, max=86016, per=0.91%, avg=46694.40, stdev=19074.22, samples=15 00:24:03.445 iops : min= 22, max= 84, avg=45.60, stdev=18.63, samples=15 00:24:03.445 lat (msec) : 50=0.21%, 100=0.21%, 250=2.55%, 500=4.89%, 750=5.11% 00:24:03.445 lat (msec) : 1000=3.83%, 2000=8.94%, >=2000=74.26% 00:24:03.445 cpu : usr=0.01%, sys=0.82%, ctx=1545, majf=0, minf=32769 00:24:03.445 IO depths : 1=0.2%, 2=0.4%, 4=0.9%, 8=1.7%, 16=3.4%, 32=6.8%, >=64=86.6% 00:24:03.445 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.445 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:24:03.446 issued rwts: total=470,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.446 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.446 job1: (groupid=0, jobs=1): err= 0: pid=4175098: Thu Apr 25 03:24:36 2024 00:24:03.446 read: IOPS=46, BW=46.7MiB/s (49.0MB/s)(471MiB/10082msec) 00:24:03.446 slat (usec): min=353, max=135992, avg=21228.85, stdev=22602.19 00:24:03.446 clat (msec): min=80, max=3348, avg=2446.52, stdev=764.85 00:24:03.446 lat (msec): min=129, max=3369, avg=2467.74, stdev=765.29 00:24:03.446 clat percentiles (msec): 00:24:03.446 | 1.00th=[ 194], 5.00th=[ 617], 10.00th=[ 1167], 20.00th=[ 1972], 00:24:03.446 | 30.00th=[ 2500], 40.00th=[ 2567], 50.00th=[ 2702], 60.00th=[ 2769], 00:24:03.446 | 70.00th=[ 2836], 80.00th=[ 3037], 90.00th=[ 3138], 95.00th=[ 3205], 00:24:03.446 | 99.00th=[ 3306], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], 00:24:03.446 | 99.99th=[ 3339] 00:24:03.446 bw ( KiB/s): min=26624, max=73728, per=0.91%, avg=46962.53, stdev=12156.75, samples=15 00:24:03.446 iops : min= 26, max= 72, avg=45.80, stdev=11.93, samples=15 00:24:03.446 lat (msec) : 100=0.21%, 250=1.27%, 500=2.55%, 750=2.55%, 1000=2.12% 00:24:03.446 lat (msec) : 2000=12.31%, >=2000=78.98% 00:24:03.446 cpu : usr=0.00%, sys=0.89%, ctx=1527, majf=0, minf=32769 00:24:03.446 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.7%, 16=3.4%, 32=6.8%, >=64=86.6% 00:24:03.446 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.446 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:24:03.446 issued rwts: total=471,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.446 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.446 job1: (groupid=0, jobs=1): err= 0: pid=4175099: Thu Apr 25 03:24:36 2024 00:24:03.446 read: IOPS=52, BW=52.7MiB/s (55.2MB/s)(534MiB/10138msec) 00:24:03.446 slat (usec): min=49, max=146492, avg=18840.80, stdev=23107.37 00:24:03.446 clat (msec): min=75, max=2972, avg=2162.84, stdev=615.84 00:24:03.446 lat (msec): min=163, max=2975, avg=2181.68, stdev=613.62 00:24:03.446 clat percentiles (msec): 00:24:03.446 | 1.00th=[ 330], 5.00th=[ 751], 10.00th=[ 1368], 20.00th=[ 1737], 00:24:03.446 | 30.00th=[ 1921], 40.00th=[ 2198], 50.00th=[ 2299], 60.00th=[ 2433], 00:24:03.446 | 70.00th=[ 2534], 80.00th=[ 2735], 90.00th=[ 2836], 95.00th=[ 2869], 00:24:03.446 | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], 00:24:03.446 | 99.99th=[ 2970] 00:24:03.446 bw ( KiB/s): min=14336, max=155648, per=1.01%, avg=51968.00, stdev=31094.32, samples=16 00:24:03.446 iops : min= 14, max= 152, avg=50.75, stdev=30.37, samples=16 00:24:03.446 lat (msec) : 100=0.19%, 250=0.56%, 500=1.50%, 750=2.81%, 1000=1.69% 00:24:03.446 lat (msec) : 2000=26.59%, >=2000=66.67% 00:24:03.446 cpu : usr=0.01%, sys=1.01%, ctx=1617, majf=0, minf=32769 00:24:03.446 IO depths : 1=0.2%, 2=0.4%, 4=0.7%, 8=1.5%, 16=3.0%, 32=6.0%, >=64=88.2% 00:24:03.446 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.446 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.446 issued rwts: total=534,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.446 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.446 job1: (groupid=0, jobs=1): err= 0: pid=4175100: Thu Apr 25 03:24:36 2024 00:24:03.446 read: IOPS=55, BW=55.7MiB/s (58.4MB/s)(560MiB/10054msec) 00:24:03.446 slat (usec): min=51, max=157224, avg=17856.48, stdev=23097.28 00:24:03.446 clat (msec): min=52, max=3842, avg=2179.60, stdev=973.50 00:24:03.446 lat (msec): min=61, max=3846, avg=2197.46, stdev=977.42 00:24:03.446 clat percentiles (msec): 00:24:03.446 | 1.00th=[ 178], 5.00th=[ 726], 10.00th=[ 1028], 20.00th=[ 1167], 00:24:03.446 | 30.00th=[ 1653], 40.00th=[ 1838], 50.00th=[ 2022], 60.00th=[ 2333], 00:24:03.446 | 70.00th=[ 2769], 80.00th=[ 3339], 90.00th=[ 3608], 95.00th=[ 3675], 00:24:03.446 | 99.00th=[ 3809], 99.50th=[ 3809], 99.90th=[ 3842], 99.95th=[ 3842], 00:24:03.446 | 99.99th=[ 3842] 00:24:03.446 bw ( KiB/s): min=24576, max=120832, per=0.96%, avg=49513.41, stdev=25592.17, samples=17 00:24:03.446 iops : min= 24, max= 118, avg=48.35, stdev=24.99, samples=17 00:24:03.446 lat (msec) : 100=0.89%, 250=0.54%, 500=2.32%, 750=1.25%, 1000=2.50% 00:24:03.446 lat (msec) : 2000=38.93%, >=2000=53.57% 00:24:03.446 cpu : usr=0.01%, sys=1.24%, ctx=1563, majf=0, minf=32769 00:24:03.446 IO depths : 1=0.2%, 2=0.4%, 4=0.7%, 8=1.4%, 16=2.9%, 32=5.7%, >=64=88.8% 00:24:03.446 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.446 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.446 issued rwts: total=560,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.446 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.446 job1: (groupid=0, jobs=1): err= 0: pid=4175101: Thu Apr 25 03:24:36 2024 00:24:03.446 read: IOPS=65, BW=65.6MiB/s (68.7MB/s)(663MiB/10114msec) 00:24:03.446 slat (usec): min=35, max=109340, avg=15185.69, stdev=20320.28 00:24:03.446 clat (msec): min=43, max=3130, avg=1671.76, stdev=822.89 00:24:03.446 lat (msec): min=114, max=3141, avg=1686.94, stdev=827.28 00:24:03.446 clat percentiles (msec): 00:24:03.446 | 1.00th=[ 121], 5.00th=[ 313], 10.00th=[ 518], 20.00th=[ 802], 00:24:03.446 | 30.00th=[ 1167], 40.00th=[ 1519], 50.00th=[ 1838], 60.00th=[ 1972], 00:24:03.446 | 70.00th=[ 2165], 80.00th=[ 2366], 90.00th=[ 2869], 95.00th=[ 2937], 00:24:03.446 | 99.00th=[ 3071], 99.50th=[ 3104], 99.90th=[ 3138], 99.95th=[ 3138], 00:24:03.446 | 99.99th=[ 3138] 00:24:03.446 bw ( KiB/s): min=22528, max=176128, per=1.42%, avg=73040.93, stdev=50023.82, samples=15 00:24:03.446 iops : min= 22, max= 172, avg=71.27, stdev=48.91, samples=15 00:24:03.446 lat (msec) : 50=0.15%, 250=4.68%, 500=4.52%, 750=6.94%, 1000=10.56% 00:24:03.446 lat (msec) : 2000=34.69%, >=2000=38.46% 00:24:03.446 cpu : usr=0.02%, sys=1.06%, ctx=1687, majf=0, minf=32769 00:24:03.446 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.4%, 32=4.8%, >=64=90.5% 00:24:03.446 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.446 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.446 issued rwts: total=663,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.446 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.446 job1: (groupid=0, jobs=1): err= 0: pid=4175102: Thu Apr 25 03:24:36 2024 00:24:03.446 read: IOPS=44, BW=44.7MiB/s (46.9MB/s)(450MiB/10058msec) 00:24:03.446 slat (usec): min=382, max=112619, avg=22224.53, stdev=21889.18 00:24:03.446 clat (msec): min=54, max=3340, avg=2453.79, stdev=910.50 00:24:03.446 lat (msec): min=57, max=3380, avg=2476.02, stdev=912.50 00:24:03.446 clat percentiles (msec): 00:24:03.446 | 1.00th=[ 67], 5.00th=[ 317], 10.00th=[ 743], 20.00th=[ 1821], 00:24:03.446 | 30.00th=[ 2567], 40.00th=[ 2702], 50.00th=[ 2769], 60.00th=[ 2802], 00:24:03.446 | 70.00th=[ 3004], 80.00th=[ 3138], 90.00th=[ 3239], 95.00th=[ 3306], 00:24:03.446 | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], 00:24:03.446 | 99.99th=[ 3339] 00:24:03.446 bw ( KiB/s): min=18432, max=75324, per=0.86%, avg=44070.13, stdev=13462.52, samples=15 00:24:03.446 iops : min= 18, max= 73, avg=43.00, stdev=13.05, samples=15 00:24:03.446 lat (msec) : 100=1.78%, 250=2.67%, 500=3.33%, 750=2.22%, 1000=2.44% 00:24:03.446 lat (msec) : 2000=9.56%, >=2000=78.00% 00:24:03.446 cpu : usr=0.00%, sys=0.91%, ctx=1594, majf=0, minf=32769 00:24:03.446 IO depths : 1=0.2%, 2=0.4%, 4=0.9%, 8=1.8%, 16=3.6%, 32=7.1%, >=64=86.0% 00:24:03.446 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.446 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:24:03.446 issued rwts: total=450,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.447 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.447 job1: (groupid=0, jobs=1): err= 0: pid=4175103: Thu Apr 25 03:24:36 2024 00:24:03.447 read: IOPS=49, BW=49.8MiB/s (52.2MB/s)(504MiB/10118msec) 00:24:03.447 slat (usec): min=34, max=115263, avg=19902.62, stdev=23141.10 00:24:03.447 clat (msec): min=84, max=2975, avg=2388.69, stdev=687.80 00:24:03.447 lat (msec): min=121, max=2995, avg=2408.59, stdev=687.39 00:24:03.447 clat percentiles (msec): 00:24:03.447 | 1.00th=[ 186], 5.00th=[ 642], 10.00th=[ 1217], 20.00th=[ 2140], 00:24:03.447 | 30.00th=[ 2467], 40.00th=[ 2635], 50.00th=[ 2668], 60.00th=[ 2702], 00:24:03.447 | 70.00th=[ 2769], 80.00th=[ 2836], 90.00th=[ 2903], 95.00th=[ 2937], 00:24:03.447 | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], 00:24:03.447 | 99.99th=[ 2970] 00:24:03.447 bw ( KiB/s): min=12288, max=65536, per=0.88%, avg=45296.94, stdev=13031.03, samples=17 00:24:03.447 iops : min= 12, max= 64, avg=44.24, stdev=12.73, samples=17 00:24:03.447 lat (msec) : 100=0.20%, 250=1.39%, 500=2.18%, 750=2.78%, 1000=1.59% 00:24:03.447 lat (msec) : 2000=9.92%, >=2000=81.94% 00:24:03.447 cpu : usr=0.01%, sys=1.05%, ctx=1594, majf=0, minf=32769 00:24:03.447 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.2%, 32=6.3%, >=64=87.5% 00:24:03.447 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.447 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:24:03.447 issued rwts: total=504,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.447 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.447 job1: (groupid=0, jobs=1): err= 0: pid=4175104: Thu Apr 25 03:24:36 2024 00:24:03.447 read: IOPS=43, BW=43.0MiB/s (45.1MB/s)(434MiB/10089msec) 00:24:03.447 slat (usec): min=35, max=103880, avg=23104.98, stdev=24761.59 00:24:03.447 clat (msec): min=59, max=3741, avg=2545.10, stdev=918.08 00:24:03.447 lat (msec): min=90, max=3749, avg=2568.20, stdev=919.32 00:24:03.447 clat percentiles (msec): 00:24:03.447 | 1.00th=[ 184], 5.00th=[ 464], 10.00th=[ 944], 20.00th=[ 1972], 00:24:03.447 | 30.00th=[ 2500], 40.00th=[ 2635], 50.00th=[ 2769], 60.00th=[ 3004], 00:24:03.447 | 70.00th=[ 3104], 80.00th=[ 3171], 90.00th=[ 3406], 95.00th=[ 3641], 00:24:03.447 | 99.00th=[ 3708], 99.50th=[ 3742], 99.90th=[ 3742], 99.95th=[ 3742], 00:24:03.447 | 99.99th=[ 3742] 00:24:03.447 bw ( KiB/s): min=22528, max=69632, per=0.81%, avg=41714.67, stdev=13962.64, samples=15 00:24:03.447 iops : min= 22, max= 68, avg=40.73, stdev=13.63, samples=15 00:24:03.447 lat (msec) : 100=0.46%, 250=1.61%, 500=4.61%, 750=2.30%, 1000=1.61% 00:24:03.447 lat (msec) : 2000=9.91%, >=2000=79.49% 00:24:03.447 cpu : usr=0.00%, sys=0.81%, ctx=1534, majf=0, minf=32769 00:24:03.447 IO depths : 1=0.2%, 2=0.5%, 4=0.9%, 8=1.8%, 16=3.7%, 32=7.4%, >=64=85.5% 00:24:03.447 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.447 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:24:03.447 issued rwts: total=434,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.447 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.447 job1: (groupid=0, jobs=1): err= 0: pid=4175105: Thu Apr 25 03:24:36 2024 00:24:03.447 read: IOPS=53, BW=53.7MiB/s (56.3MB/s)(541MiB/10067msec) 00:24:03.447 slat (usec): min=66, max=112666, avg=18487.92, stdev=23780.18 00:24:03.447 clat (msec): min=62, max=3430, avg=2255.75, stdev=859.13 00:24:03.447 lat (msec): min=67, max=3448, avg=2274.24, stdev=861.64 00:24:03.447 clat percentiles (msec): 00:24:03.447 | 1.00th=[ 84], 5.00th=[ 498], 10.00th=[ 919], 20.00th=[ 1502], 00:24:03.447 | 30.00th=[ 2039], 40.00th=[ 2299], 50.00th=[ 2400], 60.00th=[ 2567], 00:24:03.447 | 70.00th=[ 2769], 80.00th=[ 3004], 90.00th=[ 3272], 95.00th=[ 3306], 00:24:03.447 | 99.00th=[ 3406], 99.50th=[ 3440], 99.90th=[ 3440], 99.95th=[ 3440], 00:24:03.447 | 99.99th=[ 3440] 00:24:03.447 bw ( KiB/s): min=24576, max=94208, per=0.92%, avg=47099.22, stdev=15083.80, samples=18 00:24:03.447 iops : min= 24, max= 92, avg=45.94, stdev=14.75, samples=18 00:24:03.447 lat (msec) : 100=1.11%, 250=1.48%, 500=2.59%, 750=3.14%, 1000=2.59% 00:24:03.447 lat (msec) : 2000=18.67%, >=2000=70.43% 00:24:03.447 cpu : usr=0.00%, sys=1.10%, ctx=1522, majf=0, minf=32769 00:24:03.447 IO depths : 1=0.2%, 2=0.4%, 4=0.7%, 8=1.5%, 16=3.0%, 32=5.9%, >=64=88.4% 00:24:03.447 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.447 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.447 issued rwts: total=541,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.447 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.447 job1: (groupid=0, jobs=1): err= 0: pid=4175106: Thu Apr 25 03:24:36 2024 00:24:03.447 read: IOPS=66, BW=66.2MiB/s (69.4MB/s)(669MiB/10106msec) 00:24:03.447 slat (usec): min=43, max=122272, avg=14953.35, stdev=22557.34 00:24:03.447 clat (msec): min=99, max=2965, avg=1780.01, stdev=598.31 00:24:03.447 lat (msec): min=108, max=2993, avg=1794.97, stdev=598.74 00:24:03.447 clat percentiles (msec): 00:24:03.447 | 1.00th=[ 184], 5.00th=[ 743], 10.00th=[ 894], 20.00th=[ 1284], 00:24:03.447 | 30.00th=[ 1502], 40.00th=[ 1754], 50.00th=[ 1871], 60.00th=[ 2022], 00:24:03.447 | 70.00th=[ 2123], 80.00th=[ 2232], 90.00th=[ 2500], 95.00th=[ 2668], 00:24:03.447 | 99.00th=[ 2903], 99.50th=[ 2937], 99.90th=[ 2970], 99.95th=[ 2970], 00:24:03.447 | 99.99th=[ 2970] 00:24:03.447 bw ( KiB/s): min=30720, max=167936, per=1.27%, avg=65295.06, stdev=35707.24, samples=17 00:24:03.447 iops : min= 30, max= 164, avg=63.76, stdev=34.87, samples=17 00:24:03.447 lat (msec) : 100=0.15%, 250=1.35%, 500=1.35%, 750=2.39%, 1000=6.43% 00:24:03.447 lat (msec) : 2000=46.64%, >=2000=41.70% 00:24:03.447 cpu : usr=0.02%, sys=1.27%, ctx=1552, majf=0, minf=32769 00:24:03.447 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.4%, 32=4.8%, >=64=90.6% 00:24:03.447 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.447 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.447 issued rwts: total=669,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.447 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.447 job1: (groupid=0, jobs=1): err= 0: pid=4175107: Thu Apr 25 03:24:36 2024 00:24:03.447 read: IOPS=62, BW=62.9MiB/s (66.0MB/s)(635MiB/10089msec) 00:24:03.447 slat (usec): min=40, max=157701, avg=15748.12, stdev=23762.11 00:24:03.447 clat (msec): min=86, max=2980, avg=1833.74, stdev=726.98 00:24:03.447 lat (msec): min=103, max=2981, avg=1849.49, stdev=726.33 00:24:03.447 clat percentiles (msec): 00:24:03.447 | 1.00th=[ 194], 5.00th=[ 651], 10.00th=[ 751], 20.00th=[ 1150], 00:24:03.447 | 30.00th=[ 1418], 40.00th=[ 1687], 50.00th=[ 1938], 60.00th=[ 2165], 00:24:03.448 | 70.00th=[ 2333], 80.00th=[ 2467], 90.00th=[ 2735], 95.00th=[ 2937], 00:24:03.448 | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], 00:24:03.448 | 99.99th=[ 2970] 00:24:03.448 bw ( KiB/s): min=20480, max=169984, per=1.26%, avg=65024.00, stdev=46114.12, samples=16 00:24:03.448 iops : min= 20, max= 166, avg=63.50, stdev=45.03, samples=16 00:24:03.448 lat (msec) : 100=0.16%, 250=1.42%, 500=2.05%, 750=6.46%, 1000=5.98% 00:24:03.448 lat (msec) : 2000=37.17%, >=2000=46.77% 00:24:03.448 cpu : usr=0.01%, sys=1.15%, ctx=1550, majf=0, minf=32769 00:24:03.448 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.3%, 16=2.5%, 32=5.0%, >=64=90.1% 00:24:03.448 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.448 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.448 issued rwts: total=635,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.448 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.448 job2: (groupid=0, jobs=1): err= 0: pid=4175108: Thu Apr 25 03:24:36 2024 00:24:03.448 read: IOPS=59, BW=59.0MiB/s (61.9MB/s)(596MiB/10096msec) 00:24:03.448 slat (usec): min=31, max=112000, avg=16775.82, stdev=21386.06 00:24:03.448 clat (msec): min=94, max=3666, avg=2067.55, stdev=849.46 00:24:03.448 lat (msec): min=101, max=3683, avg=2084.32, stdev=852.75 00:24:03.448 clat percentiles (msec): 00:24:03.448 | 1.00th=[ 165], 5.00th=[ 430], 10.00th=[ 1036], 20.00th=[ 1485], 00:24:03.448 | 30.00th=[ 1670], 40.00th=[ 1770], 50.00th=[ 1955], 60.00th=[ 2165], 00:24:03.448 | 70.00th=[ 2635], 80.00th=[ 2937], 90.00th=[ 3205], 95.00th=[ 3507], 00:24:03.448 | 99.00th=[ 3608], 99.50th=[ 3608], 99.90th=[ 3675], 99.95th=[ 3675], 00:24:03.448 | 99.99th=[ 3675] 00:24:03.448 bw ( KiB/s): min=26624, max=145408, per=1.04%, avg=53361.78, stdev=27427.12, samples=18 00:24:03.448 iops : min= 26, max= 142, avg=52.11, stdev=26.78, samples=18 00:24:03.448 lat (msec) : 100=0.17%, 250=1.85%, 500=3.69%, 750=2.01%, 1000=1.68% 00:24:03.448 lat (msec) : 2000=43.12%, >=2000=47.48% 00:24:03.448 cpu : usr=0.02%, sys=1.28%, ctx=1575, majf=0, minf=32769 00:24:03.448 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.3%, 16=2.7%, 32=5.4%, >=64=89.4% 00:24:03.448 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.448 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.448 issued rwts: total=596,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.448 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.448 job2: (groupid=0, jobs=1): err= 0: pid=4175109: Thu Apr 25 03:24:36 2024 00:24:03.448 read: IOPS=49, BW=49.4MiB/s (51.8MB/s)(497MiB/10063msec) 00:24:03.448 slat (usec): min=30, max=127016, avg=20131.78, stdev=24437.36 00:24:03.448 clat (msec): min=55, max=3179, avg=2309.28, stdev=736.30 00:24:03.448 lat (msec): min=63, max=3201, avg=2329.42, stdev=735.86 00:24:03.448 clat percentiles (msec): 00:24:03.448 | 1.00th=[ 73], 5.00th=[ 477], 10.00th=[ 1045], 20.00th=[ 2056], 00:24:03.448 | 30.00th=[ 2165], 40.00th=[ 2366], 50.00th=[ 2500], 60.00th=[ 2635], 00:24:03.448 | 70.00th=[ 2802], 80.00th=[ 2869], 90.00th=[ 2937], 95.00th=[ 3104], 00:24:03.448 | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], 00:24:03.448 | 99.99th=[ 3171] 00:24:03.448 bw ( KiB/s): min=28672, max=71680, per=0.92%, avg=47344.69, stdev=13104.20, samples=16 00:24:03.448 iops : min= 28, max= 70, avg=46.19, stdev=12.74, samples=16 00:24:03.448 lat (msec) : 100=1.41%, 250=1.41%, 500=2.62%, 750=2.21%, 1000=2.21% 00:24:03.448 lat (msec) : 2000=8.45%, >=2000=81.69% 00:24:03.448 cpu : usr=0.00%, sys=0.93%, ctx=1540, majf=0, minf=32769 00:24:03.448 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.2%, 32=6.4%, >=64=87.3% 00:24:03.448 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.448 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:24:03.448 issued rwts: total=497,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.448 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.448 job2: (groupid=0, jobs=1): err= 0: pid=4175110: Thu Apr 25 03:24:36 2024 00:24:03.448 read: IOPS=52, BW=52.6MiB/s (55.1MB/s)(531MiB/10102msec) 00:24:03.448 slat (usec): min=39, max=128780, avg=18854.51, stdev=25664.42 00:24:03.448 clat (msec): min=88, max=3347, avg=2270.77, stdev=730.13 00:24:03.448 lat (msec): min=108, max=3362, avg=2289.62, stdev=731.98 00:24:03.448 clat percentiles (msec): 00:24:03.448 | 1.00th=[ 123], 5.00th=[ 617], 10.00th=[ 1116], 20.00th=[ 1888], 00:24:03.448 | 30.00th=[ 2039], 40.00th=[ 2265], 50.00th=[ 2433], 60.00th=[ 2534], 00:24:03.448 | 70.00th=[ 2802], 80.00th=[ 2903], 90.00th=[ 3037], 95.00th=[ 3104], 00:24:03.448 | 99.00th=[ 3272], 99.50th=[ 3306], 99.90th=[ 3339], 99.95th=[ 3339], 00:24:03.448 | 99.99th=[ 3339] 00:24:03.448 bw ( KiB/s): min=24576, max=90112, per=0.94%, avg=48549.65, stdev=18127.47, samples=17 00:24:03.448 iops : min= 24, max= 88, avg=47.41, stdev=17.70, samples=17 00:24:03.448 lat (msec) : 100=0.19%, 250=1.69%, 500=2.26%, 750=2.07%, 1000=1.88% 00:24:03.448 lat (msec) : 2000=20.53%, >=2000=71.37% 00:24:03.448 cpu : usr=0.01%, sys=1.03%, ctx=1590, majf=0, minf=32769 00:24:03.448 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.5%, 16=3.0%, 32=6.0%, >=64=88.1% 00:24:03.448 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.448 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.448 issued rwts: total=531,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.448 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.448 job2: (groupid=0, jobs=1): err= 0: pid=4175111: Thu Apr 25 03:24:36 2024 00:24:03.448 read: IOPS=60, BW=60.9MiB/s (63.9MB/s)(613MiB/10065msec) 00:24:03.448 slat (usec): min=29, max=105992, avg=16312.96, stdev=24071.81 00:24:03.448 clat (msec): min=63, max=2553, avg=1811.10, stdev=641.79 00:24:03.448 lat (msec): min=87, max=2557, avg=1827.42, stdev=643.99 00:24:03.448 clat percentiles (msec): 00:24:03.448 | 1.00th=[ 146], 5.00th=[ 347], 10.00th=[ 751], 20.00th=[ 1452], 00:24:03.448 | 30.00th=[ 1636], 40.00th=[ 1787], 50.00th=[ 2005], 60.00th=[ 2198], 00:24:03.448 | 70.00th=[ 2299], 80.00th=[ 2333], 90.00th=[ 2433], 95.00th=[ 2467], 00:24:03.448 | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2567], 99.95th=[ 2567], 00:24:03.448 | 99.99th=[ 2567] 00:24:03.448 bw ( KiB/s): min= 4096, max=106496, per=1.16%, avg=59518.67, stdev=26679.85, samples=15 00:24:03.448 iops : min= 4, max= 104, avg=58.07, stdev=26.02, samples=15 00:24:03.448 lat (msec) : 100=0.33%, 250=3.92%, 500=3.26%, 750=2.45%, 1000=3.75% 00:24:03.448 lat (msec) : 2000=36.05%, >=2000=50.24% 00:24:03.448 cpu : usr=0.00%, sys=0.92%, ctx=1528, majf=0, minf=32769 00:24:03.448 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.3%, 16=2.6%, 32=5.2%, >=64=89.7% 00:24:03.448 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.448 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.448 issued rwts: total=613,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.448 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.448 job2: (groupid=0, jobs=1): err= 0: pid=4175112: Thu Apr 25 03:24:36 2024 00:24:03.448 read: IOPS=64, BW=64.2MiB/s (67.3MB/s)(648MiB/10099msec) 00:24:03.448 slat (usec): min=32, max=192076, avg=15443.42, stdev=25343.12 00:24:03.449 clat (msec): min=88, max=3416, avg=1856.11, stdev=895.29 00:24:03.449 lat (msec): min=108, max=3422, avg=1871.55, stdev=899.72 00:24:03.449 clat percentiles (msec): 00:24:03.449 | 1.00th=[ 209], 5.00th=[ 735], 10.00th=[ 953], 20.00th=[ 1062], 00:24:03.449 | 30.00th=[ 1099], 40.00th=[ 1217], 50.00th=[ 1519], 60.00th=[ 2265], 00:24:03.449 | 70.00th=[ 2467], 80.00th=[ 2970], 90.00th=[ 3171], 95.00th=[ 3239], 00:24:03.449 | 99.00th=[ 3306], 99.50th=[ 3339], 99.90th=[ 3406], 99.95th=[ 3406], 00:24:03.449 | 99.99th=[ 3406] 00:24:03.449 bw ( KiB/s): min=34816, max=129024, per=1.15%, avg=59278.22, stdev=30372.46, samples=18 00:24:03.449 iops : min= 34, max= 126, avg=57.89, stdev=29.66, samples=18 00:24:03.449 lat (msec) : 100=0.15%, 250=1.08%, 500=1.70%, 750=2.31%, 1000=8.33% 00:24:03.449 lat (msec) : 2000=43.83%, >=2000=42.59% 00:24:03.449 cpu : usr=0.03%, sys=1.31%, ctx=1395, majf=0, minf=32769 00:24:03.449 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.5%, 32=4.9%, >=64=90.3% 00:24:03.449 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.449 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.449 issued rwts: total=648,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.449 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.449 job2: (groupid=0, jobs=1): err= 0: pid=4175113: Thu Apr 25 03:24:36 2024 00:24:03.449 read: IOPS=57, BW=57.6MiB/s (60.4MB/s)(581MiB/10084msec) 00:24:03.449 slat (usec): min=32, max=140857, avg=17219.44, stdev=22133.43 00:24:03.449 clat (msec): min=77, max=3440, avg=2055.95, stdev=745.79 00:24:03.449 lat (msec): min=93, max=3453, avg=2073.17, stdev=745.24 00:24:03.449 clat percentiles (msec): 00:24:03.449 | 1.00th=[ 188], 5.00th=[ 961], 10.00th=[ 1334], 20.00th=[ 1485], 00:24:03.449 | 30.00th=[ 1620], 40.00th=[ 1720], 50.00th=[ 1854], 60.00th=[ 2123], 00:24:03.449 | 70.00th=[ 2433], 80.00th=[ 2869], 90.00th=[ 3205], 95.00th=[ 3339], 00:24:03.449 | 99.00th=[ 3406], 99.50th=[ 3440], 99.90th=[ 3440], 99.95th=[ 3440], 00:24:03.449 | 99.99th=[ 3440] 00:24:03.449 bw ( KiB/s): min=16384, max=114688, per=1.06%, avg=54688.06, stdev=28478.78, samples=17 00:24:03.449 iops : min= 16, max= 112, avg=53.35, stdev=27.83, samples=17 00:24:03.449 lat (msec) : 100=0.52%, 250=0.86%, 500=1.03%, 750=1.38%, 1000=1.55% 00:24:03.449 lat (msec) : 2000=49.57%, >=2000=45.09% 00:24:03.449 cpu : usr=0.02%, sys=1.46%, ctx=1613, majf=0, minf=32769 00:24:03.449 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.4%, 16=2.8%, 32=5.5%, >=64=89.2% 00:24:03.449 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.449 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.449 issued rwts: total=581,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.449 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.449 job2: (groupid=0, jobs=1): err= 0: pid=4175114: Thu Apr 25 03:24:36 2024 00:24:03.449 read: IOPS=46, BW=46.1MiB/s (48.3MB/s)(465MiB/10088msec) 00:24:03.449 slat (usec): min=107, max=124116, avg=21513.38, stdev=25985.53 00:24:03.449 clat (msec): min=82, max=4211, avg=2560.43, stdev=993.46 00:24:03.449 lat (msec): min=90, max=4242, avg=2581.95, stdev=995.35 00:24:03.449 clat percentiles (msec): 00:24:03.449 | 1.00th=[ 192], 5.00th=[ 625], 10.00th=[ 1116], 20.00th=[ 1921], 00:24:03.449 | 30.00th=[ 2165], 40.00th=[ 2265], 50.00th=[ 2467], 60.00th=[ 2735], 00:24:03.449 | 70.00th=[ 3104], 80.00th=[ 3608], 90.00th=[ 3977], 95.00th=[ 4010], 00:24:03.449 | 99.00th=[ 4178], 99.50th=[ 4178], 99.90th=[ 4212], 99.95th=[ 4212], 00:24:03.449 | 99.99th=[ 4212] 00:24:03.449 bw ( KiB/s): min=20480, max=81920, per=0.79%, avg=40716.41, stdev=19007.24, samples=17 00:24:03.449 iops : min= 20, max= 80, avg=39.71, stdev=18.62, samples=17 00:24:03.449 lat (msec) : 100=0.43%, 250=0.86%, 500=2.80%, 750=1.94%, 1000=2.15% 00:24:03.449 lat (msec) : 2000=12.47%, >=2000=79.35% 00:24:03.449 cpu : usr=0.00%, sys=1.05%, ctx=1590, majf=0, minf=32051 00:24:03.449 IO depths : 1=0.2%, 2=0.4%, 4=0.9%, 8=1.7%, 16=3.4%, 32=6.9%, >=64=86.5% 00:24:03.449 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.449 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:24:03.449 issued rwts: total=465,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.449 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.449 job2: (groupid=0, jobs=1): err= 0: pid=4175115: Thu Apr 25 03:24:36 2024 00:24:03.449 read: IOPS=62, BW=62.7MiB/s (65.7MB/s)(634MiB/10116msec) 00:24:03.449 slat (usec): min=35, max=104687, avg=15793.55, stdev=21453.03 00:24:03.449 clat (msec): min=100, max=2657, avg=1925.00, stdev=512.70 00:24:03.449 lat (msec): min=171, max=2691, avg=1940.80, stdev=512.59 00:24:03.449 clat percentiles (msec): 00:24:03.449 | 1.00th=[ 199], 5.00th=[ 793], 10.00th=[ 1334], 20.00th=[ 1653], 00:24:03.449 | 30.00th=[ 1754], 40.00th=[ 1838], 50.00th=[ 1938], 60.00th=[ 2123], 00:24:03.449 | 70.00th=[ 2299], 80.00th=[ 2400], 90.00th=[ 2467], 95.00th=[ 2534], 00:24:03.449 | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2668], 99.95th=[ 2668], 00:24:03.449 | 99.99th=[ 2668] 00:24:03.449 bw ( KiB/s): min=22528, max=112640, per=1.12%, avg=57580.67, stdev=20883.74, samples=18 00:24:03.449 iops : min= 22, max= 110, avg=56.22, stdev=20.38, samples=18 00:24:03.449 lat (msec) : 250=1.26%, 500=1.89%, 750=1.26%, 1000=2.21%, 2000=47.95% 00:24:03.449 lat (msec) : >=2000=45.43% 00:24:03.449 cpu : usr=0.03%, sys=1.52%, ctx=1616, majf=0, minf=32769 00:24:03.449 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.3%, 16=2.5%, 32=5.0%, >=64=90.1% 00:24:03.449 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.449 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.449 issued rwts: total=634,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.449 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.449 job2: (groupid=0, jobs=1): err= 0: pid=4175117: Thu Apr 25 03:24:36 2024 00:24:03.449 read: IOPS=68, BW=68.5MiB/s (71.9MB/s)(688MiB/10039msec) 00:24:03.449 slat (usec): min=36, max=85606, avg=14530.73, stdev=17332.51 00:24:03.449 clat (msec): min=38, max=3044, avg=1690.74, stdev=832.40 00:24:03.449 lat (msec): min=42, max=3063, avg=1705.27, stdev=835.63 00:24:03.449 clat percentiles (msec): 00:24:03.449 | 1.00th=[ 85], 5.00th=[ 659], 10.00th=[ 885], 20.00th=[ 911], 00:24:03.449 | 30.00th=[ 927], 40.00th=[ 1150], 50.00th=[ 1418], 60.00th=[ 2232], 00:24:03.449 | 70.00th=[ 2467], 80.00th=[ 2567], 90.00th=[ 2802], 95.00th=[ 2903], 00:24:03.449 | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3037], 99.95th=[ 3037], 00:24:03.449 | 99.99th=[ 3037] 00:24:03.449 bw ( KiB/s): min=16384, max=147456, per=1.24%, avg=63853.71, stdev=40508.01, samples=17 00:24:03.449 iops : min= 16, max= 144, avg=62.35, stdev=39.56, samples=17 00:24:03.449 lat (msec) : 50=0.44%, 100=0.58%, 250=1.74%, 500=1.16%, 750=1.74% 00:24:03.449 lat (msec) : 1000=29.80%, 2000=21.37%, >=2000=43.17% 00:24:03.449 cpu : usr=0.04%, sys=1.26%, ctx=1560, majf=0, minf=32769 00:24:03.449 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.3%, 32=4.7%, >=64=90.8% 00:24:03.449 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.450 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.450 issued rwts: total=688,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.450 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.450 job2: (groupid=0, jobs=1): err= 0: pid=4175118: Thu Apr 25 03:24:36 2024 00:24:03.450 read: IOPS=61, BW=61.9MiB/s (64.9MB/s)(625MiB/10100msec) 00:24:03.450 slat (usec): min=39, max=100627, avg=16034.77, stdev=19377.26 00:24:03.450 clat (msec): min=75, max=2558, avg=1808.16, stdev=557.78 00:24:03.450 lat (msec): min=104, max=2575, avg=1824.20, stdev=558.44 00:24:03.450 clat percentiles (msec): 00:24:03.450 | 1.00th=[ 142], 5.00th=[ 535], 10.00th=[ 1028], 20.00th=[ 1401], 00:24:03.450 | 30.00th=[ 1569], 40.00th=[ 1804], 50.00th=[ 1921], 60.00th=[ 2072], 00:24:03.450 | 70.00th=[ 2198], 80.00th=[ 2299], 90.00th=[ 2400], 95.00th=[ 2433], 00:24:03.450 | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2567], 99.95th=[ 2567], 00:24:03.450 | 99.99th=[ 2567] 00:24:03.450 bw ( KiB/s): min=14364, max=116736, per=1.24%, avg=63617.75, stdev=24623.06, samples=16 00:24:03.450 iops : min= 14, max= 114, avg=62.12, stdev=24.05, samples=16 00:24:03.450 lat (msec) : 100=0.16%, 250=2.08%, 500=2.56%, 750=1.92%, 1000=2.40% 00:24:03.450 lat (msec) : 2000=44.96%, >=2000=45.92% 00:24:03.450 cpu : usr=0.04%, sys=1.00%, ctx=1671, majf=0, minf=32769 00:24:03.450 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.3%, 16=2.6%, 32=5.1%, >=64=89.9% 00:24:03.450 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.450 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.450 issued rwts: total=625,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.450 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.450 job2: (groupid=0, jobs=1): err= 0: pid=4175119: Thu Apr 25 03:24:36 2024 00:24:03.450 read: IOPS=60, BW=60.0MiB/s (62.9MB/s)(605MiB/10082msec) 00:24:03.450 slat (usec): min=54, max=194352, avg=16536.46, stdev=21302.35 00:24:03.450 clat (msec): min=74, max=3290, avg=1862.72, stdev=741.23 00:24:03.450 lat (msec): min=90, max=3301, avg=1879.26, stdev=743.48 00:24:03.450 clat percentiles (msec): 00:24:03.450 | 1.00th=[ 180], 5.00th=[ 535], 10.00th=[ 1070], 20.00th=[ 1183], 00:24:03.450 | 30.00th=[ 1351], 40.00th=[ 1703], 50.00th=[ 1888], 60.00th=[ 1972], 00:24:03.450 | 70.00th=[ 2265], 80.00th=[ 2635], 90.00th=[ 2836], 95.00th=[ 3004], 00:24:03.450 | 99.00th=[ 3205], 99.50th=[ 3239], 99.90th=[ 3306], 99.95th=[ 3306], 00:24:03.450 | 99.99th=[ 3306] 00:24:03.450 bw ( KiB/s): min=26624, max=112640, per=1.12%, avg=57529.18, stdev=24564.75, samples=17 00:24:03.450 iops : min= 26, max= 110, avg=56.18, stdev=23.98, samples=17 00:24:03.450 lat (msec) : 100=0.50%, 250=0.99%, 500=2.31%, 750=3.80%, 1000=1.32% 00:24:03.450 lat (msec) : 2000=52.23%, >=2000=38.84% 00:24:03.450 cpu : usr=0.03%, sys=1.13%, ctx=1543, majf=0, minf=32769 00:24:03.450 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.3%, 16=2.6%, 32=5.3%, >=64=89.6% 00:24:03.450 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.450 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.450 issued rwts: total=605,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.450 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.450 job2: (groupid=0, jobs=1): err= 0: pid=4175120: Thu Apr 25 03:24:36 2024 00:24:03.450 read: IOPS=135, BW=135MiB/s (142MB/s)(1368MiB/10098msec) 00:24:03.450 slat (usec): min=36, max=68142, avg=7305.22, stdev=12278.04 00:24:03.450 clat (msec): min=96, max=2006, avg=899.48, stdev=360.58 00:24:03.450 lat (msec): min=100, max=2013, avg=906.78, stdev=362.61 00:24:03.450 clat percentiles (msec): 00:24:03.450 | 1.00th=[ 194], 5.00th=[ 518], 10.00th=[ 684], 20.00th=[ 709], 00:24:03.450 | 30.00th=[ 743], 40.00th=[ 768], 50.00th=[ 793], 60.00th=[ 827], 00:24:03.450 | 70.00th=[ 877], 80.00th=[ 944], 90.00th=[ 1502], 95.00th=[ 1871], 00:24:03.450 | 99.00th=[ 1972], 99.50th=[ 1989], 99.90th=[ 2005], 99.95th=[ 2005], 00:24:03.450 | 99.99th=[ 2005] 00:24:03.450 bw ( KiB/s): min=51200, max=190464, per=2.75%, avg=141190.94, stdev=44270.68, samples=18 00:24:03.450 iops : min= 50, max= 186, avg=137.83, stdev=43.32, samples=18 00:24:03.450 lat (msec) : 100=0.07%, 250=1.75%, 500=2.85%, 750=30.63%, 1000=47.51% 00:24:03.450 lat (msec) : 2000=17.11%, >=2000=0.07% 00:24:03.450 cpu : usr=0.10%, sys=2.03%, ctx=1552, majf=0, minf=32769 00:24:03.450 IO depths : 1=0.1%, 2=0.1%, 4=0.3%, 8=0.6%, 16=1.2%, 32=2.3%, >=64=95.4% 00:24:03.450 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.450 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:03.450 issued rwts: total=1368,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.450 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.450 job2: (groupid=0, jobs=1): err= 0: pid=4175121: Thu Apr 25 03:24:36 2024 00:24:03.450 read: IOPS=67, BW=67.4MiB/s (70.6MB/s)(680MiB/10095msec) 00:24:03.450 slat (usec): min=33, max=120053, avg=14712.24, stdev=21926.03 00:24:03.450 clat (msec): min=87, max=2719, avg=1663.28, stdev=634.18 00:24:03.450 lat (msec): min=108, max=2725, avg=1677.99, stdev=637.04 00:24:03.450 clat percentiles (msec): 00:24:03.450 | 1.00th=[ 255], 5.00th=[ 701], 10.00th=[ 902], 20.00th=[ 1053], 00:24:03.450 | 30.00th=[ 1250], 40.00th=[ 1351], 50.00th=[ 1519], 60.00th=[ 1921], 00:24:03.450 | 70.00th=[ 2232], 80.00th=[ 2333], 90.00th=[ 2467], 95.00th=[ 2534], 00:24:03.450 | 99.00th=[ 2668], 99.50th=[ 2702], 99.90th=[ 2735], 99.95th=[ 2735], 00:24:03.450 | 99.99th=[ 2735] 00:24:03.450 bw ( KiB/s): min=36864, max=165888, per=1.47%, avg=75502.93, stdev=39102.99, samples=15 00:24:03.450 iops : min= 36, max= 162, avg=73.73, stdev=38.19, samples=15 00:24:03.450 lat (msec) : 100=0.15%, 250=0.74%, 500=1.76%, 750=3.68%, 1000=9.56% 00:24:03.450 lat (msec) : 2000=45.88%, >=2000=38.24% 00:24:03.450 cpu : usr=0.00%, sys=1.12%, ctx=1596, majf=0, minf=32769 00:24:03.450 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.4%, 32=4.7%, >=64=90.7% 00:24:03.450 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.450 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.450 issued rwts: total=680,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.450 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.450 job3: (groupid=0, jobs=1): err= 0: pid=4175124: Thu Apr 25 03:24:36 2024 00:24:03.450 read: IOPS=43, BW=43.7MiB/s (45.8MB/s)(440MiB/10075msec) 00:24:03.450 slat (usec): min=102, max=133374, avg=22754.17, stdev=25207.89 00:24:03.450 clat (msec): min=60, max=3430, avg=2385.28, stdev=790.62 00:24:03.450 lat (msec): min=96, max=3439, avg=2408.03, stdev=790.23 00:24:03.450 clat percentiles (msec): 00:24:03.450 | 1.00th=[ 109], 5.00th=[ 542], 10.00th=[ 1452], 20.00th=[ 1804], 00:24:03.450 | 30.00th=[ 2022], 40.00th=[ 2140], 50.00th=[ 2534], 60.00th=[ 2836], 00:24:03.450 | 70.00th=[ 3004], 80.00th=[ 3071], 90.00th=[ 3239], 95.00th=[ 3306], 00:24:03.450 | 99.00th=[ 3373], 99.50th=[ 3406], 99.90th=[ 3440], 99.95th=[ 3440], 00:24:03.451 | 99.99th=[ 3440] 00:24:03.451 bw ( KiB/s): min=14336, max=104448, per=0.89%, avg=45843.69, stdev=22567.35, samples=13 00:24:03.451 iops : min= 14, max= 102, avg=44.77, stdev=22.04, samples=13 00:24:03.451 lat (msec) : 100=0.45%, 250=2.95%, 500=0.91%, 750=1.14%, 1000=0.68% 00:24:03.451 lat (msec) : 2000=21.59%, >=2000=72.27% 00:24:03.451 cpu : usr=0.00%, sys=0.97%, ctx=1779, majf=0, minf=32769 00:24:03.451 IO depths : 1=0.2%, 2=0.5%, 4=0.9%, 8=1.8%, 16=3.6%, 32=7.3%, >=64=85.7% 00:24:03.451 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.451 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:24:03.451 issued rwts: total=440,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.451 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.451 job3: (groupid=0, jobs=1): err= 0: pid=4175125: Thu Apr 25 03:24:36 2024 00:24:03.451 read: IOPS=52, BW=52.1MiB/s (54.7MB/s)(525MiB/10071msec) 00:24:03.451 slat (usec): min=351, max=169552, avg=19060.63, stdev=26782.94 00:24:03.451 clat (msec): min=61, max=3559, avg=2153.81, stdev=717.86 00:24:03.451 lat (msec): min=78, max=3627, avg=2172.87, stdev=717.80 00:24:03.451 clat percentiles (msec): 00:24:03.451 | 1.00th=[ 93], 5.00th=[ 684], 10.00th=[ 1284], 20.00th=[ 1871], 00:24:03.451 | 30.00th=[ 1921], 40.00th=[ 1955], 50.00th=[ 1989], 60.00th=[ 2165], 00:24:03.451 | 70.00th=[ 2433], 80.00th=[ 2903], 90.00th=[ 3104], 95.00th=[ 3373], 00:24:03.451 | 99.00th=[ 3507], 99.50th=[ 3540], 99.90th=[ 3574], 99.95th=[ 3574], 00:24:03.451 | 99.99th=[ 3574] 00:24:03.451 bw ( KiB/s): min=20480, max=81920, per=1.00%, avg=51200.00, stdev=20669.30, samples=15 00:24:03.451 iops : min= 20, max= 80, avg=50.00, stdev=20.18, samples=15 00:24:03.451 lat (msec) : 100=1.33%, 250=0.38%, 500=1.90%, 750=2.10%, 1000=0.95% 00:24:03.451 lat (msec) : 2000=44.57%, >=2000=48.76% 00:24:03.451 cpu : usr=0.00%, sys=0.96%, ctx=1581, majf=0, minf=32769 00:24:03.451 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.5%, 16=3.0%, 32=6.1%, >=64=88.0% 00:24:03.451 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.451 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:24:03.451 issued rwts: total=525,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.451 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.451 job3: (groupid=0, jobs=1): err= 0: pid=4175126: Thu Apr 25 03:24:36 2024 00:24:03.451 read: IOPS=43, BW=43.7MiB/s (45.9MB/s)(442MiB/10104msec) 00:24:03.451 slat (usec): min=42, max=186217, avg=22638.89, stdev=28413.74 00:24:03.451 clat (msec): min=95, max=4492, avg=2492.72, stdev=1056.41 00:24:03.451 lat (msec): min=110, max=4509, avg=2515.36, stdev=1058.52 00:24:03.451 clat percentiles (msec): 00:24:03.451 | 1.00th=[ 148], 5.00th=[ 422], 10.00th=[ 709], 20.00th=[ 1687], 00:24:03.451 | 30.00th=[ 2265], 40.00th=[ 2433], 50.00th=[ 2601], 60.00th=[ 2769], 00:24:03.451 | 70.00th=[ 2937], 80.00th=[ 3373], 90.00th=[ 3775], 95.00th=[ 4279], 00:24:03.451 | 99.00th=[ 4463], 99.50th=[ 4463], 99.90th=[ 4463], 99.95th=[ 4463], 00:24:03.451 | 99.99th=[ 4463] 00:24:03.451 bw ( KiB/s): min=14336, max=77824, per=0.97%, avg=49624.62, stdev=17421.12, samples=13 00:24:03.451 iops : min= 14, max= 76, avg=48.46, stdev=17.01, samples=13 00:24:03.451 lat (msec) : 100=0.23%, 250=2.49%, 500=4.07%, 750=4.52%, 1000=2.49% 00:24:03.451 lat (msec) : 2000=7.47%, >=2000=78.73% 00:24:03.451 cpu : usr=0.00%, sys=1.15%, ctx=1661, majf=0, minf=32769 00:24:03.451 IO depths : 1=0.2%, 2=0.5%, 4=0.9%, 8=1.8%, 16=3.6%, 32=7.2%, >=64=85.7% 00:24:03.451 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.451 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:24:03.451 issued rwts: total=442,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.451 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.451 job3: (groupid=0, jobs=1): err= 0: pid=4175127: Thu Apr 25 03:24:36 2024 00:24:03.451 read: IOPS=100, BW=101MiB/s (105MB/s)(1019MiB/10139msec) 00:24:03.451 slat (usec): min=40, max=132984, avg=9868.06, stdev=19414.43 00:24:03.451 clat (msec): min=78, max=3261, avg=1218.49, stdev=768.94 00:24:03.451 lat (msec): min=148, max=3279, avg=1228.35, stdev=773.22 00:24:03.451 clat percentiles (msec): 00:24:03.451 | 1.00th=[ 363], 5.00th=[ 701], 10.00th=[ 709], 20.00th=[ 760], 00:24:03.451 | 30.00th=[ 776], 40.00th=[ 810], 50.00th=[ 877], 60.00th=[ 927], 00:24:03.451 | 70.00th=[ 1003], 80.00th=[ 1737], 90.00th=[ 2735], 95.00th=[ 3037], 00:24:03.451 | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3272], 99.95th=[ 3272], 00:24:03.451 | 99.99th=[ 3272] 00:24:03.451 bw ( KiB/s): min=24576, max=186368, per=1.87%, avg=96040.42, stdev=60756.93, samples=19 00:24:03.451 iops : min= 24, max= 182, avg=93.79, stdev=59.33, samples=19 00:24:03.451 lat (msec) : 100=0.10%, 250=0.29%, 500=0.98%, 750=17.96%, 1000=50.64% 00:24:03.451 lat (msec) : 2000=11.29%, >=2000=18.74% 00:24:03.452 cpu : usr=0.02%, sys=1.52%, ctx=1603, majf=0, minf=32769 00:24:03.452 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.6%, 32=3.1%, >=64=93.8% 00:24:03.452 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.452 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:03.452 issued rwts: total=1019,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.452 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.452 job3: (groupid=0, jobs=1): err= 0: pid=4175128: Thu Apr 25 03:24:36 2024 00:24:03.452 read: IOPS=47, BW=47.8MiB/s (50.2MB/s)(484MiB/10116msec) 00:24:03.452 slat (usec): min=29, max=197772, avg=20737.01, stdev=27749.56 00:24:03.452 clat (msec): min=77, max=3514, avg=2451.80, stdev=657.37 00:24:03.452 lat (msec): min=163, max=3555, avg=2472.54, stdev=653.13 00:24:03.452 clat percentiles (msec): 00:24:03.452 | 1.00th=[ 239], 5.00th=[ 1036], 10.00th=[ 1804], 20.00th=[ 2072], 00:24:03.452 | 30.00th=[ 2140], 40.00th=[ 2299], 50.00th=[ 2534], 60.00th=[ 2836], 00:24:03.452 | 70.00th=[ 2903], 80.00th=[ 2970], 90.00th=[ 3104], 95.00th=[ 3373], 00:24:03.452 | 99.00th=[ 3440], 99.50th=[ 3473], 99.90th=[ 3507], 99.95th=[ 3507], 00:24:03.452 | 99.99th=[ 3507] 00:24:03.452 bw ( KiB/s): min=20480, max=75776, per=0.83%, avg=42883.88, stdev=19070.21, samples=17 00:24:03.452 iops : min= 20, max= 74, avg=41.82, stdev=18.66, samples=17 00:24:03.452 lat (msec) : 100=0.21%, 250=0.83%, 500=1.03%, 750=1.03%, 1000=1.65% 00:24:03.452 lat (msec) : 2000=12.40%, >=2000=82.85% 00:24:03.452 cpu : usr=0.00%, sys=0.99%, ctx=1556, majf=0, minf=32769 00:24:03.452 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.7%, 16=3.3%, 32=6.6%, >=64=87.0% 00:24:03.452 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.452 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:24:03.452 issued rwts: total=484,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.452 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.452 job3: (groupid=0, jobs=1): err= 0: pid=4175129: Thu Apr 25 03:24:36 2024 00:24:03.452 read: IOPS=52, BW=52.7MiB/s (55.2MB/s)(530MiB/10064msec) 00:24:03.452 slat (usec): min=339, max=118761, avg=18892.13, stdev=22385.11 00:24:03.452 clat (msec): min=48, max=2938, avg=2045.86, stdev=520.61 00:24:03.452 lat (msec): min=64, max=2946, avg=2064.75, stdev=517.46 00:24:03.452 clat percentiles (msec): 00:24:03.452 | 1.00th=[ 94], 5.00th=[ 776], 10.00th=[ 1670], 20.00th=[ 1905], 00:24:03.452 | 30.00th=[ 1972], 40.00th=[ 2056], 50.00th=[ 2140], 60.00th=[ 2198], 00:24:03.452 | 70.00th=[ 2232], 80.00th=[ 2299], 90.00th=[ 2567], 95.00th=[ 2802], 00:24:03.452 | 99.00th=[ 2869], 99.50th=[ 2903], 99.90th=[ 2937], 99.95th=[ 2937], 00:24:03.452 | 99.99th=[ 2937] 00:24:03.452 bw ( KiB/s): min=22528, max=83968, per=1.01%, avg=52144.53, stdev=18522.73, samples=15 00:24:03.452 iops : min= 22, max= 82, avg=50.87, stdev=17.99, samples=15 00:24:03.452 lat (msec) : 50=0.19%, 100=0.94%, 250=0.75%, 500=1.70%, 750=1.32% 00:24:03.452 lat (msec) : 1000=1.70%, 2000=27.36%, >=2000=66.04% 00:24:03.452 cpu : usr=0.00%, sys=0.87%, ctx=1635, majf=0, minf=32769 00:24:03.452 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.5%, 16=3.0%, 32=6.0%, >=64=88.1% 00:24:03.452 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.452 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.452 issued rwts: total=530,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.452 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.452 job3: (groupid=0, jobs=1): err= 0: pid=4175130: Thu Apr 25 03:24:36 2024 00:24:03.452 read: IOPS=66, BW=66.8MiB/s (70.0MB/s)(674MiB/10095msec) 00:24:03.452 slat (usec): min=61, max=236443, avg=14834.61, stdev=23451.15 00:24:03.452 clat (msec): min=93, max=2721, avg=1805.54, stdev=539.48 00:24:03.452 lat (msec): min=173, max=2728, avg=1820.37, stdev=539.91 00:24:03.452 clat percentiles (msec): 00:24:03.452 | 1.00th=[ 380], 5.00th=[ 902], 10.00th=[ 1083], 20.00th=[ 1385], 00:24:03.452 | 30.00th=[ 1485], 40.00th=[ 1636], 50.00th=[ 1821], 60.00th=[ 2072], 00:24:03.452 | 70.00th=[ 2198], 80.00th=[ 2366], 90.00th=[ 2433], 95.00th=[ 2500], 00:24:03.452 | 99.00th=[ 2668], 99.50th=[ 2702], 99.90th=[ 2735], 99.95th=[ 2735], 00:24:03.452 | 99.99th=[ 2735] 00:24:03.452 bw ( KiB/s): min=38912, max=104448, per=1.21%, avg=62230.50, stdev=19711.05, samples=18 00:24:03.452 iops : min= 38, max= 102, avg=60.72, stdev=19.27, samples=18 00:24:03.452 lat (msec) : 100=0.15%, 250=0.30%, 500=1.48%, 750=1.93%, 1000=1.93% 00:24:03.452 lat (msec) : 2000=52.23%, >=2000=41.99% 00:24:03.452 cpu : usr=0.05%, sys=1.45%, ctx=1596, majf=0, minf=32769 00:24:03.452 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.4%, 32=4.7%, >=64=90.7% 00:24:03.452 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.452 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.452 issued rwts: total=674,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.452 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.452 job3: (groupid=0, jobs=1): err= 0: pid=4175131: Thu Apr 25 03:24:36 2024 00:24:03.452 read: IOPS=87, BW=87.4MiB/s (91.7MB/s)(882MiB/10088msec) 00:24:03.452 slat (usec): min=38, max=163385, avg=11336.58, stdev=24232.70 00:24:03.452 clat (msec): min=84, max=2257, avg=1325.37, stdev=401.22 00:24:03.452 lat (msec): min=98, max=2258, avg=1336.71, stdev=400.63 00:24:03.452 clat percentiles (msec): 00:24:03.452 | 1.00th=[ 279], 5.00th=[ 869], 10.00th=[ 877], 20.00th=[ 877], 00:24:03.452 | 30.00th=[ 953], 40.00th=[ 1183], 50.00th=[ 1351], 60.00th=[ 1485], 00:24:03.452 | 70.00th=[ 1603], 80.00th=[ 1670], 90.00th=[ 1838], 95.00th=[ 1989], 00:24:03.452 | 99.00th=[ 2165], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], 00:24:03.452 | 99.99th=[ 2265] 00:24:03.452 bw ( KiB/s): min=18432, max=157696, per=1.77%, avg=90963.71, stdev=44766.09, samples=17 00:24:03.452 iops : min= 18, max= 154, avg=88.76, stdev=43.75, samples=17 00:24:03.452 lat (msec) : 100=0.23%, 250=0.68%, 500=0.57%, 750=0.45%, 1000=30.05% 00:24:03.452 lat (msec) : 2000=63.72%, >=2000=4.31% 00:24:03.452 cpu : usr=0.05%, sys=1.38%, ctx=1376, majf=0, minf=32769 00:24:03.452 IO depths : 1=0.1%, 2=0.2%, 4=0.5%, 8=0.9%, 16=1.8%, 32=3.6%, >=64=92.9% 00:24:03.452 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.452 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:03.452 issued rwts: total=882,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.452 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.452 job3: (groupid=0, jobs=1): err= 0: pid=4175132: Thu Apr 25 03:24:36 2024 00:24:03.452 read: IOPS=119, BW=119MiB/s (125MB/s)(1205MiB/10088msec) 00:24:03.452 slat (usec): min=39, max=179698, avg=8294.68, stdev=21688.75 00:24:03.452 clat (msec): min=86, max=2278, avg=961.20, stdev=365.01 00:24:03.452 lat (msec): min=88, max=2365, avg=969.49, stdev=367.79 00:24:03.452 clat percentiles (msec): 00:24:03.452 | 1.00th=[ 184], 5.00th=[ 477], 10.00th=[ 776], 20.00th=[ 844], 00:24:03.452 | 30.00th=[ 869], 40.00th=[ 869], 50.00th=[ 877], 60.00th=[ 877], 00:24:03.452 | 70.00th=[ 944], 80.00th=[ 953], 90.00th=[ 1469], 95.00th=[ 1888], 00:24:03.452 | 99.00th=[ 2198], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], 00:24:03.453 | 99.99th=[ 2265] 00:24:03.453 bw ( KiB/s): min=63488, max=165888, per=2.68%, avg=137965.81, stdev=27561.84, samples=16 00:24:03.453 iops : min= 62, max= 162, avg=134.69, stdev=26.90, samples=16 00:24:03.453 lat (msec) : 100=0.17%, 250=1.33%, 500=3.82%, 750=2.99%, 1000=75.85% 00:24:03.453 lat (msec) : 2000=11.62%, >=2000=4.23% 00:24:03.453 cpu : usr=0.06%, sys=1.57%, ctx=1348, majf=0, minf=32769 00:24:03.453 IO depths : 1=0.1%, 2=0.2%, 4=0.3%, 8=0.7%, 16=1.3%, 32=2.7%, >=64=94.8% 00:24:03.453 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.453 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:03.453 issued rwts: total=1205,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.453 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.453 job3: (groupid=0, jobs=1): err= 0: pid=4175133: Thu Apr 25 03:24:36 2024 00:24:03.453 read: IOPS=51, BW=51.8MiB/s (54.4MB/s)(524MiB/10108msec) 00:24:03.453 slat (usec): min=87, max=104323, avg=19141.12, stdev=27425.27 00:24:03.453 clat (msec): min=75, max=3914, avg=2138.39, stdev=788.56 00:24:03.453 lat (msec): min=144, max=3928, avg=2157.53, stdev=787.27 00:24:03.453 clat percentiles (msec): 00:24:03.453 | 1.00th=[ 224], 5.00th=[ 701], 10.00th=[ 1536], 20.00th=[ 1636], 00:24:03.453 | 30.00th=[ 1787], 40.00th=[ 1938], 50.00th=[ 2022], 60.00th=[ 2123], 00:24:03.453 | 70.00th=[ 2198], 80.00th=[ 2869], 90.00th=[ 3339], 95.00th=[ 3708], 00:24:03.453 | 99.00th=[ 3842], 99.50th=[ 3876], 99.90th=[ 3910], 99.95th=[ 3910], 00:24:03.453 | 99.99th=[ 3910] 00:24:03.453 bw ( KiB/s): min=16384, max=88064, per=0.99%, avg=50681.81, stdev=22787.62, samples=16 00:24:03.453 iops : min= 16, max= 86, avg=49.44, stdev=22.26, samples=16 00:24:03.453 lat (msec) : 100=0.19%, 250=1.15%, 500=2.29%, 750=1.72%, 1000=1.34% 00:24:03.453 lat (msec) : 2000=39.12%, >=2000=54.20% 00:24:03.453 cpu : usr=0.03%, sys=0.94%, ctx=1550, majf=0, minf=32769 00:24:03.453 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.5%, 16=3.1%, 32=6.1%, >=64=88.0% 00:24:03.453 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.453 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:24:03.453 issued rwts: total=524,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.453 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.453 job3: (groupid=0, jobs=1): err= 0: pid=4175134: Thu Apr 25 03:24:36 2024 00:24:03.453 read: IOPS=69, BW=69.8MiB/s (73.2MB/s)(705MiB/10100msec) 00:24:03.453 slat (usec): min=36, max=149838, avg=14186.92, stdev=19248.67 00:24:03.453 clat (msec): min=94, max=2930, avg=1774.76, stdev=822.93 00:24:03.453 lat (msec): min=104, max=2936, avg=1788.95, stdev=827.36 00:24:03.453 clat percentiles (msec): 00:24:03.453 | 1.00th=[ 222], 5.00th=[ 642], 10.00th=[ 802], 20.00th=[ 911], 00:24:03.453 | 30.00th=[ 953], 40.00th=[ 1368], 50.00th=[ 1955], 60.00th=[ 2232], 00:24:03.453 | 70.00th=[ 2467], 80.00th=[ 2668], 90.00th=[ 2836], 95.00th=[ 2869], 00:24:03.453 | 99.00th=[ 2903], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], 00:24:03.453 | 99.99th=[ 2937] 00:24:03.453 bw ( KiB/s): min=20480, max=145408, per=1.21%, avg=62297.11, stdev=30273.99, samples=19 00:24:03.453 iops : min= 20, max= 142, avg=60.79, stdev=29.59, samples=19 00:24:03.453 lat (msec) : 100=0.14%, 250=1.42%, 500=2.13%, 750=3.69%, 1000=24.68% 00:24:03.453 lat (msec) : 2000=19.57%, >=2000=48.37% 00:24:03.453 cpu : usr=0.03%, sys=1.59%, ctx=1667, majf=0, minf=32769 00:24:03.453 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.1%, 16=2.3%, 32=4.5%, >=64=91.1% 00:24:03.453 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.453 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.453 issued rwts: total=705,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.453 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.453 job3: (groupid=0, jobs=1): err= 0: pid=4175135: Thu Apr 25 03:24:36 2024 00:24:03.453 read: IOPS=57, BW=57.7MiB/s (60.5MB/s)(583MiB/10108msec) 00:24:03.453 slat (usec): min=29, max=113533, avg=17161.64, stdev=24299.20 00:24:03.453 clat (msec): min=100, max=2698, avg=1963.67, stdev=601.73 00:24:03.453 lat (msec): min=198, max=2726, avg=1980.83, stdev=602.33 00:24:03.453 clat percentiles (msec): 00:24:03.453 | 1.00th=[ 199], 5.00th=[ 405], 10.00th=[ 911], 20.00th=[ 1670], 00:24:03.453 | 30.00th=[ 1871], 40.00th=[ 2106], 50.00th=[ 2232], 60.00th=[ 2265], 00:24:03.453 | 70.00th=[ 2299], 80.00th=[ 2333], 90.00th=[ 2433], 95.00th=[ 2601], 00:24:03.453 | 99.00th=[ 2668], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], 00:24:03.453 | 99.99th=[ 2702] 00:24:03.453 bw ( KiB/s): min=22528, max=92160, per=1.14%, avg=58368.00, stdev=18025.50, samples=16 00:24:03.453 iops : min= 22, max= 90, avg=57.00, stdev=17.60, samples=16 00:24:03.453 lat (msec) : 250=3.95%, 500=2.06%, 750=1.89%, 1000=2.74%, 2000=25.56% 00:24:03.453 lat (msec) : >=2000=63.81% 00:24:03.453 cpu : usr=0.01%, sys=1.02%, ctx=1507, majf=0, minf=32769 00:24:03.453 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.4%, 16=2.7%, 32=5.5%, >=64=89.2% 00:24:03.453 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.453 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.453 issued rwts: total=583,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.453 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.453 job3: (groupid=0, jobs=1): err= 0: pid=4175136: Thu Apr 25 03:24:36 2024 00:24:03.453 read: IOPS=66, BW=66.9MiB/s (70.2MB/s)(675MiB/10087msec) 00:24:03.453 slat (usec): min=31, max=104122, avg=14813.45, stdev=21934.78 00:24:03.453 clat (msec): min=86, max=2485, avg=1671.71, stdev=544.86 00:24:03.453 lat (msec): min=90, max=2514, avg=1686.52, stdev=546.57 00:24:03.453 clat percentiles (msec): 00:24:03.453 | 1.00th=[ 201], 5.00th=[ 642], 10.00th=[ 1083], 20.00th=[ 1250], 00:24:03.453 | 30.00th=[ 1368], 40.00th=[ 1452], 50.00th=[ 1670], 60.00th=[ 1838], 00:24:03.453 | 70.00th=[ 2072], 80.00th=[ 2265], 90.00th=[ 2366], 95.00th=[ 2400], 00:24:03.453 | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2500], 99.95th=[ 2500], 00:24:03.453 | 99.99th=[ 2500] 00:24:03.453 bw ( KiB/s): min=38912, max=124928, per=1.36%, avg=70144.00, stdev=26093.59, samples=16 00:24:03.453 iops : min= 38, max= 122, avg=68.50, stdev=25.48, samples=16 00:24:03.453 lat (msec) : 100=0.30%, 250=1.48%, 500=2.37%, 750=1.19%, 1000=2.81% 00:24:03.453 lat (msec) : 2000=58.37%, >=2000=33.48% 00:24:03.453 cpu : usr=0.01%, sys=1.03%, ctx=1595, majf=0, minf=32769 00:24:03.453 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.4%, 32=4.7%, >=64=90.7% 00:24:03.453 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.453 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.453 issued rwts: total=675,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.453 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.453 job4: (groupid=0, jobs=1): err= 0: pid=4175137: Thu Apr 25 03:24:36 2024 00:24:03.453 read: IOPS=90, BW=90.4MiB/s (94.8MB/s)(910MiB/10069msec) 00:24:03.453 slat (usec): min=37, max=94733, avg=11004.43, stdev=19332.61 00:24:03.453 clat (msec): min=49, max=3228, avg=1177.67, stdev=680.81 00:24:03.453 lat (msec): min=69, max=3236, avg=1188.68, stdev=685.72 00:24:03.453 clat percentiles (msec): 00:24:03.453 | 1.00th=[ 102], 5.00th=[ 684], 10.00th=[ 693], 20.00th=[ 693], 00:24:03.453 | 30.00th=[ 701], 40.00th=[ 751], 50.00th=[ 827], 60.00th=[ 1062], 00:24:03.453 | 70.00th=[ 1368], 80.00th=[ 1737], 90.00th=[ 2089], 95.00th=[ 2802], 00:24:03.453 | 99.00th=[ 3171], 99.50th=[ 3205], 99.90th=[ 3239], 99.95th=[ 3239], 00:24:03.453 | 99.99th=[ 3239] 00:24:03.453 bw ( KiB/s): min=36864, max=188416, per=2.30%, avg=117996.31, stdev=59846.58, samples=13 00:24:03.454 iops : min= 36, max= 184, avg=115.23, stdev=58.44, samples=13 00:24:03.454 lat (msec) : 50=0.11%, 100=0.88%, 250=0.66%, 500=1.98%, 750=33.08% 00:24:03.454 lat (msec) : 1000=20.66%, 2000=30.00%, >=2000=12.64% 00:24:03.454 cpu : usr=0.00%, sys=1.66%, ctx=1534, majf=0, minf=32769 00:24:03.454 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.9%, 16=1.8%, 32=3.5%, >=64=93.1% 00:24:03.454 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.454 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:03.454 issued rwts: total=910,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.454 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.454 job4: (groupid=0, jobs=1): err= 0: pid=4175138: Thu Apr 25 03:24:36 2024 00:24:03.454 read: IOPS=102, BW=102MiB/s (107MB/s)(1035MiB/10139msec) 00:24:03.454 slat (usec): min=45, max=107965, avg=9702.42, stdev=17516.26 00:24:03.454 clat (msec): min=92, max=2882, avg=1209.40, stdev=797.88 00:24:03.454 lat (msec): min=152, max=2895, avg=1219.10, stdev=802.98 00:24:03.454 clat percentiles (msec): 00:24:03.454 | 1.00th=[ 167], 5.00th=[ 435], 10.00th=[ 676], 20.00th=[ 693], 00:24:03.454 | 30.00th=[ 701], 40.00th=[ 709], 50.00th=[ 751], 60.00th=[ 776], 00:24:03.454 | 70.00th=[ 1401], 80.00th=[ 2333], 90.00th=[ 2567], 95.00th=[ 2702], 00:24:03.454 | 99.00th=[ 2836], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], 00:24:03.454 | 99.99th=[ 2869] 00:24:03.454 bw ( KiB/s): min=18432, max=188416, per=1.90%, avg=97757.47, stdev=68101.74, samples=19 00:24:03.454 iops : min= 18, max= 184, avg=95.42, stdev=66.52, samples=19 00:24:03.454 lat (msec) : 100=0.10%, 250=1.45%, 500=4.44%, 750=46.47%, 1000=11.98% 00:24:03.454 lat (msec) : 2000=11.01%, >=2000=24.54% 00:24:03.454 cpu : usr=0.03%, sys=1.72%, ctx=1552, majf=0, minf=32769 00:24:03.454 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.5%, 32=3.1%, >=64=93.9% 00:24:03.454 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.454 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:03.454 issued rwts: total=1035,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.454 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.454 job4: (groupid=0, jobs=1): err= 0: pid=4175139: Thu Apr 25 03:24:36 2024 00:24:03.454 read: IOPS=68, BW=68.4MiB/s (71.7MB/s)(693MiB/10136msec) 00:24:03.454 slat (usec): min=40, max=101692, avg=14501.82, stdev=16594.11 00:24:03.454 clat (msec): min=82, max=2721, avg=1784.82, stdev=618.10 00:24:03.454 lat (msec): min=141, max=2742, avg=1799.33, stdev=619.98 00:24:03.454 clat percentiles (msec): 00:24:03.454 | 1.00th=[ 239], 5.00th=[ 659], 10.00th=[ 944], 20.00th=[ 995], 00:24:03.454 | 30.00th=[ 1502], 40.00th=[ 1737], 50.00th=[ 1955], 60.00th=[ 2123], 00:24:03.454 | 70.00th=[ 2232], 80.00th=[ 2333], 90.00th=[ 2433], 95.00th=[ 2567], 00:24:03.454 | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2735], 99.95th=[ 2735], 00:24:03.454 | 99.99th=[ 2735] 00:24:03.454 bw ( KiB/s): min=32768, max=139264, per=1.18%, avg=60901.05, stdev=25723.42, samples=19 00:24:03.454 iops : min= 32, max= 136, avg=59.47, stdev=25.12, samples=19 00:24:03.454 lat (msec) : 100=0.14%, 250=1.01%, 500=1.88%, 750=2.16%, 1000=15.30% 00:24:03.454 lat (msec) : 2000=33.48%, >=2000=46.03% 00:24:03.454 cpu : usr=0.03%, sys=1.45%, ctx=1592, majf=0, minf=32769 00:24:03.454 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.3%, 32=4.6%, >=64=90.9% 00:24:03.454 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.454 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.454 issued rwts: total=693,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.454 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.454 job4: (groupid=0, jobs=1): err= 0: pid=4175140: Thu Apr 25 03:24:36 2024 00:24:03.454 read: IOPS=59, BW=59.4MiB/s (62.3MB/s)(598MiB/10069msec) 00:24:03.454 slat (usec): min=33, max=99636, avg=16726.28, stdev=19668.00 00:24:03.454 clat (msec): min=64, max=2818, avg=1917.30, stdev=708.97 00:24:03.454 lat (msec): min=142, max=2823, avg=1934.02, stdev=711.87 00:24:03.454 clat percentiles (msec): 00:24:03.454 | 1.00th=[ 236], 5.00th=[ 558], 10.00th=[ 793], 20.00th=[ 1133], 00:24:03.454 | 30.00th=[ 1385], 40.00th=[ 2232], 50.00th=[ 2299], 60.00th=[ 2366], 00:24:03.454 | 70.00th=[ 2366], 80.00th=[ 2433], 90.00th=[ 2534], 95.00th=[ 2668], 00:24:03.454 | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2802], 99.95th=[ 2802], 00:24:03.454 | 99.99th=[ 2802] 00:24:03.454 bw ( KiB/s): min=32768, max=133120, per=1.17%, avg=60288.00, stdev=26109.32, samples=16 00:24:03.454 iops : min= 32, max= 130, avg=58.88, stdev=25.50, samples=16 00:24:03.454 lat (msec) : 100=0.17%, 250=1.34%, 500=2.17%, 750=5.69%, 1000=5.85% 00:24:03.454 lat (msec) : 2000=19.73%, >=2000=65.05% 00:24:03.454 cpu : usr=0.03%, sys=1.01%, ctx=1514, majf=0, minf=32769 00:24:03.454 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.3%, 16=2.7%, 32=5.4%, >=64=89.5% 00:24:03.454 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.454 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.454 issued rwts: total=598,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.454 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.454 job4: (groupid=0, jobs=1): err= 0: pid=4175141: Thu Apr 25 03:24:36 2024 00:24:03.454 read: IOPS=140, BW=141MiB/s (147MB/s)(1413MiB/10054msec) 00:24:03.454 slat (usec): min=37, max=104743, avg=7074.23, stdev=16851.17 00:24:03.454 clat (msec): min=52, max=1619, avg=845.50, stdev=258.22 00:24:03.454 lat (msec): min=53, max=1633, avg=852.58, stdev=259.06 00:24:03.454 clat percentiles (msec): 00:24:03.454 | 1.00th=[ 126], 5.00th=[ 447], 10.00th=[ 684], 20.00th=[ 709], 00:24:03.454 | 30.00th=[ 743], 40.00th=[ 760], 50.00th=[ 793], 60.00th=[ 827], 00:24:03.454 | 70.00th=[ 869], 80.00th=[ 995], 90.00th=[ 1183], 95.00th=[ 1452], 00:24:03.454 | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1586], 99.95th=[ 1620], 00:24:03.454 | 99.99th=[ 1620] 00:24:03.454 bw ( KiB/s): min=40960, max=190464, per=2.84%, avg=146204.94, stdev=40409.94, samples=18 00:24:03.454 iops : min= 40, max= 186, avg=142.72, stdev=39.44, samples=18 00:24:03.454 lat (msec) : 100=0.64%, 250=1.91%, 500=3.33%, 750=27.88%, 1000=46.43% 00:24:03.454 lat (msec) : 2000=19.82% 00:24:03.454 cpu : usr=0.00%, sys=1.63%, ctx=1586, majf=0, minf=32769 00:24:03.454 IO depths : 1=0.1%, 2=0.1%, 4=0.3%, 8=0.6%, 16=1.1%, 32=2.3%, >=64=95.5% 00:24:03.454 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.454 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:03.454 issued rwts: total=1413,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.454 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.454 job4: (groupid=0, jobs=1): err= 0: pid=4175142: Thu Apr 25 03:24:36 2024 00:24:03.454 read: IOPS=55, BW=55.3MiB/s (58.0MB/s)(559MiB/10101msec) 00:24:03.454 slat (usec): min=59, max=111372, avg=17935.60, stdev=18860.56 00:24:03.454 clat (msec): min=71, max=3299, avg=2011.28, stdev=699.88 00:24:03.454 lat (msec): min=138, max=3337, avg=2029.21, stdev=700.25 00:24:03.454 clat percentiles (msec): 00:24:03.454 | 1.00th=[ 146], 5.00th=[ 523], 10.00th=[ 1116], 20.00th=[ 1469], 00:24:03.454 | 30.00th=[ 1737], 40.00th=[ 2005], 50.00th=[ 2140], 60.00th=[ 2198], 00:24:03.454 | 70.00th=[ 2333], 80.00th=[ 2433], 90.00th=[ 3037], 95.00th=[ 3239], 00:24:03.454 | 99.00th=[ 3272], 99.50th=[ 3272], 99.90th=[ 3306], 99.95th=[ 3306], 00:24:03.454 | 99.99th=[ 3306] 00:24:03.454 bw ( KiB/s): min= 6144, max=102400, per=1.14%, avg=58845.87, stdev=24213.30, samples=15 00:24:03.454 iops : min= 6, max= 100, avg=57.47, stdev=23.65, samples=15 00:24:03.455 lat (msec) : 100=0.18%, 250=1.79%, 500=2.50%, 750=1.97%, 1000=2.15% 00:24:03.455 lat (msec) : 2000=30.59%, >=2000=60.82% 00:24:03.455 cpu : usr=0.01%, sys=1.52%, ctx=1565, majf=0, minf=32769 00:24:03.455 IO depths : 1=0.2%, 2=0.4%, 4=0.7%, 8=1.4%, 16=2.9%, 32=5.7%, >=64=88.7% 00:24:03.455 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.455 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.455 issued rwts: total=559,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.455 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.455 job4: (groupid=0, jobs=1): err= 0: pid=4175143: Thu Apr 25 03:24:36 2024 00:24:03.455 read: IOPS=77, BW=77.4MiB/s (81.1MB/s)(779MiB/10068msec) 00:24:03.455 slat (usec): min=47, max=100325, avg=12855.26, stdev=15227.54 00:24:03.455 clat (msec): min=51, max=1901, avg=1469.98, stdev=310.14 00:24:03.455 lat (msec): min=85, max=1922, avg=1482.84, stdev=308.67 00:24:03.455 clat percentiles (msec): 00:24:03.455 | 1.00th=[ 144], 5.00th=[ 877], 10.00th=[ 1217], 20.00th=[ 1301], 00:24:03.455 | 30.00th=[ 1385], 40.00th=[ 1418], 50.00th=[ 1502], 60.00th=[ 1552], 00:24:03.455 | 70.00th=[ 1653], 80.00th=[ 1720], 90.00th=[ 1804], 95.00th=[ 1838], 00:24:03.455 | 99.00th=[ 1888], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], 00:24:03.455 | 99.99th=[ 1905] 00:24:03.455 bw ( KiB/s): min=28672, max=136942, per=1.57%, avg=80622.88, stdev=27620.81, samples=16 00:24:03.455 iops : min= 28, max= 133, avg=78.69, stdev=26.87, samples=16 00:24:03.455 lat (msec) : 100=0.64%, 250=0.90%, 500=1.03%, 750=1.03%, 1000=2.05% 00:24:03.455 lat (msec) : 2000=94.35% 00:24:03.455 cpu : usr=0.01%, sys=1.20%, ctx=1708, majf=0, minf=32769 00:24:03.455 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.0%, 16=2.1%, 32=4.1%, >=64=91.9% 00:24:03.455 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.455 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.455 issued rwts: total=779,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.455 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.455 job4: (groupid=0, jobs=1): err= 0: pid=4175144: Thu Apr 25 03:24:36 2024 00:24:03.455 read: IOPS=55, BW=56.0MiB/s (58.7MB/s)(564MiB/10078msec) 00:24:03.455 slat (usec): min=353, max=107451, avg=17727.87, stdev=19576.26 00:24:03.455 clat (msec): min=77, max=2989, avg=2013.59, stdev=630.06 00:24:03.455 lat (msec): min=78, max=3024, avg=2031.31, stdev=630.13 00:24:03.455 clat percentiles (msec): 00:24:03.455 | 1.00th=[ 146], 5.00th=[ 550], 10.00th=[ 1083], 20.00th=[ 1703], 00:24:03.455 | 30.00th=[ 1821], 40.00th=[ 1972], 50.00th=[ 2039], 60.00th=[ 2198], 00:24:03.455 | 70.00th=[ 2333], 80.00th=[ 2467], 90.00th=[ 2802], 95.00th=[ 2869], 00:24:03.455 | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 3004], 99.95th=[ 3004], 00:24:03.455 | 99.99th=[ 3004] 00:24:03.455 bw ( KiB/s): min= 4096, max=90112, per=1.09%, avg=55888.94, stdev=20499.46, samples=16 00:24:03.455 iops : min= 4, max= 88, avg=54.56, stdev=20.01, samples=16 00:24:03.455 lat (msec) : 100=0.89%, 250=0.89%, 500=2.48%, 750=2.66%, 1000=2.30% 00:24:03.455 lat (msec) : 2000=35.99%, >=2000=54.79% 00:24:03.455 cpu : usr=0.02%, sys=0.85%, ctx=1504, majf=0, minf=32769 00:24:03.455 IO depths : 1=0.2%, 2=0.4%, 4=0.7%, 8=1.4%, 16=2.8%, 32=5.7%, >=64=88.8% 00:24:03.455 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.455 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.455 issued rwts: total=564,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.455 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.455 job4: (groupid=0, jobs=1): err= 0: pid=4175145: Thu Apr 25 03:24:36 2024 00:24:03.455 read: IOPS=51, BW=51.1MiB/s (53.6MB/s)(516MiB/10090msec) 00:24:03.455 slat (usec): min=393, max=121751, avg=19403.79, stdev=24810.59 00:24:03.455 clat (msec): min=75, max=3472, avg=2181.74, stdev=800.63 00:24:03.455 lat (msec): min=96, max=3490, avg=2201.15, stdev=802.73 00:24:03.455 clat percentiles (msec): 00:24:03.455 | 1.00th=[ 268], 5.00th=[ 693], 10.00th=[ 1045], 20.00th=[ 1653], 00:24:03.455 | 30.00th=[ 1787], 40.00th=[ 1854], 50.00th=[ 2039], 60.00th=[ 2668], 00:24:03.455 | 70.00th=[ 2836], 80.00th=[ 2970], 90.00th=[ 3104], 95.00th=[ 3339], 00:24:03.455 | 99.00th=[ 3406], 99.50th=[ 3406], 99.90th=[ 3473], 99.95th=[ 3473], 00:24:03.455 | 99.99th=[ 3473] 00:24:03.455 bw ( KiB/s): min=24576, max=98304, per=1.03%, avg=52974.93, stdev=21435.86, samples=15 00:24:03.455 iops : min= 24, max= 96, avg=51.73, stdev=20.93, samples=15 00:24:03.455 lat (msec) : 100=0.39%, 250=0.58%, 500=1.55%, 750=3.88%, 1000=3.10% 00:24:03.455 lat (msec) : 2000=39.53%, >=2000=50.97% 00:24:03.455 cpu : usr=0.03%, sys=0.97%, ctx=1544, majf=0, minf=32769 00:24:03.455 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.1%, 32=6.2%, >=64=87.8% 00:24:03.455 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.455 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:24:03.455 issued rwts: total=516,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.455 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.455 job4: (groupid=0, jobs=1): err= 0: pid=4175146: Thu Apr 25 03:24:36 2024 00:24:03.455 read: IOPS=61, BW=61.7MiB/s (64.7MB/s)(623MiB/10096msec) 00:24:03.455 slat (usec): min=41, max=144393, avg=16064.58, stdev=26156.97 00:24:03.455 clat (msec): min=83, max=3775, avg=1937.56, stdev=878.38 00:24:03.455 lat (msec): min=141, max=3785, avg=1953.63, stdev=880.29 00:24:03.455 clat percentiles (msec): 00:24:03.455 | 1.00th=[ 249], 5.00th=[ 835], 10.00th=[ 852], 20.00th=[ 1099], 00:24:03.455 | 30.00th=[ 1318], 40.00th=[ 1687], 50.00th=[ 1905], 60.00th=[ 2072], 00:24:03.455 | 70.00th=[ 2265], 80.00th=[ 2735], 90.00th=[ 3373], 95.00th=[ 3540], 00:24:03.455 | 99.00th=[ 3742], 99.50th=[ 3775], 99.90th=[ 3775], 99.95th=[ 3775], 00:24:03.455 | 99.99th=[ 3775] 00:24:03.455 bw ( KiB/s): min=26624, max=157696, per=1.16%, avg=59753.41, stdev=37834.24, samples=17 00:24:03.455 iops : min= 26, max= 154, avg=58.35, stdev=36.95, samples=17 00:24:03.455 lat (msec) : 100=0.16%, 250=0.96%, 500=1.77%, 750=1.28%, 1000=11.72% 00:24:03.455 lat (msec) : 2000=39.65%, >=2000=44.46% 00:24:03.455 cpu : usr=0.03%, sys=1.41%, ctx=1401, majf=0, minf=32769 00:24:03.455 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.3%, 16=2.6%, 32=5.1%, >=64=89.9% 00:24:03.455 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.455 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.455 issued rwts: total=623,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.455 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.455 job4: (groupid=0, jobs=1): err= 0: pid=4175147: Thu Apr 25 03:24:36 2024 00:24:03.455 read: IOPS=107, BW=107MiB/s (112MB/s)(1076MiB/10053msec) 00:24:03.455 slat (usec): min=30, max=107523, avg=9303.20, stdev=21348.59 00:24:03.455 clat (msec): min=39, max=2770, avg=1025.74, stdev=493.91 00:24:03.455 lat (msec): min=81, max=2774, avg=1035.04, stdev=498.03 00:24:03.455 clat percentiles (msec): 00:24:03.455 | 1.00th=[ 115], 5.00th=[ 409], 10.00th=[ 776], 20.00th=[ 852], 00:24:03.455 | 30.00th=[ 869], 40.00th=[ 877], 50.00th=[ 885], 60.00th=[ 961], 00:24:03.455 | 70.00th=[ 969], 80.00th=[ 1070], 90.00th=[ 1552], 95.00th=[ 2500], 00:24:03.455 | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2769], 99.95th=[ 2769], 00:24:03.456 | 99.99th=[ 2769] 00:24:03.456 bw ( KiB/s): min=30720, max=157696, per=2.48%, avg=127707.43, stdev=39927.78, samples=14 00:24:03.456 iops : min= 30, max= 154, avg=124.71, stdev=38.99, samples=14 00:24:03.456 lat (msec) : 50=0.09%, 100=0.09%, 250=2.70%, 500=3.16%, 750=3.81% 00:24:03.456 lat (msec) : 1000=65.80%, 2000=16.54%, >=2000=7.81% 00:24:03.456 cpu : usr=0.03%, sys=1.12%, ctx=1418, majf=0, minf=32769 00:24:03.456 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.7%, 16=1.5%, 32=3.0%, >=64=94.1% 00:24:03.456 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.456 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:03.456 issued rwts: total=1076,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.456 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.456 job4: (groupid=0, jobs=1): err= 0: pid=4175148: Thu Apr 25 03:24:36 2024 00:24:03.456 read: IOPS=59, BW=59.9MiB/s (62.8MB/s)(604MiB/10081msec) 00:24:03.456 slat (usec): min=365, max=126271, avg=16559.14, stdev=19874.92 00:24:03.456 clat (msec): min=76, max=2623, avg=1943.43, stdev=527.93 00:24:03.456 lat (msec): min=81, max=2630, avg=1959.99, stdev=528.09 00:24:03.456 clat percentiles (msec): 00:24:03.456 | 1.00th=[ 171], 5.00th=[ 684], 10.00th=[ 1133], 20.00th=[ 1770], 00:24:03.456 | 30.00th=[ 1905], 40.00th=[ 2056], 50.00th=[ 2123], 60.00th=[ 2165], 00:24:03.456 | 70.00th=[ 2198], 80.00th=[ 2265], 90.00th=[ 2433], 95.00th=[ 2500], 00:24:03.456 | 99.00th=[ 2567], 99.50th=[ 2601], 99.90th=[ 2635], 99.95th=[ 2635], 00:24:03.456 | 99.99th=[ 2635] 00:24:03.456 bw ( KiB/s): min=36864, max=86016, per=1.12%, avg=57464.47, stdev=13917.94, samples=17 00:24:03.456 iops : min= 36, max= 84, avg=56.12, stdev=13.59, samples=17 00:24:03.456 lat (msec) : 100=0.83%, 250=0.99%, 500=1.99%, 750=2.81%, 1000=2.15% 00:24:03.456 lat (msec) : 2000=26.49%, >=2000=64.74% 00:24:03.456 cpu : usr=0.02%, sys=1.00%, ctx=1570, majf=0, minf=32769 00:24:03.456 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.3%, 16=2.6%, 32=5.3%, >=64=89.6% 00:24:03.456 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.456 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.456 issued rwts: total=604,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.456 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.456 job4: (groupid=0, jobs=1): err= 0: pid=4175149: Thu Apr 25 03:24:36 2024 00:24:03.456 read: IOPS=65, BW=65.3MiB/s (68.4MB/s)(660MiB/10114msec) 00:24:03.456 slat (usec): min=64, max=99577, avg=15180.83, stdev=19921.78 00:24:03.456 clat (msec): min=91, max=2672, avg=1823.42, stdev=531.68 00:24:03.456 lat (msec): min=138, max=2691, avg=1838.60, stdev=532.07 00:24:03.456 clat percentiles (msec): 00:24:03.456 | 1.00th=[ 222], 5.00th=[ 676], 10.00th=[ 1045], 20.00th=[ 1552], 00:24:03.456 | 30.00th=[ 1603], 40.00th=[ 1653], 50.00th=[ 1871], 60.00th=[ 2056], 00:24:03.456 | 70.00th=[ 2198], 80.00th=[ 2333], 90.00th=[ 2400], 95.00th=[ 2433], 00:24:03.456 | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2668], 99.95th=[ 2668], 00:24:03.456 | 99.99th=[ 2668] 00:24:03.456 bw ( KiB/s): min=34816, max=96063, per=1.25%, avg=64079.00, stdev=17770.00, samples=17 00:24:03.456 iops : min= 34, max= 93, avg=62.53, stdev=17.26, samples=17 00:24:03.456 lat (msec) : 100=0.15%, 250=1.06%, 500=2.27%, 750=2.27%, 1000=3.33% 00:24:03.456 lat (msec) : 2000=47.58%, >=2000=43.33% 00:24:03.456 cpu : usr=0.04%, sys=1.33%, ctx=1645, majf=0, minf=32769 00:24:03.456 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.4%, 32=4.8%, >=64=90.5% 00:24:03.456 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.456 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.456 issued rwts: total=660,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.456 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.456 job5: (groupid=0, jobs=1): err= 0: pid=4175152: Thu Apr 25 03:24:36 2024 00:24:03.456 read: IOPS=40, BW=40.7MiB/s (42.7MB/s)(411MiB/10091msec) 00:24:03.456 slat (usec): min=111, max=113242, avg=24335.03, stdev=27069.62 00:24:03.456 clat (msec): min=87, max=4016, avg=2675.17, stdev=984.37 00:24:03.456 lat (msec): min=93, max=4023, avg=2699.51, stdev=985.60 00:24:03.456 clat percentiles (msec): 00:24:03.456 | 1.00th=[ 142], 5.00th=[ 575], 10.00th=[ 1150], 20.00th=[ 1804], 00:24:03.456 | 30.00th=[ 2534], 40.00th=[ 2668], 50.00th=[ 2802], 60.00th=[ 2903], 00:24:03.456 | 70.00th=[ 3339], 80.00th=[ 3675], 90.00th=[ 3809], 95.00th=[ 3876], 00:24:03.456 | 99.00th=[ 3943], 99.50th=[ 4010], 99.90th=[ 4010], 99.95th=[ 4010], 00:24:03.456 | 99.99th=[ 4010] 00:24:03.456 bw ( KiB/s): min=10240, max=63488, per=0.75%, avg=38775.47, stdev=15058.95, samples=15 00:24:03.456 iops : min= 10, max= 62, avg=37.87, stdev=14.71, samples=15 00:24:03.456 lat (msec) : 100=0.49%, 250=1.70%, 500=2.43%, 750=1.70%, 1000=2.92% 00:24:03.456 lat (msec) : 2000=13.38%, >=2000=77.37% 00:24:03.456 cpu : usr=0.04%, sys=0.95%, ctx=1583, majf=0, minf=32769 00:24:03.456 IO depths : 1=0.2%, 2=0.5%, 4=1.0%, 8=1.9%, 16=3.9%, 32=7.8%, >=64=84.7% 00:24:03.456 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.456 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:24:03.456 issued rwts: total=411,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.456 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.456 job5: (groupid=0, jobs=1): err= 0: pid=4175153: Thu Apr 25 03:24:36 2024 00:24:03.456 read: IOPS=53, BW=53.1MiB/s (55.7MB/s)(536MiB/10088msec) 00:24:03.456 slat (usec): min=33, max=121542, avg=18664.36, stdev=22714.38 00:24:03.456 clat (msec): min=81, max=3283, avg=2266.54, stdev=771.61 00:24:03.456 lat (msec): min=89, max=3325, avg=2285.21, stdev=773.61 00:24:03.456 clat percentiles (msec): 00:24:03.456 | 1.00th=[ 109], 5.00th=[ 477], 10.00th=[ 969], 20.00th=[ 1804], 00:24:03.456 | 30.00th=[ 2089], 40.00th=[ 2299], 50.00th=[ 2467], 60.00th=[ 2668], 00:24:03.456 | 70.00th=[ 2769], 80.00th=[ 2869], 90.00th=[ 3037], 95.00th=[ 3104], 00:24:03.456 | 99.00th=[ 3205], 99.50th=[ 3239], 99.90th=[ 3272], 99.95th=[ 3272], 00:24:03.456 | 99.99th=[ 3272] 00:24:03.456 bw ( KiB/s): min=30720, max=83968, per=0.96%, avg=49278.00, stdev=13822.54, samples=17 00:24:03.456 iops : min= 30, max= 82, avg=48.12, stdev=13.50, samples=17 00:24:03.456 lat (msec) : 100=0.56%, 250=2.43%, 500=2.24%, 750=2.24%, 1000=2.99% 00:24:03.456 lat (msec) : 2000=15.49%, >=2000=74.07% 00:24:03.456 cpu : usr=0.00%, sys=1.26%, ctx=1576, majf=0, minf=32769 00:24:03.456 IO depths : 1=0.2%, 2=0.4%, 4=0.7%, 8=1.5%, 16=3.0%, 32=6.0%, >=64=88.2% 00:24:03.456 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.456 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.456 issued rwts: total=536,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.456 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.456 job5: (groupid=0, jobs=1): err= 0: pid=4175154: Thu Apr 25 03:24:36 2024 00:24:03.456 read: IOPS=46, BW=46.5MiB/s (48.8MB/s)(469MiB/10082msec) 00:24:03.456 slat (usec): min=33, max=213198, avg=21332.58, stdev=25144.92 00:24:03.456 clat (msec): min=74, max=3749, avg=2422.15, stdev=927.08 00:24:03.456 lat (msec): min=81, max=3752, avg=2443.48, stdev=927.41 00:24:03.456 clat percentiles (msec): 00:24:03.456 | 1.00th=[ 113], 5.00th=[ 443], 10.00th=[ 701], 20.00th=[ 2123], 00:24:03.456 | 30.00th=[ 2366], 40.00th=[ 2500], 50.00th=[ 2567], 60.00th=[ 2635], 00:24:03.456 | 70.00th=[ 2769], 80.00th=[ 3138], 90.00th=[ 3641], 95.00th=[ 3675], 00:24:03.456 | 99.00th=[ 3742], 99.50th=[ 3742], 99.90th=[ 3742], 99.95th=[ 3742], 00:24:03.456 | 99.99th=[ 3742] 00:24:03.456 bw ( KiB/s): min=18432, max=88064, per=0.85%, avg=43776.00, stdev=20286.23, samples=16 00:24:03.456 iops : min= 18, max= 86, avg=42.75, stdev=19.81, samples=16 00:24:03.456 lat (msec) : 100=0.85%, 250=1.71%, 500=4.26%, 750=4.05%, 1000=2.35% 00:24:03.456 lat (msec) : 2000=6.18%, >=2000=80.60% 00:24:03.456 cpu : usr=0.00%, sys=0.90%, ctx=1608, majf=0, minf=32769 00:24:03.457 IO depths : 1=0.2%, 2=0.4%, 4=0.9%, 8=1.7%, 16=3.4%, 32=6.8%, >=64=86.6% 00:24:03.457 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.457 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:24:03.457 issued rwts: total=469,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.457 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.457 job5: (groupid=0, jobs=1): err= 0: pid=4175155: Thu Apr 25 03:24:36 2024 00:24:03.457 read: IOPS=52, BW=52.6MiB/s (55.2MB/s)(530MiB/10075msec) 00:24:03.457 slat (usec): min=37, max=121387, avg=18876.59, stdev=24513.14 00:24:03.457 clat (msec): min=67, max=3165, avg=2220.55, stdev=694.65 00:24:03.457 lat (msec): min=153, max=3168, avg=2239.43, stdev=695.35 00:24:03.457 clat percentiles (msec): 00:24:03.457 | 1.00th=[ 184], 5.00th=[ 701], 10.00th=[ 1083], 20.00th=[ 1653], 00:24:03.457 | 30.00th=[ 1938], 40.00th=[ 2467], 50.00th=[ 2567], 60.00th=[ 2601], 00:24:03.457 | 70.00th=[ 2635], 80.00th=[ 2702], 90.00th=[ 2802], 95.00th=[ 2937], 00:24:03.457 | 99.00th=[ 3104], 99.50th=[ 3138], 99.90th=[ 3171], 99.95th=[ 3171], 00:24:03.457 | 99.99th=[ 3171] 00:24:03.457 bw ( KiB/s): min=34816, max=65536, per=0.94%, avg=48544.35, stdev=9408.56, samples=17 00:24:03.457 iops : min= 34, max= 64, avg=47.35, stdev= 9.21, samples=17 00:24:03.457 lat (msec) : 100=0.19%, 250=1.51%, 500=1.51%, 750=2.08%, 1000=3.96% 00:24:03.457 lat (msec) : 2000=21.51%, >=2000=69.25% 00:24:03.457 cpu : usr=0.00%, sys=1.05%, ctx=1503, majf=0, minf=32769 00:24:03.457 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.5%, 16=3.0%, 32=6.0%, >=64=88.1% 00:24:03.457 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.457 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.457 issued rwts: total=530,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.457 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.457 job5: (groupid=0, jobs=1): err= 0: pid=4175156: Thu Apr 25 03:24:36 2024 00:24:03.457 read: IOPS=38, BW=38.6MiB/s (40.4MB/s)(388MiB/10062msec) 00:24:03.457 slat (usec): min=29, max=203689, avg=25778.79, stdev=33393.61 00:24:03.457 clat (msec): min=58, max=5039, avg=2712.37, stdev=1528.72 00:24:03.457 lat (msec): min=62, max=5056, avg=2738.14, stdev=1534.76 00:24:03.457 clat percentiles (msec): 00:24:03.457 | 1.00th=[ 65], 5.00th=[ 234], 10.00th=[ 542], 20.00th=[ 1133], 00:24:03.457 | 30.00th=[ 1888], 40.00th=[ 2089], 50.00th=[ 2601], 60.00th=[ 3272], 00:24:03.457 | 70.00th=[ 3977], 80.00th=[ 4530], 90.00th=[ 4732], 95.00th=[ 4866], 00:24:03.457 | 99.00th=[ 5000], 99.50th=[ 5067], 99.90th=[ 5067], 99.95th=[ 5067], 00:24:03.457 | 99.99th=[ 5067] 00:24:03.457 bw ( KiB/s): min=12288, max=102400, per=0.74%, avg=38180.57, stdev=27972.63, samples=14 00:24:03.457 iops : min= 12, max= 100, avg=37.29, stdev=27.32, samples=14 00:24:03.457 lat (msec) : 100=2.84%, 250=2.58%, 500=3.87%, 750=3.61%, 1000=3.61% 00:24:03.457 lat (msec) : 2000=20.36%, >=2000=63.14% 00:24:03.457 cpu : usr=0.00%, sys=0.82%, ctx=1552, majf=0, minf=32769 00:24:03.457 IO depths : 1=0.3%, 2=0.5%, 4=1.0%, 8=2.1%, 16=4.1%, 32=8.2%, >=64=83.8% 00:24:03.457 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.457 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:24:03.457 issued rwts: total=388,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.457 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.457 job5: (groupid=0, jobs=1): err= 0: pid=4175157: Thu Apr 25 03:24:36 2024 00:24:03.457 read: IOPS=55, BW=55.1MiB/s (57.8MB/s)(557MiB/10113msec) 00:24:03.457 slat (usec): min=33, max=170244, avg=18056.32, stdev=23513.71 00:24:03.457 clat (msec): min=53, max=3116, avg=2134.14, stdev=771.33 00:24:03.457 lat (msec): min=136, max=3140, avg=2152.19, stdev=772.84 00:24:03.457 clat percentiles (msec): 00:24:03.457 | 1.00th=[ 146], 5.00th=[ 372], 10.00th=[ 776], 20.00th=[ 1485], 00:24:03.457 | 30.00th=[ 1921], 40.00th=[ 2299], 50.00th=[ 2400], 60.00th=[ 2467], 00:24:03.457 | 70.00th=[ 2601], 80.00th=[ 2769], 90.00th=[ 2937], 95.00th=[ 3004], 00:24:03.457 | 99.00th=[ 3071], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], 00:24:03.457 | 99.99th=[ 3104] 00:24:03.457 bw ( KiB/s): min=18395, max=79872, per=0.95%, avg=48815.89, stdev=15629.38, samples=18 00:24:03.457 iops : min= 17, max= 78, avg=47.61, stdev=15.37, samples=18 00:24:03.457 lat (msec) : 100=0.18%, 250=2.33%, 500=3.41%, 750=3.77%, 1000=1.97% 00:24:03.457 lat (msec) : 2000=19.75%, >=2000=68.58% 00:24:03.457 cpu : usr=0.01%, sys=1.12%, ctx=1537, majf=0, minf=32769 00:24:03.457 IO depths : 1=0.2%, 2=0.4%, 4=0.7%, 8=1.4%, 16=2.9%, 32=5.7%, >=64=88.7% 00:24:03.457 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.457 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.457 issued rwts: total=557,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.457 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.457 job5: (groupid=0, jobs=1): err= 0: pid=4175158: Thu Apr 25 03:24:36 2024 00:24:03.457 read: IOPS=44, BW=44.6MiB/s (46.8MB/s)(450MiB/10081msec) 00:24:03.457 slat (usec): min=453, max=129611, avg=22239.37, stdev=25901.71 00:24:03.457 clat (msec): min=71, max=3722, avg=2537.97, stdev=614.42 00:24:03.457 lat (msec): min=82, max=3749, avg=2560.21, stdev=608.62 00:24:03.457 clat percentiles (msec): 00:24:03.457 | 1.00th=[ 122], 5.00th=[ 1183], 10.00th=[ 1938], 20.00th=[ 2366], 00:24:03.457 | 30.00th=[ 2467], 40.00th=[ 2500], 50.00th=[ 2601], 60.00th=[ 2735], 00:24:03.457 | 70.00th=[ 2769], 80.00th=[ 2802], 90.00th=[ 3104], 95.00th=[ 3507], 00:24:03.457 | 99.00th=[ 3675], 99.50th=[ 3708], 99.90th=[ 3708], 99.95th=[ 3708], 00:24:03.457 | 99.99th=[ 3708] 00:24:03.457 bw ( KiB/s): min=16384, max=61440, per=0.80%, avg=41344.00, stdev=14715.58, samples=16 00:24:03.457 iops : min= 16, max= 60, avg=40.38, stdev=14.37, samples=16 00:24:03.457 lat (msec) : 100=0.89%, 250=0.67%, 500=0.89%, 750=1.11%, 1000=1.11% 00:24:03.457 lat (msec) : 2000=5.33%, >=2000=90.00% 00:24:03.457 cpu : usr=0.01%, sys=0.85%, ctx=1561, majf=0, minf=32769 00:24:03.457 IO depths : 1=0.2%, 2=0.4%, 4=0.9%, 8=1.8%, 16=3.6%, 32=7.1%, >=64=86.0% 00:24:03.457 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.457 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:24:03.457 issued rwts: total=450,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.457 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.457 job5: (groupid=0, jobs=1): err= 0: pid=4175159: Thu Apr 25 03:24:36 2024 00:24:03.457 read: IOPS=60, BW=61.0MiB/s (64.0MB/s)(614MiB/10066msec) 00:24:03.457 slat (usec): min=32, max=123098, avg=16283.54, stdev=23367.70 00:24:03.457 clat (msec): min=65, max=3355, avg=1956.11, stdev=899.30 00:24:03.457 lat (msec): min=67, max=3371, avg=1972.39, stdev=903.86 00:24:03.457 clat percentiles (msec): 00:24:03.457 | 1.00th=[ 71], 5.00th=[ 268], 10.00th=[ 634], 20.00th=[ 1217], 00:24:03.457 | 30.00th=[ 1318], 40.00th=[ 1787], 50.00th=[ 1989], 60.00th=[ 2333], 00:24:03.457 | 70.00th=[ 2567], 80.00th=[ 2903], 90.00th=[ 3171], 95.00th=[ 3272], 00:24:03.457 | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], 00:24:03.457 | 99.99th=[ 3339] 00:24:03.457 bw ( KiB/s): min=26624, max=114688, per=1.00%, avg=51566.94, stdev=21173.99, samples=17 00:24:03.457 iops : min= 26, max= 112, avg=50.35, stdev=20.68, samples=17 00:24:03.457 lat (msec) : 100=1.95%, 250=0.98%, 500=6.35%, 750=1.47%, 1000=1.79% 00:24:03.457 lat (msec) : 2000=37.95%, >=2000=49.51% 00:24:03.457 cpu : usr=0.02%, sys=1.06%, ctx=1443, majf=0, minf=32769 00:24:03.457 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.3%, 16=2.6%, 32=5.2%, >=64=89.7% 00:24:03.457 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.457 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.457 issued rwts: total=614,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.457 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.458 job5: (groupid=0, jobs=1): err= 0: pid=4175160: Thu Apr 25 03:24:36 2024 00:24:03.458 read: IOPS=50, BW=50.3MiB/s (52.8MB/s)(508MiB/10098msec) 00:24:03.458 slat (usec): min=44, max=111228, avg=19720.92, stdev=23511.28 00:24:03.458 clat (msec): min=77, max=3626, avg=2215.70, stdev=772.79 00:24:03.458 lat (msec): min=106, max=3647, avg=2235.42, stdev=772.47 00:24:03.458 clat percentiles (msec): 00:24:03.458 | 1.00th=[ 186], 5.00th=[ 609], 10.00th=[ 1116], 20.00th=[ 1636], 00:24:03.458 | 30.00th=[ 2089], 40.00th=[ 2265], 50.00th=[ 2366], 60.00th=[ 2400], 00:24:03.458 | 70.00th=[ 2534], 80.00th=[ 2769], 90.00th=[ 3205], 95.00th=[ 3406], 00:24:03.458 | 99.00th=[ 3608], 99.50th=[ 3608], 99.90th=[ 3641], 99.95th=[ 3641], 00:24:03.458 | 99.99th=[ 3641] 00:24:03.458 bw ( KiB/s): min= 8192, max=106496, per=0.95%, avg=48648.12, stdev=25630.80, samples=16 00:24:03.458 iops : min= 8, max= 104, avg=47.44, stdev=25.07, samples=16 00:24:03.458 lat (msec) : 100=0.20%, 250=1.38%, 500=2.76%, 750=2.56%, 1000=1.97% 00:24:03.458 lat (msec) : 2000=18.70%, >=2000=72.44% 00:24:03.458 cpu : usr=0.01%, sys=0.91%, ctx=1522, majf=0, minf=32769 00:24:03.458 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.1%, 32=6.3%, >=64=87.6% 00:24:03.458 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.458 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:24:03.458 issued rwts: total=508,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.458 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.458 job5: (groupid=0, jobs=1): err= 0: pid=4175161: Thu Apr 25 03:24:36 2024 00:24:03.458 read: IOPS=156, BW=157MiB/s (164MB/s)(1578MiB/10074msec) 00:24:03.458 slat (usec): min=35, max=89449, avg=6347.51, stdev=15938.27 00:24:03.458 clat (msec): min=51, max=1198, avg=760.05, stdev=143.52 00:24:03.458 lat (msec): min=124, max=1205, avg=766.40, stdev=144.47 00:24:03.458 clat percentiles (msec): 00:24:03.458 | 1.00th=[ 144], 5.00th=[ 584], 10.00th=[ 684], 20.00th=[ 693], 00:24:03.458 | 30.00th=[ 701], 40.00th=[ 726], 50.00th=[ 751], 60.00th=[ 768], 00:24:03.458 | 70.00th=[ 793], 80.00th=[ 852], 90.00th=[ 927], 95.00th=[ 978], 00:24:03.458 | 99.00th=[ 1116], 99.50th=[ 1150], 99.90th=[ 1200], 99.95th=[ 1200], 00:24:03.458 | 99.99th=[ 1200] 00:24:03.458 bw ( KiB/s): min=104448, max=190464, per=3.22%, avg=165526.59, stdev=24759.16, samples=17 00:24:03.458 iops : min= 102, max= 186, avg=161.65, stdev=24.18, samples=17 00:24:03.458 lat (msec) : 100=0.06%, 250=1.90%, 500=2.09%, 750=44.74%, 1000=47.53% 00:24:03.458 lat (msec) : 2000=3.68% 00:24:03.458 cpu : usr=0.03%, sys=1.55%, ctx=1523, majf=0, minf=32769 00:24:03.458 IO depths : 1=0.1%, 2=0.1%, 4=0.3%, 8=0.5%, 16=1.0%, 32=2.0%, >=64=96.0% 00:24:03.458 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.458 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:03.458 issued rwts: total=1578,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.458 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.458 job5: (groupid=0, jobs=1): err= 0: pid=4175162: Thu Apr 25 03:24:36 2024 00:24:03.458 read: IOPS=57, BW=57.6MiB/s (60.4MB/s)(585MiB/10149msec) 00:24:03.458 slat (usec): min=34, max=116627, avg=17228.48, stdev=26338.36 00:24:03.458 clat (msec): min=67, max=3567, avg=1960.69, stdev=922.05 00:24:03.458 lat (msec): min=153, max=3583, avg=1977.91, stdev=923.38 00:24:03.458 clat percentiles (msec): 00:24:03.458 | 1.00th=[ 228], 5.00th=[ 642], 10.00th=[ 651], 20.00th=[ 936], 00:24:03.458 | 30.00th=[ 1318], 40.00th=[ 1603], 50.00th=[ 2106], 60.00th=[ 2366], 00:24:03.458 | 70.00th=[ 2601], 80.00th=[ 2903], 90.00th=[ 3104], 95.00th=[ 3339], 00:24:03.458 | 99.00th=[ 3507], 99.50th=[ 3540], 99.90th=[ 3574], 99.95th=[ 3574], 00:24:03.458 | 99.99th=[ 3574] 00:24:03.458 bw ( KiB/s): min=10240, max=186368, per=1.21%, avg=62395.73, stdev=48122.50, samples=15 00:24:03.458 iops : min= 10, max= 182, avg=60.93, stdev=46.99, samples=15 00:24:03.458 lat (msec) : 100=0.17%, 250=0.85%, 500=1.37%, 750=13.68%, 1000=5.13% 00:24:03.458 lat (msec) : 2000=26.50%, >=2000=52.31% 00:24:03.458 cpu : usr=0.00%, sys=1.06%, ctx=1573, majf=0, minf=32769 00:24:03.458 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.4%, 16=2.7%, 32=5.5%, >=64=89.2% 00:24:03.458 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.458 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.458 issued rwts: total=585,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.458 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.458 job5: (groupid=0, jobs=1): err= 0: pid=4175164: Thu Apr 25 03:24:36 2024 00:24:03.458 read: IOPS=96, BW=96.5MiB/s (101MB/s)(973MiB/10078msec) 00:24:03.458 slat (usec): min=29, max=153052, avg=10275.59, stdev=18691.02 00:24:03.458 clat (msec): min=75, max=3048, avg=1215.96, stdev=665.93 00:24:03.458 lat (msec): min=78, max=3049, avg=1226.23, stdev=668.86 00:24:03.458 clat percentiles (msec): 00:24:03.458 | 1.00th=[ 153], 5.00th=[ 401], 10.00th=[ 667], 20.00th=[ 693], 00:24:03.458 | 30.00th=[ 751], 40.00th=[ 818], 50.00th=[ 1045], 60.00th=[ 1200], 00:24:03.458 | 70.00th=[ 1485], 80.00th=[ 1720], 90.00th=[ 2198], 95.00th=[ 2702], 00:24:03.458 | 99.00th=[ 3004], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], 00:24:03.458 | 99.99th=[ 3037] 00:24:03.458 bw ( KiB/s): min=12288, max=188416, per=1.87%, avg=96256.00, stdev=59725.47, samples=18 00:24:03.458 iops : min= 12, max= 184, avg=94.00, stdev=58.33, samples=18 00:24:03.458 lat (msec) : 100=0.21%, 250=2.98%, 500=4.32%, 750=21.89%, 1000=18.40% 00:24:03.458 lat (msec) : 2000=40.08%, >=2000=12.13% 00:24:03.458 cpu : usr=0.05%, sys=1.36%, ctx=1486, majf=0, minf=32769 00:24:03.458 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.6%, 32=3.3%, >=64=93.5% 00:24:03.458 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.458 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:03.458 issued rwts: total=973,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.458 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.458 job5: (groupid=0, jobs=1): err= 0: pid=4175165: Thu Apr 25 03:24:36 2024 00:24:03.458 read: IOPS=53, BW=53.1MiB/s (55.7MB/s)(535MiB/10077msec) 00:24:03.458 slat (usec): min=28, max=163289, avg=18715.16, stdev=29171.72 00:24:03.458 clat (msec): min=61, max=5411, avg=2080.34, stdev=1479.54 00:24:03.458 lat (msec): min=82, max=5485, avg=2099.05, stdev=1484.68 00:24:03.459 clat percentiles (msec): 00:24:03.459 | 1.00th=[ 313], 5.00th=[ 625], 10.00th=[ 676], 20.00th=[ 743], 00:24:03.459 | 30.00th=[ 1053], 40.00th=[ 1368], 50.00th=[ 1620], 60.00th=[ 1955], 00:24:03.459 | 70.00th=[ 2123], 80.00th=[ 3272], 90.00th=[ 4933], 95.00th=[ 5201], 00:24:03.459 | 99.00th=[ 5403], 99.50th=[ 5403], 99.90th=[ 5403], 99.95th=[ 5403], 00:24:03.459 | 99.99th=[ 5403] 00:24:03.459 bw ( KiB/s): min= 8192, max=196608, per=1.25%, avg=64118.15, stdev=61754.27, samples=13 00:24:03.459 iops : min= 8, max= 192, avg=62.62, stdev=60.31, samples=13 00:24:03.459 lat (msec) : 100=0.75%, 250=0.19%, 500=0.93%, 750=18.13%, 1000=7.85% 00:24:03.459 lat (msec) : 2000=34.02%, >=2000=38.13% 00:24:03.459 cpu : usr=0.02%, sys=1.06%, ctx=1560, majf=0, minf=32769 00:24:03.459 IO depths : 1=0.2%, 2=0.4%, 4=0.7%, 8=1.5%, 16=3.0%, 32=6.0%, >=64=88.2% 00:24:03.459 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.459 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:24:03.459 issued rwts: total=535,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.459 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:03.459 00:24:03.459 Run status group 0 (all jobs): 00:24:03.459 READ: bw=5020MiB/s (5264MB/s), 25.6MiB/s-157MiB/s (26.9MB/s-164MB/s), io=49.8GiB (53.4GB), run=10039-10149msec 00:24:03.459 00:24:03.459 Disk stats (read/write): 00:24:03.459 nvme0n1: ios=69074/0, merge=0/0, ticks=6776653/0, in_queue=6776653, util=98.62% 00:24:03.459 nvme2n1: ios=53798/0, merge=0/0, ticks=5239452/0, in_queue=5239452, util=98.52% 00:24:03.459 nvme3n1: ios=67568/0, merge=0/0, ticks=6549279/0, in_queue=6549279, util=98.79% 00:24:03.459 nvme4n1: ios=68962/0, merge=0/0, ticks=6725270/0, in_queue=6725270, util=99.04% 00:24:03.459 nvme5n1: ios=79313/0, merge=0/0, ticks=7633865/0, in_queue=7633865, util=99.12% 00:24:03.459 nvme6n1: ios=64262/0, merge=0/0, ticks=6310493/0, in_queue=6310493, util=99.11% 00:24:03.459 03:24:36 -- target/srq_overwhelm.sh@38 -- # sync 00:24:03.459 03:24:36 -- target/srq_overwhelm.sh@40 -- # seq 0 5 00:24:03.459 03:24:36 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:24:03.459 03:24:36 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode0 00:24:03.459 NQN:nqn.2016-06.io.spdk:cnode0 disconnected 1 controller(s) 00:24:03.459 03:24:37 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000000 00:24:03.459 03:24:37 -- common/autotest_common.sh@1205 -- # local i=0 00:24:03.459 03:24:37 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:24:03.459 03:24:37 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000000 00:24:03.459 03:24:37 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:24:03.459 03:24:37 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000000 00:24:03.459 03:24:37 -- common/autotest_common.sh@1217 -- # return 0 00:24:03.459 03:24:37 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:24:03.459 03:24:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:03.459 03:24:37 -- common/autotest_common.sh@10 -- # set +x 00:24:03.459 03:24:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:03.459 03:24:37 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:24:03.459 03:24:37 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:24:04.025 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:24:04.025 03:24:38 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000001 00:24:04.025 03:24:38 -- common/autotest_common.sh@1205 -- # local i=0 00:24:04.025 03:24:38 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:24:04.025 03:24:38 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000001 00:24:04.025 03:24:38 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000001 00:24:04.025 03:24:38 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:24:04.025 03:24:38 -- common/autotest_common.sh@1217 -- # return 0 00:24:04.025 03:24:38 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:04.025 03:24:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:04.025 03:24:38 -- common/autotest_common.sh@10 -- # set +x 00:24:04.025 03:24:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:04.025 03:24:38 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:24:04.025 03:24:38 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:24:04.960 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:24:04.960 03:24:39 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000002 00:24:04.960 03:24:39 -- common/autotest_common.sh@1205 -- # local i=0 00:24:04.960 03:24:39 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:24:04.960 03:24:39 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000002 00:24:04.960 03:24:39 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:24:04.960 03:24:39 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000002 00:24:04.960 03:24:39 -- common/autotest_common.sh@1217 -- # return 0 00:24:04.960 03:24:39 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:24:04.960 03:24:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:04.960 03:24:39 -- common/autotest_common.sh@10 -- # set +x 00:24:04.960 03:24:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:04.960 03:24:39 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:24:04.960 03:24:39 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:24:05.893 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:24:05.893 03:24:40 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000003 00:24:05.893 03:24:40 -- common/autotest_common.sh@1205 -- # local i=0 00:24:05.893 03:24:40 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:24:05.893 03:24:40 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000003 00:24:05.893 03:24:40 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:24:05.893 03:24:40 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000003 00:24:05.893 03:24:40 -- common/autotest_common.sh@1217 -- # return 0 00:24:05.893 03:24:40 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:24:05.893 03:24:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:05.893 03:24:40 -- common/autotest_common.sh@10 -- # set +x 00:24:05.893 03:24:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:05.893 03:24:40 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:24:05.893 03:24:40 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:24:06.827 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:24:06.827 03:24:41 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000004 00:24:06.827 03:24:41 -- common/autotest_common.sh@1205 -- # local i=0 00:24:06.827 03:24:41 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:24:06.827 03:24:41 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000004 00:24:06.827 03:24:41 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:24:06.827 03:24:41 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000004 00:24:06.827 03:24:41 -- common/autotest_common.sh@1217 -- # return 0 00:24:06.827 03:24:41 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:24:06.827 03:24:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:06.827 03:24:41 -- common/autotest_common.sh@10 -- # set +x 00:24:06.827 03:24:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:06.827 03:24:41 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:24:06.827 03:24:41 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:24:07.761 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:24:07.761 03:24:41 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000005 00:24:07.761 03:24:41 -- common/autotest_common.sh@1205 -- # local i=0 00:24:07.761 03:24:41 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:24:07.761 03:24:41 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000005 00:24:07.761 03:24:41 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:24:07.761 03:24:41 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000005 00:24:07.761 03:24:41 -- common/autotest_common.sh@1217 -- # return 0 00:24:07.761 03:24:41 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:24:07.761 03:24:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:07.761 03:24:41 -- common/autotest_common.sh@10 -- # set +x 00:24:07.761 03:24:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:07.761 03:24:41 -- target/srq_overwhelm.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:24:07.761 03:24:41 -- target/srq_overwhelm.sh@48 -- # nvmftestfini 00:24:07.761 03:24:41 -- nvmf/common.sh@477 -- # nvmfcleanup 00:24:07.761 03:24:41 -- nvmf/common.sh@117 -- # sync 00:24:07.761 03:24:41 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:24:07.761 03:24:41 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:24:07.761 03:24:41 -- nvmf/common.sh@120 -- # set +e 00:24:07.761 03:24:41 -- nvmf/common.sh@121 -- # for i in {1..20} 00:24:07.761 03:24:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:24:07.761 rmmod nvme_rdma 00:24:07.761 rmmod nvme_fabrics 00:24:07.761 03:24:41 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:24:07.761 03:24:42 -- nvmf/common.sh@124 -- # set -e 00:24:07.761 03:24:42 -- nvmf/common.sh@125 -- # return 0 00:24:07.761 03:24:42 -- nvmf/common.sh@478 -- # '[' -n 4174402 ']' 00:24:07.761 03:24:42 -- nvmf/common.sh@479 -- # killprocess 4174402 00:24:07.761 03:24:42 -- common/autotest_common.sh@936 -- # '[' -z 4174402 ']' 00:24:07.761 03:24:42 -- common/autotest_common.sh@940 -- # kill -0 4174402 00:24:07.761 03:24:42 -- common/autotest_common.sh@941 -- # uname 00:24:07.761 03:24:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:07.761 03:24:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4174402 00:24:07.761 03:24:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:07.761 03:24:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:07.761 03:24:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4174402' 00:24:07.761 killing process with pid 4174402 00:24:07.761 03:24:42 -- common/autotest_common.sh@955 -- # kill 4174402 00:24:07.761 03:24:42 -- common/autotest_common.sh@960 -- # wait 4174402 00:24:07.761 [2024-04-25 03:24:42.079281] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:24:08.020 03:24:42 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:24:08.020 03:24:42 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:24:08.020 00:24:08.020 real 0m25.830s 00:24:08.020 user 1m25.621s 00:24:08.020 sys 0m15.531s 00:24:08.020 03:24:42 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:24:08.020 03:24:42 -- common/autotest_common.sh@10 -- # set +x 00:24:08.020 ************************************ 00:24:08.020 END TEST nvmf_srq_overwhelm 00:24:08.020 ************************************ 00:24:08.020 03:24:42 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=rdma 00:24:08.020 03:24:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:08.020 03:24:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:08.020 03:24:42 -- common/autotest_common.sh@10 -- # set +x 00:24:08.279 ************************************ 00:24:08.279 START TEST nvmf_shutdown 00:24:08.279 ************************************ 00:24:08.279 03:24:42 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=rdma 00:24:08.279 * Looking for test storage... 00:24:08.279 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:24:08.279 03:24:42 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:24:08.279 03:24:42 -- nvmf/common.sh@7 -- # uname -s 00:24:08.279 03:24:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:08.279 03:24:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:08.279 03:24:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:08.279 03:24:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:08.279 03:24:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:08.279 03:24:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:08.279 03:24:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:08.279 03:24:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:08.279 03:24:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:08.279 03:24:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:08.279 03:24:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:24:08.279 03:24:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:24:08.279 03:24:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:08.279 03:24:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:08.279 03:24:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:08.279 03:24:42 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:24:08.279 03:24:42 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:24:08.279 03:24:42 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:08.279 03:24:42 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:08.279 03:24:42 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:08.279 03:24:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:08.279 03:24:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:08.279 03:24:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:08.279 03:24:42 -- paths/export.sh@5 -- # export PATH 00:24:08.279 03:24:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:08.279 03:24:42 -- nvmf/common.sh@47 -- # : 0 00:24:08.279 03:24:42 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:24:08.279 03:24:42 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:24:08.279 03:24:42 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:24:08.279 03:24:42 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:08.279 03:24:42 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:08.279 03:24:42 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:24:08.279 03:24:42 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:24:08.279 03:24:42 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:24:08.279 03:24:42 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:24:08.279 03:24:42 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:24:08.279 03:24:42 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:24:08.279 03:24:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:24:08.279 03:24:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:08.279 03:24:42 -- common/autotest_common.sh@10 -- # set +x 00:24:08.279 ************************************ 00:24:08.279 START TEST nvmf_shutdown_tc1 00:24:08.279 ************************************ 00:24:08.279 03:24:42 -- common/autotest_common.sh@1111 -- # nvmf_shutdown_tc1 00:24:08.279 03:24:42 -- target/shutdown.sh@74 -- # starttarget 00:24:08.279 03:24:42 -- target/shutdown.sh@15 -- # nvmftestinit 00:24:08.279 03:24:42 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:24:08.279 03:24:42 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:08.279 03:24:42 -- nvmf/common.sh@437 -- # prepare_net_devs 00:24:08.279 03:24:42 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:24:08.279 03:24:42 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:24:08.279 03:24:42 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:08.279 03:24:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:08.279 03:24:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:08.279 03:24:42 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:24:08.279 03:24:42 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:24:08.279 03:24:42 -- nvmf/common.sh@285 -- # xtrace_disable 00:24:08.279 03:24:42 -- common/autotest_common.sh@10 -- # set +x 00:24:14.839 03:24:48 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:14.839 03:24:48 -- nvmf/common.sh@291 -- # pci_devs=() 00:24:14.839 03:24:48 -- nvmf/common.sh@291 -- # local -a pci_devs 00:24:14.839 03:24:48 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:24:14.839 03:24:48 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:24:14.839 03:24:48 -- nvmf/common.sh@293 -- # pci_drivers=() 00:24:14.839 03:24:48 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:24:14.839 03:24:48 -- nvmf/common.sh@295 -- # net_devs=() 00:24:14.839 03:24:48 -- nvmf/common.sh@295 -- # local -ga net_devs 00:24:14.839 03:24:48 -- nvmf/common.sh@296 -- # e810=() 00:24:14.839 03:24:48 -- nvmf/common.sh@296 -- # local -ga e810 00:24:14.839 03:24:48 -- nvmf/common.sh@297 -- # x722=() 00:24:14.839 03:24:48 -- nvmf/common.sh@297 -- # local -ga x722 00:24:14.839 03:24:48 -- nvmf/common.sh@298 -- # mlx=() 00:24:14.839 03:24:48 -- nvmf/common.sh@298 -- # local -ga mlx 00:24:14.839 03:24:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:14.839 03:24:48 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:14.839 03:24:48 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:14.839 03:24:48 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:14.839 03:24:48 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:14.839 03:24:48 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:14.839 03:24:48 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:14.839 03:24:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:14.839 03:24:48 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:14.839 03:24:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:14.839 03:24:48 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:14.839 03:24:48 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:24:14.839 03:24:48 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:24:14.839 03:24:48 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:24:14.839 03:24:48 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:24:14.839 03:24:48 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:24:14.839 03:24:48 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:24:14.839 03:24:48 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:24:14.839 03:24:48 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:24:14.839 03:24:48 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:14.839 03:24:48 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:24:14.839 Found 0000:af:00.0 (0x8086 - 0x159b) 00:24:14.839 03:24:48 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:24:14.839 03:24:48 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:24:14.839 03:24:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:14.839 03:24:48 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:14.839 03:24:48 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:24:14.839 03:24:48 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:24:14.839 03:24:48 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:14.839 03:24:48 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:24:14.839 Found 0000:af:00.1 (0x8086 - 0x159b) 00:24:14.839 03:24:48 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:24:14.839 03:24:48 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:24:14.839 03:24:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:14.839 03:24:48 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:14.839 03:24:48 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:24:14.839 03:24:48 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:24:14.839 03:24:48 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:24:14.839 03:24:48 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:24:14.839 03:24:48 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:24:14.839 03:24:48 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:24:14.839 03:24:48 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:24:14.839 03:24:48 -- nvmf/common.sh@377 -- # modinfo irdma 00:24:14.839 03:24:48 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:24:14.839 03:24:48 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:14.839 03:24:48 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:14.839 03:24:48 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:14.839 03:24:48 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:14.839 03:24:48 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:24:14.840 Found net devices under 0000:af:00.0: cvl_0_0 00:24:14.840 03:24:48 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:14.840 03:24:48 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:14.840 03:24:48 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:14.840 03:24:48 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:14.840 03:24:48 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:14.840 03:24:48 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:24:14.840 Found net devices under 0000:af:00.1: cvl_0_1 00:24:14.840 03:24:48 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:14.840 03:24:48 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:24:14.840 03:24:48 -- nvmf/common.sh@403 -- # is_hw=yes 00:24:14.840 03:24:48 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:24:14.840 03:24:48 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:24:14.840 03:24:48 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:24:14.840 03:24:48 -- nvmf/common.sh@409 -- # rdma_device_init 00:24:14.840 03:24:48 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:24:14.840 03:24:48 -- nvmf/common.sh@58 -- # uname 00:24:14.840 03:24:48 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:24:14.840 03:24:48 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:24:14.840 03:24:48 -- nvmf/common.sh@63 -- # modprobe ib_core 00:24:14.840 03:24:48 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:24:14.840 03:24:48 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:24:14.840 03:24:48 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:24:14.840 03:24:48 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:24:14.840 03:24:48 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:24:14.840 03:24:48 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:24:14.840 03:24:48 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:24:14.840 03:24:48 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:24:14.840 03:24:48 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:24:14.840 03:24:48 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:24:14.840 03:24:48 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:24:14.840 03:24:48 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:24:14.840 03:24:48 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:24:14.840 03:24:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:14.840 03:24:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:14.840 03:24:48 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:24:14.840 03:24:48 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:24:14.840 03:24:48 -- nvmf/common.sh@105 -- # continue 2 00:24:14.840 03:24:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:14.840 03:24:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:14.840 03:24:48 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:24:14.840 03:24:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:14.840 03:24:48 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:24:14.840 03:24:48 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:24:14.840 03:24:48 -- nvmf/common.sh@105 -- # continue 2 00:24:14.840 03:24:48 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:24:14.840 03:24:48 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:24:14.840 03:24:48 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:24:14.840 03:24:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:24:14.840 03:24:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:14.840 03:24:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:14.840 03:24:48 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:24:14.840 03:24:48 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:24:14.840 03:24:48 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:24:14.840 50: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:24:14.840 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:24:14.840 altname enp175s0f0np0 00:24:14.840 altname ens801f0np0 00:24:14.840 inet 192.168.100.8/24 scope global cvl_0_0 00:24:14.840 valid_lft forever preferred_lft forever 00:24:14.840 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:24:14.840 valid_lft forever preferred_lft forever 00:24:14.840 03:24:48 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:24:14.840 03:24:48 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:24:14.840 03:24:48 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:24:14.840 03:24:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:24:14.840 03:24:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:14.840 03:24:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:14.840 03:24:48 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:24:14.840 03:24:48 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:24:14.840 03:24:48 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:24:14.840 51: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:24:14.840 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:24:14.840 altname enp175s0f1np1 00:24:14.840 altname ens801f1np1 00:24:14.840 inet 192.168.100.9/24 scope global cvl_0_1 00:24:14.840 valid_lft forever preferred_lft forever 00:24:14.840 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:24:14.840 valid_lft forever preferred_lft forever 00:24:14.840 03:24:48 -- nvmf/common.sh@411 -- # return 0 00:24:14.840 03:24:48 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:24:14.840 03:24:48 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:24:14.840 03:24:48 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:24:14.840 03:24:48 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:24:14.840 03:24:48 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:24:14.840 03:24:48 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:24:14.840 03:24:48 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:24:14.840 03:24:48 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:24:14.840 03:24:48 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:24:14.840 03:24:48 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:24:14.840 03:24:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:14.840 03:24:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:14.840 03:24:48 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:24:14.840 03:24:48 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:24:14.840 03:24:48 -- nvmf/common.sh@105 -- # continue 2 00:24:14.840 03:24:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:14.840 03:24:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:14.840 03:24:48 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:24:14.840 03:24:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:14.840 03:24:48 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:24:14.840 03:24:48 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:24:14.840 03:24:48 -- nvmf/common.sh@105 -- # continue 2 00:24:14.840 03:24:48 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:24:14.840 03:24:48 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:24:14.840 03:24:48 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:24:14.840 03:24:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:24:14.840 03:24:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:14.840 03:24:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:14.840 03:24:48 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:24:14.840 03:24:48 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:24:14.840 03:24:48 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:24:14.840 03:24:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:24:14.840 03:24:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:14.840 03:24:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:14.840 03:24:48 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:24:14.840 192.168.100.9' 00:24:14.840 03:24:48 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:24:14.840 192.168.100.9' 00:24:14.840 03:24:48 -- nvmf/common.sh@446 -- # head -n 1 00:24:14.840 03:24:48 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:24:14.840 03:24:48 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:24:14.840 192.168.100.9' 00:24:14.840 03:24:48 -- nvmf/common.sh@447 -- # head -n 1 00:24:14.840 03:24:48 -- nvmf/common.sh@447 -- # tail -n +2 00:24:14.840 03:24:48 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:24:14.840 03:24:48 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:24:14.840 03:24:48 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:24:14.840 03:24:48 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:24:14.840 03:24:48 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:24:14.840 03:24:48 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:24:14.840 03:24:48 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:24:14.840 03:24:48 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:24:14.840 03:24:48 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:14.840 03:24:48 -- common/autotest_common.sh@10 -- # set +x 00:24:14.840 03:24:48 -- nvmf/common.sh@470 -- # nvmfpid=4180944 00:24:14.840 03:24:48 -- nvmf/common.sh@471 -- # waitforlisten 4180944 00:24:14.840 03:24:48 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:24:14.840 03:24:48 -- common/autotest_common.sh@817 -- # '[' -z 4180944 ']' 00:24:14.840 03:24:48 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:14.840 03:24:48 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:14.840 03:24:48 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:14.840 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:14.840 03:24:48 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:14.840 03:24:48 -- common/autotest_common.sh@10 -- # set +x 00:24:14.840 [2024-04-25 03:24:48.583595] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:24:14.840 [2024-04-25 03:24:48.583635] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:14.840 EAL: No free 2048 kB hugepages reported on node 1 00:24:14.840 [2024-04-25 03:24:48.642191] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:14.840 [2024-04-25 03:24:48.710601] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:14.840 [2024-04-25 03:24:48.710641] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:14.840 [2024-04-25 03:24:48.710647] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:24:14.840 [2024-04-25 03:24:48.710653] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:24:14.840 [2024-04-25 03:24:48.710658] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:14.840 [2024-04-25 03:24:48.710776] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:14.840 [2024-04-25 03:24:48.710881] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:14.841 [2024-04-25 03:24:48.711005] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:14.841 [2024-04-25 03:24:48.711006] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:24:15.104 03:24:49 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:15.105 03:24:49 -- common/autotest_common.sh@850 -- # return 0 00:24:15.105 03:24:49 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:24:15.105 03:24:49 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:15.105 03:24:49 -- common/autotest_common.sh@10 -- # set +x 00:24:15.105 03:24:49 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:15.105 03:24:49 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:24:15.105 03:24:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:15.105 03:24:49 -- common/autotest_common.sh@10 -- # set +x 00:24:15.105 [2024-04-25 03:24:49.441925] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0xac2190/0xac17d0) succeed. 00:24:15.105 [2024-04-25 03:24:49.452024] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0xac3500/0xac1d50) succeed. 00:24:15.105 [2024-04-25 03:24:49.452046] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:24:15.105 03:24:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:15.105 03:24:49 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:24:15.105 03:24:49 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:24:15.105 03:24:49 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:15.105 03:24:49 -- common/autotest_common.sh@10 -- # set +x 00:24:15.105 03:24:49 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:15.105 03:24:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:15.105 03:24:49 -- target/shutdown.sh@28 -- # cat 00:24:15.105 03:24:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:15.105 03:24:49 -- target/shutdown.sh@28 -- # cat 00:24:15.105 03:24:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:15.105 03:24:49 -- target/shutdown.sh@28 -- # cat 00:24:15.105 03:24:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:15.105 03:24:49 -- target/shutdown.sh@28 -- # cat 00:24:15.105 03:24:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:15.105 03:24:49 -- target/shutdown.sh@28 -- # cat 00:24:15.105 03:24:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:15.105 03:24:49 -- target/shutdown.sh@28 -- # cat 00:24:15.105 03:24:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:15.105 03:24:49 -- target/shutdown.sh@28 -- # cat 00:24:15.105 03:24:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:15.105 03:24:49 -- target/shutdown.sh@28 -- # cat 00:24:15.105 03:24:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:15.105 03:24:49 -- target/shutdown.sh@28 -- # cat 00:24:15.105 03:24:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:15.105 03:24:49 -- target/shutdown.sh@28 -- # cat 00:24:15.105 03:24:49 -- target/shutdown.sh@35 -- # rpc_cmd 00:24:15.105 03:24:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:15.105 03:24:49 -- common/autotest_common.sh@10 -- # set +x 00:24:15.105 Malloc1 00:24:15.105 [2024-04-25 03:24:49.550861] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:24:15.105 Malloc2 00:24:15.417 Malloc3 00:24:15.417 Malloc4 00:24:15.417 Malloc5 00:24:15.417 Malloc6 00:24:15.417 Malloc7 00:24:15.417 Malloc8 00:24:15.417 Malloc9 00:24:15.675 Malloc10 00:24:15.675 03:24:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:15.675 03:24:49 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:24:15.676 03:24:49 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:15.676 03:24:49 -- common/autotest_common.sh@10 -- # set +x 00:24:15.676 03:24:49 -- target/shutdown.sh@78 -- # perfpid=4181227 00:24:15.676 03:24:49 -- target/shutdown.sh@79 -- # waitforlisten 4181227 /var/tmp/bdevperf.sock 00:24:15.676 03:24:49 -- common/autotest_common.sh@817 -- # '[' -z 4181227 ']' 00:24:15.676 03:24:49 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:15.676 03:24:49 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:24:15.676 03:24:49 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:15.676 03:24:49 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:15.676 03:24:49 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:15.676 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:15.676 03:24:49 -- nvmf/common.sh@521 -- # config=() 00:24:15.676 03:24:49 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:15.676 03:24:49 -- nvmf/common.sh@521 -- # local subsystem config 00:24:15.676 03:24:49 -- common/autotest_common.sh@10 -- # set +x 00:24:15.676 03:24:49 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:15.676 03:24:49 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:15.676 { 00:24:15.676 "params": { 00:24:15.676 "name": "Nvme$subsystem", 00:24:15.676 "trtype": "$TEST_TRANSPORT", 00:24:15.676 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:15.676 "adrfam": "ipv4", 00:24:15.676 "trsvcid": "$NVMF_PORT", 00:24:15.676 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:15.676 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:15.676 "hdgst": ${hdgst:-false}, 00:24:15.676 "ddgst": ${ddgst:-false} 00:24:15.676 }, 00:24:15.676 "method": "bdev_nvme_attach_controller" 00:24:15.676 } 00:24:15.676 EOF 00:24:15.676 )") 00:24:15.676 03:24:49 -- nvmf/common.sh@543 -- # cat 00:24:15.676 03:24:49 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:15.676 03:24:49 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:15.676 { 00:24:15.676 "params": { 00:24:15.676 "name": "Nvme$subsystem", 00:24:15.676 "trtype": "$TEST_TRANSPORT", 00:24:15.676 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:15.676 "adrfam": "ipv4", 00:24:15.676 "trsvcid": "$NVMF_PORT", 00:24:15.676 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:15.676 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:15.676 "hdgst": ${hdgst:-false}, 00:24:15.676 "ddgst": ${ddgst:-false} 00:24:15.676 }, 00:24:15.676 "method": "bdev_nvme_attach_controller" 00:24:15.676 } 00:24:15.676 EOF 00:24:15.676 )") 00:24:15.676 03:24:49 -- nvmf/common.sh@543 -- # cat 00:24:15.676 03:24:49 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:15.676 03:24:49 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:15.676 { 00:24:15.676 "params": { 00:24:15.676 "name": "Nvme$subsystem", 00:24:15.676 "trtype": "$TEST_TRANSPORT", 00:24:15.676 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:15.676 "adrfam": "ipv4", 00:24:15.676 "trsvcid": "$NVMF_PORT", 00:24:15.676 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:15.676 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:15.676 "hdgst": ${hdgst:-false}, 00:24:15.676 "ddgst": ${ddgst:-false} 00:24:15.676 }, 00:24:15.676 "method": "bdev_nvme_attach_controller" 00:24:15.676 } 00:24:15.676 EOF 00:24:15.676 )") 00:24:15.676 03:24:49 -- nvmf/common.sh@543 -- # cat 00:24:15.676 03:24:50 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:15.676 03:24:50 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:15.676 { 00:24:15.676 "params": { 00:24:15.676 "name": "Nvme$subsystem", 00:24:15.676 "trtype": "$TEST_TRANSPORT", 00:24:15.676 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:15.676 "adrfam": "ipv4", 00:24:15.676 "trsvcid": "$NVMF_PORT", 00:24:15.676 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:15.676 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:15.676 "hdgst": ${hdgst:-false}, 00:24:15.676 "ddgst": ${ddgst:-false} 00:24:15.676 }, 00:24:15.676 "method": "bdev_nvme_attach_controller" 00:24:15.676 } 00:24:15.676 EOF 00:24:15.676 )") 00:24:15.676 03:24:50 -- nvmf/common.sh@543 -- # cat 00:24:15.676 03:24:50 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:15.676 03:24:50 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:15.676 { 00:24:15.676 "params": { 00:24:15.676 "name": "Nvme$subsystem", 00:24:15.676 "trtype": "$TEST_TRANSPORT", 00:24:15.676 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:15.676 "adrfam": "ipv4", 00:24:15.676 "trsvcid": "$NVMF_PORT", 00:24:15.676 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:15.676 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:15.676 "hdgst": ${hdgst:-false}, 00:24:15.676 "ddgst": ${ddgst:-false} 00:24:15.676 }, 00:24:15.676 "method": "bdev_nvme_attach_controller" 00:24:15.676 } 00:24:15.676 EOF 00:24:15.676 )") 00:24:15.676 03:24:50 -- nvmf/common.sh@543 -- # cat 00:24:15.676 03:24:50 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:15.676 03:24:50 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:15.676 { 00:24:15.676 "params": { 00:24:15.676 "name": "Nvme$subsystem", 00:24:15.676 "trtype": "$TEST_TRANSPORT", 00:24:15.676 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:15.676 "adrfam": "ipv4", 00:24:15.676 "trsvcid": "$NVMF_PORT", 00:24:15.676 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:15.676 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:15.676 "hdgst": ${hdgst:-false}, 00:24:15.676 "ddgst": ${ddgst:-false} 00:24:15.676 }, 00:24:15.676 "method": "bdev_nvme_attach_controller" 00:24:15.676 } 00:24:15.676 EOF 00:24:15.676 )") 00:24:15.676 03:24:50 -- nvmf/common.sh@543 -- # cat 00:24:15.676 [2024-04-25 03:24:50.019861] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:24:15.676 [2024-04-25 03:24:50.019907] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:24:15.676 03:24:50 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:15.676 03:24:50 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:15.676 { 00:24:15.676 "params": { 00:24:15.676 "name": "Nvme$subsystem", 00:24:15.676 "trtype": "$TEST_TRANSPORT", 00:24:15.676 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:15.676 "adrfam": "ipv4", 00:24:15.676 "trsvcid": "$NVMF_PORT", 00:24:15.676 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:15.676 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:15.676 "hdgst": ${hdgst:-false}, 00:24:15.676 "ddgst": ${ddgst:-false} 00:24:15.676 }, 00:24:15.676 "method": "bdev_nvme_attach_controller" 00:24:15.676 } 00:24:15.676 EOF 00:24:15.676 )") 00:24:15.676 03:24:50 -- nvmf/common.sh@543 -- # cat 00:24:15.676 03:24:50 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:15.676 03:24:50 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:15.676 { 00:24:15.676 "params": { 00:24:15.676 "name": "Nvme$subsystem", 00:24:15.676 "trtype": "$TEST_TRANSPORT", 00:24:15.676 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:15.676 "adrfam": "ipv4", 00:24:15.676 "trsvcid": "$NVMF_PORT", 00:24:15.676 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:15.676 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:15.676 "hdgst": ${hdgst:-false}, 00:24:15.676 "ddgst": ${ddgst:-false} 00:24:15.676 }, 00:24:15.676 "method": "bdev_nvme_attach_controller" 00:24:15.676 } 00:24:15.676 EOF 00:24:15.676 )") 00:24:15.676 03:24:50 -- nvmf/common.sh@543 -- # cat 00:24:15.677 03:24:50 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:15.677 03:24:50 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:15.677 { 00:24:15.677 "params": { 00:24:15.677 "name": "Nvme$subsystem", 00:24:15.677 "trtype": "$TEST_TRANSPORT", 00:24:15.677 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:15.677 "adrfam": "ipv4", 00:24:15.677 "trsvcid": "$NVMF_PORT", 00:24:15.677 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:15.677 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:15.677 "hdgst": ${hdgst:-false}, 00:24:15.677 "ddgst": ${ddgst:-false} 00:24:15.677 }, 00:24:15.677 "method": "bdev_nvme_attach_controller" 00:24:15.677 } 00:24:15.677 EOF 00:24:15.677 )") 00:24:15.677 03:24:50 -- nvmf/common.sh@543 -- # cat 00:24:15.677 03:24:50 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:15.677 03:24:50 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:15.677 { 00:24:15.677 "params": { 00:24:15.677 "name": "Nvme$subsystem", 00:24:15.677 "trtype": "$TEST_TRANSPORT", 00:24:15.677 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:15.677 "adrfam": "ipv4", 00:24:15.677 "trsvcid": "$NVMF_PORT", 00:24:15.677 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:15.677 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:15.677 "hdgst": ${hdgst:-false}, 00:24:15.677 "ddgst": ${ddgst:-false} 00:24:15.677 }, 00:24:15.677 "method": "bdev_nvme_attach_controller" 00:24:15.677 } 00:24:15.677 EOF 00:24:15.677 )") 00:24:15.677 03:24:50 -- nvmf/common.sh@543 -- # cat 00:24:15.677 03:24:50 -- nvmf/common.sh@545 -- # jq . 00:24:15.677 EAL: No free 2048 kB hugepages reported on node 1 00:24:15.677 03:24:50 -- nvmf/common.sh@546 -- # IFS=, 00:24:15.677 03:24:50 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:24:15.677 "params": { 00:24:15.677 "name": "Nvme1", 00:24:15.677 "trtype": "rdma", 00:24:15.677 "traddr": "192.168.100.8", 00:24:15.677 "adrfam": "ipv4", 00:24:15.677 "trsvcid": "4420", 00:24:15.677 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:15.677 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:15.677 "hdgst": false, 00:24:15.677 "ddgst": false 00:24:15.677 }, 00:24:15.677 "method": "bdev_nvme_attach_controller" 00:24:15.677 },{ 00:24:15.677 "params": { 00:24:15.677 "name": "Nvme2", 00:24:15.677 "trtype": "rdma", 00:24:15.677 "traddr": "192.168.100.8", 00:24:15.677 "adrfam": "ipv4", 00:24:15.677 "trsvcid": "4420", 00:24:15.677 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:15.677 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:15.677 "hdgst": false, 00:24:15.677 "ddgst": false 00:24:15.677 }, 00:24:15.677 "method": "bdev_nvme_attach_controller" 00:24:15.677 },{ 00:24:15.677 "params": { 00:24:15.677 "name": "Nvme3", 00:24:15.677 "trtype": "rdma", 00:24:15.677 "traddr": "192.168.100.8", 00:24:15.677 "adrfam": "ipv4", 00:24:15.677 "trsvcid": "4420", 00:24:15.677 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:15.677 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:15.677 "hdgst": false, 00:24:15.677 "ddgst": false 00:24:15.677 }, 00:24:15.677 "method": "bdev_nvme_attach_controller" 00:24:15.677 },{ 00:24:15.677 "params": { 00:24:15.677 "name": "Nvme4", 00:24:15.677 "trtype": "rdma", 00:24:15.677 "traddr": "192.168.100.8", 00:24:15.677 "adrfam": "ipv4", 00:24:15.677 "trsvcid": "4420", 00:24:15.677 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:15.677 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:15.677 "hdgst": false, 00:24:15.677 "ddgst": false 00:24:15.677 }, 00:24:15.677 "method": "bdev_nvme_attach_controller" 00:24:15.677 },{ 00:24:15.677 "params": { 00:24:15.677 "name": "Nvme5", 00:24:15.677 "trtype": "rdma", 00:24:15.677 "traddr": "192.168.100.8", 00:24:15.677 "adrfam": "ipv4", 00:24:15.677 "trsvcid": "4420", 00:24:15.677 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:15.677 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:15.677 "hdgst": false, 00:24:15.677 "ddgst": false 00:24:15.677 }, 00:24:15.677 "method": "bdev_nvme_attach_controller" 00:24:15.677 },{ 00:24:15.677 "params": { 00:24:15.677 "name": "Nvme6", 00:24:15.677 "trtype": "rdma", 00:24:15.677 "traddr": "192.168.100.8", 00:24:15.677 "adrfam": "ipv4", 00:24:15.677 "trsvcid": "4420", 00:24:15.677 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:15.677 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:15.677 "hdgst": false, 00:24:15.677 "ddgst": false 00:24:15.677 }, 00:24:15.677 "method": "bdev_nvme_attach_controller" 00:24:15.677 },{ 00:24:15.677 "params": { 00:24:15.677 "name": "Nvme7", 00:24:15.677 "trtype": "rdma", 00:24:15.677 "traddr": "192.168.100.8", 00:24:15.677 "adrfam": "ipv4", 00:24:15.677 "trsvcid": "4420", 00:24:15.677 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:15.677 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:15.677 "hdgst": false, 00:24:15.677 "ddgst": false 00:24:15.677 }, 00:24:15.677 "method": "bdev_nvme_attach_controller" 00:24:15.677 },{ 00:24:15.677 "params": { 00:24:15.677 "name": "Nvme8", 00:24:15.677 "trtype": "rdma", 00:24:15.677 "traddr": "192.168.100.8", 00:24:15.677 "adrfam": "ipv4", 00:24:15.677 "trsvcid": "4420", 00:24:15.677 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:15.677 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:15.677 "hdgst": false, 00:24:15.677 "ddgst": false 00:24:15.677 }, 00:24:15.677 "method": "bdev_nvme_attach_controller" 00:24:15.677 },{ 00:24:15.677 "params": { 00:24:15.677 "name": "Nvme9", 00:24:15.677 "trtype": "rdma", 00:24:15.677 "traddr": "192.168.100.8", 00:24:15.677 "adrfam": "ipv4", 00:24:15.677 "trsvcid": "4420", 00:24:15.677 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:15.677 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:15.677 "hdgst": false, 00:24:15.677 "ddgst": false 00:24:15.677 }, 00:24:15.677 "method": "bdev_nvme_attach_controller" 00:24:15.677 },{ 00:24:15.677 "params": { 00:24:15.677 "name": "Nvme10", 00:24:15.677 "trtype": "rdma", 00:24:15.677 "traddr": "192.168.100.8", 00:24:15.677 "adrfam": "ipv4", 00:24:15.677 "trsvcid": "4420", 00:24:15.677 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:15.677 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:15.677 "hdgst": false, 00:24:15.677 "ddgst": false 00:24:15.677 }, 00:24:15.677 "method": "bdev_nvme_attach_controller" 00:24:15.677 }' 00:24:15.677 [2024-04-25 03:24:50.083628] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:15.677 [2024-04-25 03:24:50.155109] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:16.610 03:24:50 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:16.610 03:24:50 -- common/autotest_common.sh@850 -- # return 0 00:24:16.610 03:24:50 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:24:16.610 03:24:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:16.610 03:24:50 -- common/autotest_common.sh@10 -- # set +x 00:24:16.610 03:24:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:16.610 03:24:50 -- target/shutdown.sh@83 -- # kill -9 4181227 00:24:16.610 03:24:50 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:24:16.610 03:24:51 -- target/shutdown.sh@87 -- # sleep 1 00:24:17.540 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 4181227 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:24:17.540 03:24:52 -- target/shutdown.sh@88 -- # kill -0 4180944 00:24:17.540 03:24:52 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:24:17.540 03:24:52 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:17.540 03:24:52 -- nvmf/common.sh@521 -- # config=() 00:24:17.540 03:24:52 -- nvmf/common.sh@521 -- # local subsystem config 00:24:17.540 03:24:52 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:17.540 03:24:52 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:17.540 { 00:24:17.540 "params": { 00:24:17.540 "name": "Nvme$subsystem", 00:24:17.540 "trtype": "$TEST_TRANSPORT", 00:24:17.540 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:17.540 "adrfam": "ipv4", 00:24:17.540 "trsvcid": "$NVMF_PORT", 00:24:17.540 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:17.540 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:17.540 "hdgst": ${hdgst:-false}, 00:24:17.540 "ddgst": ${ddgst:-false} 00:24:17.540 }, 00:24:17.540 "method": "bdev_nvme_attach_controller" 00:24:17.540 } 00:24:17.540 EOF 00:24:17.540 )") 00:24:17.540 03:24:52 -- nvmf/common.sh@543 -- # cat 00:24:17.540 03:24:52 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:17.540 03:24:52 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:17.540 { 00:24:17.540 "params": { 00:24:17.540 "name": "Nvme$subsystem", 00:24:17.540 "trtype": "$TEST_TRANSPORT", 00:24:17.540 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:17.540 "adrfam": "ipv4", 00:24:17.540 "trsvcid": "$NVMF_PORT", 00:24:17.540 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:17.540 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:17.540 "hdgst": ${hdgst:-false}, 00:24:17.540 "ddgst": ${ddgst:-false} 00:24:17.540 }, 00:24:17.540 "method": "bdev_nvme_attach_controller" 00:24:17.540 } 00:24:17.540 EOF 00:24:17.540 )") 00:24:17.540 03:24:52 -- nvmf/common.sh@543 -- # cat 00:24:17.540 03:24:52 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:17.540 03:24:52 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:17.540 { 00:24:17.540 "params": { 00:24:17.540 "name": "Nvme$subsystem", 00:24:17.540 "trtype": "$TEST_TRANSPORT", 00:24:17.540 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:17.540 "adrfam": "ipv4", 00:24:17.540 "trsvcid": "$NVMF_PORT", 00:24:17.540 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:17.540 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:17.540 "hdgst": ${hdgst:-false}, 00:24:17.540 "ddgst": ${ddgst:-false} 00:24:17.540 }, 00:24:17.540 "method": "bdev_nvme_attach_controller" 00:24:17.540 } 00:24:17.540 EOF 00:24:17.540 )") 00:24:17.540 03:24:52 -- nvmf/common.sh@543 -- # cat 00:24:17.540 03:24:52 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:17.540 03:24:52 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:17.540 { 00:24:17.540 "params": { 00:24:17.540 "name": "Nvme$subsystem", 00:24:17.540 "trtype": "$TEST_TRANSPORT", 00:24:17.540 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:17.540 "adrfam": "ipv4", 00:24:17.540 "trsvcid": "$NVMF_PORT", 00:24:17.541 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:17.541 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:17.541 "hdgst": ${hdgst:-false}, 00:24:17.541 "ddgst": ${ddgst:-false} 00:24:17.541 }, 00:24:17.541 "method": "bdev_nvme_attach_controller" 00:24:17.541 } 00:24:17.541 EOF 00:24:17.541 )") 00:24:17.541 03:24:52 -- nvmf/common.sh@543 -- # cat 00:24:17.541 03:24:52 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:17.541 03:24:52 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:17.541 { 00:24:17.541 "params": { 00:24:17.541 "name": "Nvme$subsystem", 00:24:17.541 "trtype": "$TEST_TRANSPORT", 00:24:17.541 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:17.541 "adrfam": "ipv4", 00:24:17.541 "trsvcid": "$NVMF_PORT", 00:24:17.541 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:17.541 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:17.541 "hdgst": ${hdgst:-false}, 00:24:17.541 "ddgst": ${ddgst:-false} 00:24:17.541 }, 00:24:17.541 "method": "bdev_nvme_attach_controller" 00:24:17.541 } 00:24:17.541 EOF 00:24:17.541 )") 00:24:17.541 03:24:52 -- nvmf/common.sh@543 -- # cat 00:24:17.798 03:24:52 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:17.798 03:24:52 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:17.798 { 00:24:17.798 "params": { 00:24:17.798 "name": "Nvme$subsystem", 00:24:17.798 "trtype": "$TEST_TRANSPORT", 00:24:17.798 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:17.798 "adrfam": "ipv4", 00:24:17.798 "trsvcid": "$NVMF_PORT", 00:24:17.798 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:17.798 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:17.798 "hdgst": ${hdgst:-false}, 00:24:17.798 "ddgst": ${ddgst:-false} 00:24:17.798 }, 00:24:17.798 "method": "bdev_nvme_attach_controller" 00:24:17.798 } 00:24:17.798 EOF 00:24:17.798 )") 00:24:17.798 03:24:52 -- nvmf/common.sh@543 -- # cat 00:24:17.798 03:24:52 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:17.798 03:24:52 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:17.798 { 00:24:17.798 "params": { 00:24:17.798 "name": "Nvme$subsystem", 00:24:17.798 "trtype": "$TEST_TRANSPORT", 00:24:17.798 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:17.798 "adrfam": "ipv4", 00:24:17.798 "trsvcid": "$NVMF_PORT", 00:24:17.798 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:17.798 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:17.798 "hdgst": ${hdgst:-false}, 00:24:17.798 "ddgst": ${ddgst:-false} 00:24:17.798 }, 00:24:17.798 "method": "bdev_nvme_attach_controller" 00:24:17.798 } 00:24:17.798 EOF 00:24:17.798 )") 00:24:17.798 03:24:52 -- nvmf/common.sh@543 -- # cat 00:24:17.798 [2024-04-25 03:24:52.052964] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:24:17.799 [2024-04-25 03:24:52.053012] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4181492 ] 00:24:17.799 03:24:52 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:17.799 03:24:52 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:17.799 { 00:24:17.799 "params": { 00:24:17.799 "name": "Nvme$subsystem", 00:24:17.799 "trtype": "$TEST_TRANSPORT", 00:24:17.799 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:17.799 "adrfam": "ipv4", 00:24:17.799 "trsvcid": "$NVMF_PORT", 00:24:17.799 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:17.799 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:17.799 "hdgst": ${hdgst:-false}, 00:24:17.799 "ddgst": ${ddgst:-false} 00:24:17.799 }, 00:24:17.799 "method": "bdev_nvme_attach_controller" 00:24:17.799 } 00:24:17.799 EOF 00:24:17.799 )") 00:24:17.799 03:24:52 -- nvmf/common.sh@543 -- # cat 00:24:17.799 03:24:52 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:17.799 03:24:52 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:17.799 { 00:24:17.799 "params": { 00:24:17.799 "name": "Nvme$subsystem", 00:24:17.799 "trtype": "$TEST_TRANSPORT", 00:24:17.799 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:17.799 "adrfam": "ipv4", 00:24:17.799 "trsvcid": "$NVMF_PORT", 00:24:17.799 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:17.799 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:17.799 "hdgst": ${hdgst:-false}, 00:24:17.799 "ddgst": ${ddgst:-false} 00:24:17.799 }, 00:24:17.799 "method": "bdev_nvme_attach_controller" 00:24:17.799 } 00:24:17.799 EOF 00:24:17.799 )") 00:24:17.799 03:24:52 -- nvmf/common.sh@543 -- # cat 00:24:17.799 03:24:52 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:17.799 03:24:52 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:17.799 { 00:24:17.799 "params": { 00:24:17.799 "name": "Nvme$subsystem", 00:24:17.799 "trtype": "$TEST_TRANSPORT", 00:24:17.799 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:17.799 "adrfam": "ipv4", 00:24:17.799 "trsvcid": "$NVMF_PORT", 00:24:17.799 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:17.799 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:17.799 "hdgst": ${hdgst:-false}, 00:24:17.799 "ddgst": ${ddgst:-false} 00:24:17.799 }, 00:24:17.799 "method": "bdev_nvme_attach_controller" 00:24:17.799 } 00:24:17.799 EOF 00:24:17.799 )") 00:24:17.799 03:24:52 -- nvmf/common.sh@543 -- # cat 00:24:17.799 03:24:52 -- nvmf/common.sh@545 -- # jq . 00:24:17.799 03:24:52 -- nvmf/common.sh@546 -- # IFS=, 00:24:17.799 03:24:52 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:24:17.799 "params": { 00:24:17.799 "name": "Nvme1", 00:24:17.799 "trtype": "rdma", 00:24:17.799 "traddr": "192.168.100.8", 00:24:17.799 "adrfam": "ipv4", 00:24:17.799 "trsvcid": "4420", 00:24:17.799 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:17.799 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:17.799 "hdgst": false, 00:24:17.799 "ddgst": false 00:24:17.799 }, 00:24:17.799 "method": "bdev_nvme_attach_controller" 00:24:17.799 },{ 00:24:17.799 "params": { 00:24:17.799 "name": "Nvme2", 00:24:17.799 "trtype": "rdma", 00:24:17.799 "traddr": "192.168.100.8", 00:24:17.799 "adrfam": "ipv4", 00:24:17.799 "trsvcid": "4420", 00:24:17.799 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:17.799 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:17.799 "hdgst": false, 00:24:17.799 "ddgst": false 00:24:17.799 }, 00:24:17.799 "method": "bdev_nvme_attach_controller" 00:24:17.799 },{ 00:24:17.799 "params": { 00:24:17.799 "name": "Nvme3", 00:24:17.799 "trtype": "rdma", 00:24:17.799 "traddr": "192.168.100.8", 00:24:17.799 "adrfam": "ipv4", 00:24:17.799 "trsvcid": "4420", 00:24:17.799 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:17.799 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:17.799 "hdgst": false, 00:24:17.799 "ddgst": false 00:24:17.799 }, 00:24:17.799 "method": "bdev_nvme_attach_controller" 00:24:17.799 },{ 00:24:17.799 "params": { 00:24:17.799 "name": "Nvme4", 00:24:17.799 "trtype": "rdma", 00:24:17.799 "traddr": "192.168.100.8", 00:24:17.799 "adrfam": "ipv4", 00:24:17.799 "trsvcid": "4420", 00:24:17.799 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:17.799 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:17.799 "hdgst": false, 00:24:17.799 "ddgst": false 00:24:17.799 }, 00:24:17.799 "method": "bdev_nvme_attach_controller" 00:24:17.799 },{ 00:24:17.799 "params": { 00:24:17.799 "name": "Nvme5", 00:24:17.799 "trtype": "rdma", 00:24:17.799 "traddr": "192.168.100.8", 00:24:17.799 "adrfam": "ipv4", 00:24:17.799 "trsvcid": "4420", 00:24:17.799 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:17.799 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:17.799 "hdgst": false, 00:24:17.799 "ddgst": false 00:24:17.799 }, 00:24:17.799 "method": "bdev_nvme_attach_controller" 00:24:17.799 },{ 00:24:17.799 "params": { 00:24:17.799 "name": "Nvme6", 00:24:17.799 "trtype": "rdma", 00:24:17.799 "traddr": "192.168.100.8", 00:24:17.799 "adrfam": "ipv4", 00:24:17.799 "trsvcid": "4420", 00:24:17.799 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:17.799 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:17.799 "hdgst": false, 00:24:17.799 "ddgst": false 00:24:17.799 }, 00:24:17.799 "method": "bdev_nvme_attach_controller" 00:24:17.799 },{ 00:24:17.799 "params": { 00:24:17.799 "name": "Nvme7", 00:24:17.799 "trtype": "rdma", 00:24:17.799 "traddr": "192.168.100.8", 00:24:17.799 "adrfam": "ipv4", 00:24:17.799 "trsvcid": "4420", 00:24:17.799 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:17.799 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:17.799 "hdgst": false, 00:24:17.799 "ddgst": false 00:24:17.799 }, 00:24:17.799 "method": "bdev_nvme_attach_controller" 00:24:17.799 },{ 00:24:17.799 "params": { 00:24:17.799 "name": "Nvme8", 00:24:17.799 "trtype": "rdma", 00:24:17.799 "traddr": "192.168.100.8", 00:24:17.799 "adrfam": "ipv4", 00:24:17.799 "trsvcid": "4420", 00:24:17.799 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:17.799 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:17.799 "hdgst": false, 00:24:17.799 "ddgst": false 00:24:17.799 }, 00:24:17.799 "method": "bdev_nvme_attach_controller" 00:24:17.799 },{ 00:24:17.799 "params": { 00:24:17.799 "name": "Nvme9", 00:24:17.799 "trtype": "rdma", 00:24:17.799 "traddr": "192.168.100.8", 00:24:17.799 "adrfam": "ipv4", 00:24:17.799 "trsvcid": "4420", 00:24:17.799 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:17.799 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:17.799 "hdgst": false, 00:24:17.799 "ddgst": false 00:24:17.799 }, 00:24:17.799 "method": "bdev_nvme_attach_controller" 00:24:17.799 },{ 00:24:17.799 "params": { 00:24:17.799 "name": "Nvme10", 00:24:17.799 "trtype": "rdma", 00:24:17.799 "traddr": "192.168.100.8", 00:24:17.799 "adrfam": "ipv4", 00:24:17.799 "trsvcid": "4420", 00:24:17.799 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:17.799 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:17.799 "hdgst": false, 00:24:17.799 "ddgst": false 00:24:17.799 }, 00:24:17.799 "method": "bdev_nvme_attach_controller" 00:24:17.799 }' 00:24:17.799 EAL: No free 2048 kB hugepages reported on node 1 00:24:17.799 [2024-04-25 03:24:52.115911] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:17.799 [2024-04-25 03:24:52.187565] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:18.732 Running I/O for 1 seconds... 00:24:20.106 00:24:20.106 Latency(us) 00:24:20.106 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:20.106 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:20.106 Verification LBA range: start 0x0 length 0x400 00:24:20.106 Nvme1n1 : 1.08 354.76 22.17 0.00 0.00 178797.88 56922.70 176759.95 00:24:20.106 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:20.106 Verification LBA range: start 0x0 length 0x400 00:24:20.106 Nvme2n1 : 1.17 384.11 24.01 0.00 0.00 162906.70 9736.78 155788.43 00:24:20.106 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:20.106 Verification LBA range: start 0x0 length 0x400 00:24:20.106 Nvme3n1 : 1.17 387.30 24.21 0.00 0.00 157982.25 6678.43 143804.71 00:24:20.106 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:20.106 Verification LBA range: start 0x0 length 0x400 00:24:20.106 Nvme4n1 : 1.16 386.72 24.17 0.00 0.00 157161.99 23592.96 124331.15 00:24:20.106 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:20.106 Verification LBA range: start 0x0 length 0x400 00:24:20.106 Nvme5n1 : 1.16 386.14 24.13 0.00 0.00 155089.05 37199.48 114344.72 00:24:20.106 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:20.106 Verification LBA range: start 0x0 length 0x400 00:24:20.106 Nvme6n1 : 1.17 383.48 23.97 0.00 0.00 153489.80 6303.94 146800.64 00:24:20.106 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:20.106 Verification LBA range: start 0x0 length 0x400 00:24:20.106 Nvme7n1 : 1.17 383.08 23.94 0.00 0.00 151363.74 6647.22 141807.42 00:24:20.106 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:20.106 Verification LBA range: start 0x0 length 0x400 00:24:20.106 Nvme8n1 : 1.17 382.80 23.93 0.00 0.00 148844.11 6584.81 129823.70 00:24:20.106 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:20.106 Verification LBA range: start 0x0 length 0x400 00:24:20.106 Nvme9n1 : 1.17 382.26 23.89 0.00 0.00 147556.59 7333.79 127327.09 00:24:20.106 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:20.106 Verification LBA range: start 0x0 length 0x400 00:24:20.106 Nvme10n1 : 1.17 327.19 20.45 0.00 0.00 169725.32 8238.81 263641.97 00:24:20.106 =================================================================================================================== 00:24:20.106 Total : 3757.86 234.87 0.00 0.00 157822.19 6303.94 263641.97 00:24:20.106 03:24:54 -- target/shutdown.sh@94 -- # stoptarget 00:24:20.106 03:24:54 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:24:20.106 03:24:54 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:24:20.106 03:24:54 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:20.106 03:24:54 -- target/shutdown.sh@45 -- # nvmftestfini 00:24:20.106 03:24:54 -- nvmf/common.sh@477 -- # nvmfcleanup 00:24:20.106 03:24:54 -- nvmf/common.sh@117 -- # sync 00:24:20.106 03:24:54 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:24:20.106 03:24:54 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:24:20.106 03:24:54 -- nvmf/common.sh@120 -- # set +e 00:24:20.106 03:24:54 -- nvmf/common.sh@121 -- # for i in {1..20} 00:24:20.106 03:24:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:24:20.106 rmmod nvme_rdma 00:24:20.106 rmmod nvme_fabrics 00:24:20.106 03:24:54 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:24:20.106 03:24:54 -- nvmf/common.sh@124 -- # set -e 00:24:20.106 03:24:54 -- nvmf/common.sh@125 -- # return 0 00:24:20.106 03:24:54 -- nvmf/common.sh@478 -- # '[' -n 4180944 ']' 00:24:20.106 03:24:54 -- nvmf/common.sh@479 -- # killprocess 4180944 00:24:20.106 03:24:54 -- common/autotest_common.sh@936 -- # '[' -z 4180944 ']' 00:24:20.106 03:24:54 -- common/autotest_common.sh@940 -- # kill -0 4180944 00:24:20.106 03:24:54 -- common/autotest_common.sh@941 -- # uname 00:24:20.106 03:24:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:20.106 03:24:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4180944 00:24:20.106 03:24:54 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:24:20.106 03:24:54 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:24:20.106 03:24:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4180944' 00:24:20.106 killing process with pid 4180944 00:24:20.106 03:24:54 -- common/autotest_common.sh@955 -- # kill 4180944 00:24:20.106 03:24:54 -- common/autotest_common.sh@960 -- # wait 4180944 00:24:20.364 [2024-04-25 03:24:54.620706] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:24:20.623 03:24:55 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:24:20.623 03:24:55 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:24:20.623 00:24:20.623 real 0m12.264s 00:24:20.623 user 0m29.779s 00:24:20.623 sys 0m5.554s 00:24:20.623 03:24:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:24:20.623 03:24:55 -- common/autotest_common.sh@10 -- # set +x 00:24:20.623 ************************************ 00:24:20.623 END TEST nvmf_shutdown_tc1 00:24:20.623 ************************************ 00:24:20.623 03:24:55 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:24:20.623 03:24:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:24:20.623 03:24:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:20.623 03:24:55 -- common/autotest_common.sh@10 -- # set +x 00:24:20.883 ************************************ 00:24:20.883 START TEST nvmf_shutdown_tc2 00:24:20.883 ************************************ 00:24:20.883 03:24:55 -- common/autotest_common.sh@1111 -- # nvmf_shutdown_tc2 00:24:20.883 03:24:55 -- target/shutdown.sh@99 -- # starttarget 00:24:20.883 03:24:55 -- target/shutdown.sh@15 -- # nvmftestinit 00:24:20.883 03:24:55 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:24:20.883 03:24:55 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:20.883 03:24:55 -- nvmf/common.sh@437 -- # prepare_net_devs 00:24:20.883 03:24:55 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:24:20.883 03:24:55 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:24:20.883 03:24:55 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:20.883 03:24:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:20.883 03:24:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:20.883 03:24:55 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:24:20.883 03:24:55 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:24:20.883 03:24:55 -- nvmf/common.sh@285 -- # xtrace_disable 00:24:20.883 03:24:55 -- common/autotest_common.sh@10 -- # set +x 00:24:20.883 03:24:55 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:20.883 03:24:55 -- nvmf/common.sh@291 -- # pci_devs=() 00:24:20.883 03:24:55 -- nvmf/common.sh@291 -- # local -a pci_devs 00:24:20.883 03:24:55 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:24:20.883 03:24:55 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:24:20.883 03:24:55 -- nvmf/common.sh@293 -- # pci_drivers=() 00:24:20.883 03:24:55 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:24:20.883 03:24:55 -- nvmf/common.sh@295 -- # net_devs=() 00:24:20.883 03:24:55 -- nvmf/common.sh@295 -- # local -ga net_devs 00:24:20.883 03:24:55 -- nvmf/common.sh@296 -- # e810=() 00:24:20.883 03:24:55 -- nvmf/common.sh@296 -- # local -ga e810 00:24:20.883 03:24:55 -- nvmf/common.sh@297 -- # x722=() 00:24:20.883 03:24:55 -- nvmf/common.sh@297 -- # local -ga x722 00:24:20.883 03:24:55 -- nvmf/common.sh@298 -- # mlx=() 00:24:20.883 03:24:55 -- nvmf/common.sh@298 -- # local -ga mlx 00:24:20.883 03:24:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:20.883 03:24:55 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:20.883 03:24:55 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:20.883 03:24:55 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:20.883 03:24:55 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:20.883 03:24:55 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:20.883 03:24:55 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:20.883 03:24:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:20.883 03:24:55 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:20.883 03:24:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:20.883 03:24:55 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:20.883 03:24:55 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:24:20.883 03:24:55 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:24:20.883 03:24:55 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:24:20.883 03:24:55 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:24:20.883 03:24:55 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:24:20.883 03:24:55 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:24:20.883 03:24:55 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:24:20.883 03:24:55 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:24:20.883 03:24:55 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:20.883 03:24:55 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:24:20.883 Found 0000:af:00.0 (0x8086 - 0x159b) 00:24:20.883 03:24:55 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:24:20.883 03:24:55 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:24:20.883 03:24:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:20.883 03:24:55 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:20.883 03:24:55 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:24:20.883 03:24:55 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:24:20.883 03:24:55 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:20.883 03:24:55 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:24:20.883 Found 0000:af:00.1 (0x8086 - 0x159b) 00:24:20.883 03:24:55 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:24:20.883 03:24:55 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:24:20.883 03:24:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:20.883 03:24:55 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:20.883 03:24:55 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:24:20.883 03:24:55 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:24:20.883 03:24:55 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:24:20.883 03:24:55 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:24:20.883 03:24:55 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:24:20.883 03:24:55 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:24:20.883 03:24:55 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:24:20.883 03:24:55 -- nvmf/common.sh@377 -- # modinfo irdma 00:24:20.883 03:24:55 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:24:20.883 03:24:55 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:20.883 03:24:55 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:20.883 03:24:55 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:20.883 03:24:55 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:20.883 03:24:55 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:24:20.883 Found net devices under 0000:af:00.0: cvl_0_0 00:24:20.883 03:24:55 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:20.883 03:24:55 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:20.883 03:24:55 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:20.883 03:24:55 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:20.883 03:24:55 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:20.883 03:24:55 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:24:20.883 Found net devices under 0000:af:00.1: cvl_0_1 00:24:20.883 03:24:55 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:20.883 03:24:55 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:24:20.883 03:24:55 -- nvmf/common.sh@403 -- # is_hw=yes 00:24:20.883 03:24:55 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:24:20.883 03:24:55 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:24:20.883 03:24:55 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:24:20.883 03:24:55 -- nvmf/common.sh@409 -- # rdma_device_init 00:24:20.883 03:24:55 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:24:20.883 03:24:55 -- nvmf/common.sh@58 -- # uname 00:24:20.883 03:24:55 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:24:20.883 03:24:55 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:24:20.883 03:24:55 -- nvmf/common.sh@63 -- # modprobe ib_core 00:24:20.883 03:24:55 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:24:20.883 03:24:55 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:24:20.883 03:24:55 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:24:20.883 03:24:55 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:24:20.883 03:24:55 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:24:20.883 03:24:55 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:24:20.883 03:24:55 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:24:20.883 03:24:55 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:24:20.883 03:24:55 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:24:20.883 03:24:55 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:24:20.883 03:24:55 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:24:20.883 03:24:55 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:24:20.883 03:24:55 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:24:20.883 03:24:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:20.883 03:24:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:20.883 03:24:55 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:24:20.883 03:24:55 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:24:20.883 03:24:55 -- nvmf/common.sh@105 -- # continue 2 00:24:20.883 03:24:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:20.883 03:24:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:20.883 03:24:55 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:24:20.883 03:24:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:20.883 03:24:55 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:24:20.883 03:24:55 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:24:20.883 03:24:55 -- nvmf/common.sh@105 -- # continue 2 00:24:20.883 03:24:55 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:24:20.883 03:24:55 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:24:20.883 03:24:55 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:24:20.883 03:24:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:24:20.883 03:24:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:20.883 03:24:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:20.883 03:24:55 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:24:20.884 03:24:55 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:24:20.884 03:24:55 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:24:20.884 50: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:24:20.884 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:24:20.884 altname enp175s0f0np0 00:24:20.884 altname ens801f0np0 00:24:20.884 inet 192.168.100.8/24 scope global cvl_0_0 00:24:20.884 valid_lft forever preferred_lft forever 00:24:20.884 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:24:20.884 valid_lft forever preferred_lft forever 00:24:20.884 03:24:55 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:24:20.884 03:24:55 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:24:20.884 03:24:55 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:24:20.884 03:24:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:24:20.884 03:24:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:20.884 03:24:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:20.884 03:24:55 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:24:20.884 03:24:55 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:24:20.884 03:24:55 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:24:20.884 51: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:24:20.884 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:24:20.884 altname enp175s0f1np1 00:24:20.884 altname ens801f1np1 00:24:20.884 inet 192.168.100.9/24 scope global cvl_0_1 00:24:20.884 valid_lft forever preferred_lft forever 00:24:20.884 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:24:20.884 valid_lft forever preferred_lft forever 00:24:20.884 03:24:55 -- nvmf/common.sh@411 -- # return 0 00:24:20.884 03:24:55 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:24:20.884 03:24:55 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:24:20.884 03:24:55 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:24:20.884 03:24:55 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:24:20.884 03:24:55 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:24:20.884 03:24:55 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:24:20.884 03:24:55 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:24:20.884 03:24:55 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:24:20.884 03:24:55 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:24:20.884 03:24:55 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:24:20.884 03:24:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:20.884 03:24:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:20.884 03:24:55 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:24:20.884 03:24:55 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:24:20.884 03:24:55 -- nvmf/common.sh@105 -- # continue 2 00:24:20.884 03:24:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:20.884 03:24:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:21.143 03:24:55 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:24:21.144 03:24:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:21.144 03:24:55 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:24:21.144 03:24:55 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:24:21.144 03:24:55 -- nvmf/common.sh@105 -- # continue 2 00:24:21.144 03:24:55 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:24:21.144 03:24:55 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:24:21.144 03:24:55 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:24:21.144 03:24:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:24:21.144 03:24:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:21.144 03:24:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:21.144 03:24:55 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:24:21.144 03:24:55 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:24:21.144 03:24:55 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:24:21.144 03:24:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:24:21.144 03:24:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:21.144 03:24:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:21.144 03:24:55 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:24:21.144 192.168.100.9' 00:24:21.144 03:24:55 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:24:21.144 192.168.100.9' 00:24:21.144 03:24:55 -- nvmf/common.sh@446 -- # head -n 1 00:24:21.144 03:24:55 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:24:21.144 03:24:55 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:24:21.144 192.168.100.9' 00:24:21.144 03:24:55 -- nvmf/common.sh@447 -- # tail -n +2 00:24:21.144 03:24:55 -- nvmf/common.sh@447 -- # head -n 1 00:24:21.144 03:24:55 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:24:21.144 03:24:55 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:24:21.144 03:24:55 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:24:21.144 03:24:55 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:24:21.144 03:24:55 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:24:21.144 03:24:55 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:24:21.144 03:24:55 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:24:21.144 03:24:55 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:24:21.144 03:24:55 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:21.144 03:24:55 -- common/autotest_common.sh@10 -- # set +x 00:24:21.144 03:24:55 -- nvmf/common.sh@470 -- # nvmfpid=4182269 00:24:21.144 03:24:55 -- nvmf/common.sh@471 -- # waitforlisten 4182269 00:24:21.144 03:24:55 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:24:21.144 03:24:55 -- common/autotest_common.sh@817 -- # '[' -z 4182269 ']' 00:24:21.144 03:24:55 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:21.144 03:24:55 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:21.144 03:24:55 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:21.144 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:21.144 03:24:55 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:21.144 03:24:55 -- common/autotest_common.sh@10 -- # set +x 00:24:21.144 [2024-04-25 03:24:55.493008] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:24:21.144 [2024-04-25 03:24:55.493057] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:21.144 EAL: No free 2048 kB hugepages reported on node 1 00:24:21.144 [2024-04-25 03:24:55.550046] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:21.144 [2024-04-25 03:24:55.627953] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:21.144 [2024-04-25 03:24:55.627988] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:21.144 [2024-04-25 03:24:55.627996] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:24:21.144 [2024-04-25 03:24:55.628002] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:24:21.144 [2024-04-25 03:24:55.628007] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:21.144 [2024-04-25 03:24:55.628048] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:21.144 [2024-04-25 03:24:55.628135] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:21.144 [2024-04-25 03:24:55.628242] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:21.144 [2024-04-25 03:24:55.628243] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:24:22.077 03:24:56 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:22.077 03:24:56 -- common/autotest_common.sh@850 -- # return 0 00:24:22.077 03:24:56 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:24:22.077 03:24:56 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:22.077 03:24:56 -- common/autotest_common.sh@10 -- # set +x 00:24:22.077 03:24:56 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:22.077 03:24:56 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:24:22.077 03:24:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:22.077 03:24:56 -- common/autotest_common.sh@10 -- # set +x 00:24:22.077 [2024-04-25 03:24:56.347126] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x912190/0x9117d0) succeed. 00:24:22.077 [2024-04-25 03:24:56.357345] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x913500/0x911d50) succeed. 00:24:22.077 [2024-04-25 03:24:56.357366] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:24:22.077 03:24:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:22.077 03:24:56 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:24:22.077 03:24:56 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:24:22.077 03:24:56 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:22.077 03:24:56 -- common/autotest_common.sh@10 -- # set +x 00:24:22.077 03:24:56 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:22.077 03:24:56 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:22.077 03:24:56 -- target/shutdown.sh@28 -- # cat 00:24:22.077 03:24:56 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:22.077 03:24:56 -- target/shutdown.sh@28 -- # cat 00:24:22.077 03:24:56 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:22.077 03:24:56 -- target/shutdown.sh@28 -- # cat 00:24:22.077 03:24:56 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:22.077 03:24:56 -- target/shutdown.sh@28 -- # cat 00:24:22.077 03:24:56 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:22.077 03:24:56 -- target/shutdown.sh@28 -- # cat 00:24:22.077 03:24:56 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:22.077 03:24:56 -- target/shutdown.sh@28 -- # cat 00:24:22.077 03:24:56 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:22.077 03:24:56 -- target/shutdown.sh@28 -- # cat 00:24:22.077 03:24:56 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:22.077 03:24:56 -- target/shutdown.sh@28 -- # cat 00:24:22.077 03:24:56 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:22.077 03:24:56 -- target/shutdown.sh@28 -- # cat 00:24:22.077 03:24:56 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:22.077 03:24:56 -- target/shutdown.sh@28 -- # cat 00:24:22.077 03:24:56 -- target/shutdown.sh@35 -- # rpc_cmd 00:24:22.078 03:24:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:22.078 03:24:56 -- common/autotest_common.sh@10 -- # set +x 00:24:22.078 Malloc1 00:24:22.078 [2024-04-25 03:24:56.452130] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:24:22.078 Malloc2 00:24:22.078 Malloc3 00:24:22.078 Malloc4 00:24:22.335 Malloc5 00:24:22.335 Malloc6 00:24:22.335 Malloc7 00:24:22.335 Malloc8 00:24:22.335 Malloc9 00:24:22.335 Malloc10 00:24:22.594 03:24:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:22.594 03:24:56 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:24:22.594 03:24:56 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:22.594 03:24:56 -- common/autotest_common.sh@10 -- # set +x 00:24:22.594 03:24:56 -- target/shutdown.sh@103 -- # perfpid=4182549 00:24:22.594 03:24:56 -- target/shutdown.sh@104 -- # waitforlisten 4182549 /var/tmp/bdevperf.sock 00:24:22.594 03:24:56 -- common/autotest_common.sh@817 -- # '[' -z 4182549 ']' 00:24:22.594 03:24:56 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:22.594 03:24:56 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:22.594 03:24:56 -- target/shutdown.sh@102 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:24:22.594 03:24:56 -- target/shutdown.sh@102 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:22.594 03:24:56 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:22.594 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:22.594 03:24:56 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:22.594 03:24:56 -- nvmf/common.sh@521 -- # config=() 00:24:22.594 03:24:56 -- common/autotest_common.sh@10 -- # set +x 00:24:22.594 03:24:56 -- nvmf/common.sh@521 -- # local subsystem config 00:24:22.594 03:24:56 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:22.594 03:24:56 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:22.594 { 00:24:22.595 "params": { 00:24:22.595 "name": "Nvme$subsystem", 00:24:22.595 "trtype": "$TEST_TRANSPORT", 00:24:22.595 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:22.595 "adrfam": "ipv4", 00:24:22.595 "trsvcid": "$NVMF_PORT", 00:24:22.595 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:22.595 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:22.595 "hdgst": ${hdgst:-false}, 00:24:22.595 "ddgst": ${ddgst:-false} 00:24:22.595 }, 00:24:22.595 "method": "bdev_nvme_attach_controller" 00:24:22.595 } 00:24:22.595 EOF 00:24:22.595 )") 00:24:22.595 03:24:56 -- nvmf/common.sh@543 -- # cat 00:24:22.595 03:24:56 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:22.595 03:24:56 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:22.595 { 00:24:22.595 "params": { 00:24:22.595 "name": "Nvme$subsystem", 00:24:22.595 "trtype": "$TEST_TRANSPORT", 00:24:22.595 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:22.595 "adrfam": "ipv4", 00:24:22.595 "trsvcid": "$NVMF_PORT", 00:24:22.595 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:22.595 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:22.595 "hdgst": ${hdgst:-false}, 00:24:22.595 "ddgst": ${ddgst:-false} 00:24:22.595 }, 00:24:22.595 "method": "bdev_nvme_attach_controller" 00:24:22.595 } 00:24:22.595 EOF 00:24:22.595 )") 00:24:22.595 03:24:56 -- nvmf/common.sh@543 -- # cat 00:24:22.595 03:24:56 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:22.595 03:24:56 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:22.595 { 00:24:22.595 "params": { 00:24:22.595 "name": "Nvme$subsystem", 00:24:22.595 "trtype": "$TEST_TRANSPORT", 00:24:22.595 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:22.595 "adrfam": "ipv4", 00:24:22.595 "trsvcid": "$NVMF_PORT", 00:24:22.595 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:22.595 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:22.595 "hdgst": ${hdgst:-false}, 00:24:22.595 "ddgst": ${ddgst:-false} 00:24:22.595 }, 00:24:22.595 "method": "bdev_nvme_attach_controller" 00:24:22.595 } 00:24:22.595 EOF 00:24:22.595 )") 00:24:22.595 03:24:56 -- nvmf/common.sh@543 -- # cat 00:24:22.595 03:24:56 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:22.595 03:24:56 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:22.595 { 00:24:22.595 "params": { 00:24:22.595 "name": "Nvme$subsystem", 00:24:22.595 "trtype": "$TEST_TRANSPORT", 00:24:22.595 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:22.595 "adrfam": "ipv4", 00:24:22.595 "trsvcid": "$NVMF_PORT", 00:24:22.595 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:22.595 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:22.595 "hdgst": ${hdgst:-false}, 00:24:22.595 "ddgst": ${ddgst:-false} 00:24:22.595 }, 00:24:22.595 "method": "bdev_nvme_attach_controller" 00:24:22.595 } 00:24:22.595 EOF 00:24:22.595 )") 00:24:22.595 03:24:56 -- nvmf/common.sh@543 -- # cat 00:24:22.595 03:24:56 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:22.595 03:24:56 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:22.595 { 00:24:22.595 "params": { 00:24:22.595 "name": "Nvme$subsystem", 00:24:22.595 "trtype": "$TEST_TRANSPORT", 00:24:22.595 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:22.595 "adrfam": "ipv4", 00:24:22.595 "trsvcid": "$NVMF_PORT", 00:24:22.595 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:22.595 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:22.595 "hdgst": ${hdgst:-false}, 00:24:22.595 "ddgst": ${ddgst:-false} 00:24:22.595 }, 00:24:22.595 "method": "bdev_nvme_attach_controller" 00:24:22.595 } 00:24:22.595 EOF 00:24:22.595 )") 00:24:22.595 03:24:56 -- nvmf/common.sh@543 -- # cat 00:24:22.595 03:24:56 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:22.595 03:24:56 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:22.595 { 00:24:22.595 "params": { 00:24:22.595 "name": "Nvme$subsystem", 00:24:22.595 "trtype": "$TEST_TRANSPORT", 00:24:22.595 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:22.595 "adrfam": "ipv4", 00:24:22.595 "trsvcid": "$NVMF_PORT", 00:24:22.595 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:22.595 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:22.595 "hdgst": ${hdgst:-false}, 00:24:22.595 "ddgst": ${ddgst:-false} 00:24:22.595 }, 00:24:22.595 "method": "bdev_nvme_attach_controller" 00:24:22.595 } 00:24:22.595 EOF 00:24:22.595 )") 00:24:22.595 03:24:56 -- nvmf/common.sh@543 -- # cat 00:24:22.595 03:24:56 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:22.595 03:24:56 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:22.595 { 00:24:22.595 "params": { 00:24:22.595 "name": "Nvme$subsystem", 00:24:22.595 "trtype": "$TEST_TRANSPORT", 00:24:22.595 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:22.595 "adrfam": "ipv4", 00:24:22.595 "trsvcid": "$NVMF_PORT", 00:24:22.595 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:22.595 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:22.595 "hdgst": ${hdgst:-false}, 00:24:22.595 "ddgst": ${ddgst:-false} 00:24:22.595 }, 00:24:22.595 "method": "bdev_nvme_attach_controller" 00:24:22.595 } 00:24:22.595 EOF 00:24:22.595 )") 00:24:22.595 03:24:56 -- nvmf/common.sh@543 -- # cat 00:24:22.595 [2024-04-25 03:24:56.932472] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:24:22.595 [2024-04-25 03:24:56.932517] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4182549 ] 00:24:22.595 03:24:56 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:22.595 03:24:56 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:22.595 { 00:24:22.595 "params": { 00:24:22.595 "name": "Nvme$subsystem", 00:24:22.595 "trtype": "$TEST_TRANSPORT", 00:24:22.595 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:22.595 "adrfam": "ipv4", 00:24:22.595 "trsvcid": "$NVMF_PORT", 00:24:22.595 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:22.595 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:22.595 "hdgst": ${hdgst:-false}, 00:24:22.595 "ddgst": ${ddgst:-false} 00:24:22.595 }, 00:24:22.595 "method": "bdev_nvme_attach_controller" 00:24:22.595 } 00:24:22.595 EOF 00:24:22.595 )") 00:24:22.595 03:24:56 -- nvmf/common.sh@543 -- # cat 00:24:22.595 03:24:56 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:22.595 03:24:56 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:22.595 { 00:24:22.595 "params": { 00:24:22.595 "name": "Nvme$subsystem", 00:24:22.595 "trtype": "$TEST_TRANSPORT", 00:24:22.595 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:22.595 "adrfam": "ipv4", 00:24:22.595 "trsvcid": "$NVMF_PORT", 00:24:22.595 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:22.595 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:22.595 "hdgst": ${hdgst:-false}, 00:24:22.595 "ddgst": ${ddgst:-false} 00:24:22.595 }, 00:24:22.596 "method": "bdev_nvme_attach_controller" 00:24:22.596 } 00:24:22.596 EOF 00:24:22.596 )") 00:24:22.596 03:24:56 -- nvmf/common.sh@543 -- # cat 00:24:22.596 03:24:56 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:22.596 03:24:56 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:22.596 { 00:24:22.596 "params": { 00:24:22.596 "name": "Nvme$subsystem", 00:24:22.596 "trtype": "$TEST_TRANSPORT", 00:24:22.596 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:22.596 "adrfam": "ipv4", 00:24:22.596 "trsvcid": "$NVMF_PORT", 00:24:22.596 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:22.596 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:22.596 "hdgst": ${hdgst:-false}, 00:24:22.596 "ddgst": ${ddgst:-false} 00:24:22.596 }, 00:24:22.596 "method": "bdev_nvme_attach_controller" 00:24:22.596 } 00:24:22.596 EOF 00:24:22.596 )") 00:24:22.596 03:24:56 -- nvmf/common.sh@543 -- # cat 00:24:22.596 03:24:56 -- nvmf/common.sh@545 -- # jq . 00:24:22.596 03:24:56 -- nvmf/common.sh@546 -- # IFS=, 00:24:22.596 03:24:56 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:24:22.596 "params": { 00:24:22.596 "name": "Nvme1", 00:24:22.596 "trtype": "rdma", 00:24:22.596 "traddr": "192.168.100.8", 00:24:22.596 "adrfam": "ipv4", 00:24:22.596 "trsvcid": "4420", 00:24:22.596 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:22.596 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:22.596 "hdgst": false, 00:24:22.596 "ddgst": false 00:24:22.596 }, 00:24:22.596 "method": "bdev_nvme_attach_controller" 00:24:22.596 },{ 00:24:22.596 "params": { 00:24:22.596 "name": "Nvme2", 00:24:22.596 "trtype": "rdma", 00:24:22.596 "traddr": "192.168.100.8", 00:24:22.596 "adrfam": "ipv4", 00:24:22.596 "trsvcid": "4420", 00:24:22.596 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:22.596 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:22.596 "hdgst": false, 00:24:22.596 "ddgst": false 00:24:22.596 }, 00:24:22.596 "method": "bdev_nvme_attach_controller" 00:24:22.596 },{ 00:24:22.596 "params": { 00:24:22.596 "name": "Nvme3", 00:24:22.596 "trtype": "rdma", 00:24:22.596 "traddr": "192.168.100.8", 00:24:22.596 "adrfam": "ipv4", 00:24:22.596 "trsvcid": "4420", 00:24:22.596 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:22.596 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:22.596 "hdgst": false, 00:24:22.596 "ddgst": false 00:24:22.596 }, 00:24:22.596 "method": "bdev_nvme_attach_controller" 00:24:22.596 },{ 00:24:22.596 "params": { 00:24:22.596 "name": "Nvme4", 00:24:22.596 "trtype": "rdma", 00:24:22.596 "traddr": "192.168.100.8", 00:24:22.596 "adrfam": "ipv4", 00:24:22.596 "trsvcid": "4420", 00:24:22.596 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:22.596 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:22.596 "hdgst": false, 00:24:22.596 "ddgst": false 00:24:22.596 }, 00:24:22.596 "method": "bdev_nvme_attach_controller" 00:24:22.596 },{ 00:24:22.596 "params": { 00:24:22.596 "name": "Nvme5", 00:24:22.596 "trtype": "rdma", 00:24:22.596 "traddr": "192.168.100.8", 00:24:22.596 "adrfam": "ipv4", 00:24:22.596 "trsvcid": "4420", 00:24:22.596 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:22.596 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:22.596 "hdgst": false, 00:24:22.596 "ddgst": false 00:24:22.596 }, 00:24:22.596 "method": "bdev_nvme_attach_controller" 00:24:22.596 },{ 00:24:22.596 "params": { 00:24:22.596 "name": "Nvme6", 00:24:22.596 "trtype": "rdma", 00:24:22.596 "traddr": "192.168.100.8", 00:24:22.596 "adrfam": "ipv4", 00:24:22.596 "trsvcid": "4420", 00:24:22.596 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:22.596 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:22.596 "hdgst": false, 00:24:22.596 "ddgst": false 00:24:22.596 }, 00:24:22.596 "method": "bdev_nvme_attach_controller" 00:24:22.596 },{ 00:24:22.596 "params": { 00:24:22.596 "name": "Nvme7", 00:24:22.596 "trtype": "rdma", 00:24:22.596 "traddr": "192.168.100.8", 00:24:22.596 "adrfam": "ipv4", 00:24:22.596 "trsvcid": "4420", 00:24:22.596 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:22.596 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:22.596 "hdgst": false, 00:24:22.596 "ddgst": false 00:24:22.596 }, 00:24:22.596 "method": "bdev_nvme_attach_controller" 00:24:22.596 },{ 00:24:22.596 "params": { 00:24:22.596 "name": "Nvme8", 00:24:22.596 "trtype": "rdma", 00:24:22.596 "traddr": "192.168.100.8", 00:24:22.596 "adrfam": "ipv4", 00:24:22.596 "trsvcid": "4420", 00:24:22.596 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:22.596 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:22.596 "hdgst": false, 00:24:22.596 "ddgst": false 00:24:22.596 }, 00:24:22.596 "method": "bdev_nvme_attach_controller" 00:24:22.596 },{ 00:24:22.596 "params": { 00:24:22.596 "name": "Nvme9", 00:24:22.596 "trtype": "rdma", 00:24:22.596 "traddr": "192.168.100.8", 00:24:22.596 "adrfam": "ipv4", 00:24:22.596 "trsvcid": "4420", 00:24:22.596 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:22.596 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:22.596 "hdgst": false, 00:24:22.596 "ddgst": false 00:24:22.596 }, 00:24:22.596 "method": "bdev_nvme_attach_controller" 00:24:22.596 },{ 00:24:22.596 "params": { 00:24:22.596 "name": "Nvme10", 00:24:22.596 "trtype": "rdma", 00:24:22.596 "traddr": "192.168.100.8", 00:24:22.596 "adrfam": "ipv4", 00:24:22.596 "trsvcid": "4420", 00:24:22.596 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:22.596 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:22.596 "hdgst": false, 00:24:22.596 "ddgst": false 00:24:22.596 }, 00:24:22.596 "method": "bdev_nvme_attach_controller" 00:24:22.596 }' 00:24:22.596 EAL: No free 2048 kB hugepages reported on node 1 00:24:22.596 [2024-04-25 03:24:56.993815] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:22.596 [2024-04-25 03:24:57.064036] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:23.528 Running I/O for 10 seconds... 00:24:23.528 03:24:57 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:23.528 03:24:57 -- common/autotest_common.sh@850 -- # return 0 00:24:23.528 03:24:57 -- target/shutdown.sh@105 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:24:23.528 03:24:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:23.528 03:24:57 -- common/autotest_common.sh@10 -- # set +x 00:24:23.785 03:24:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:23.785 03:24:58 -- target/shutdown.sh@107 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:24:23.785 03:24:58 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:24:23.785 03:24:58 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:24:23.785 03:24:58 -- target/shutdown.sh@57 -- # local ret=1 00:24:23.785 03:24:58 -- target/shutdown.sh@58 -- # local i 00:24:23.785 03:24:58 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:24:23.785 03:24:58 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:24:23.785 03:24:58 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:24:23.785 03:24:58 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:24:23.785 03:24:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:23.785 03:24:58 -- common/autotest_common.sh@10 -- # set +x 00:24:23.785 03:24:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:23.785 03:24:58 -- target/shutdown.sh@60 -- # read_io_count=3 00:24:23.785 03:24:58 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:24:23.785 03:24:58 -- target/shutdown.sh@67 -- # sleep 0.25 00:24:24.043 03:24:58 -- target/shutdown.sh@59 -- # (( i-- )) 00:24:24.043 03:24:58 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:24:24.043 03:24:58 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:24:24.043 03:24:58 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:24:24.043 03:24:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:24.043 03:24:58 -- common/autotest_common.sh@10 -- # set +x 00:24:24.301 03:24:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:24.301 03:24:58 -- target/shutdown.sh@60 -- # read_io_count=195 00:24:24.301 03:24:58 -- target/shutdown.sh@63 -- # '[' 195 -ge 100 ']' 00:24:24.301 03:24:58 -- target/shutdown.sh@64 -- # ret=0 00:24:24.301 03:24:58 -- target/shutdown.sh@65 -- # break 00:24:24.301 03:24:58 -- target/shutdown.sh@69 -- # return 0 00:24:24.301 03:24:58 -- target/shutdown.sh@110 -- # killprocess 4182549 00:24:24.301 03:24:58 -- common/autotest_common.sh@936 -- # '[' -z 4182549 ']' 00:24:24.301 03:24:58 -- common/autotest_common.sh@940 -- # kill -0 4182549 00:24:24.301 03:24:58 -- common/autotest_common.sh@941 -- # uname 00:24:24.301 03:24:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:24.301 03:24:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4182549 00:24:24.301 03:24:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:24.301 03:24:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:24.301 03:24:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4182549' 00:24:24.301 killing process with pid 4182549 00:24:24.301 03:24:58 -- common/autotest_common.sh@955 -- # kill 4182549 00:24:24.301 03:24:58 -- common/autotest_common.sh@960 -- # wait 4182549 00:24:24.301 Received shutdown signal, test time was about 0.858126 seconds 00:24:24.301 00:24:24.301 Latency(us) 00:24:24.301 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:24.301 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:24.301 Verification LBA range: start 0x0 length 0x400 00:24:24.301 Nvme1n1 : 0.85 377.59 23.60 0.00 0.00 165505.71 9861.61 165774.87 00:24:24.301 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:24.301 Verification LBA range: start 0x0 length 0x400 00:24:24.301 Nvme2n1 : 0.85 376.82 23.55 0.00 0.00 162784.99 10985.08 153791.15 00:24:24.301 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:24.301 Verification LBA range: start 0x0 length 0x400 00:24:24.301 Nvme3n1 : 0.84 381.40 23.84 0.00 0.00 157731.16 6303.94 137812.85 00:24:24.301 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:24.301 Verification LBA range: start 0x0 length 0x400 00:24:24.301 Nvme4n1 : 0.84 380.59 23.79 0.00 0.00 155036.72 23218.47 122833.19 00:24:24.301 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:24.301 Verification LBA range: start 0x0 length 0x400 00:24:24.301 Nvme5n1 : 0.85 376.29 23.52 0.00 0.00 153136.96 7864.32 143804.71 00:24:24.301 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:24.301 Verification LBA range: start 0x0 length 0x400 00:24:24.301 Nvme6n1 : 0.85 375.69 23.48 0.00 0.00 150425.40 8363.64 135815.56 00:24:24.301 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:24.301 Verification LBA range: start 0x0 length 0x400 00:24:24.301 Nvme7n1 : 0.85 375.18 23.45 0.00 0.00 147070.00 8738.13 132819.63 00:24:24.301 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:24.301 Verification LBA range: start 0x0 length 0x400 00:24:24.301 Nvme8n1 : 0.85 374.63 23.41 0.00 0.00 144432.47 8987.79 119337.94 00:24:24.301 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:24.301 Verification LBA range: start 0x0 length 0x400 00:24:24.301 Nvme9n1 : 0.86 373.91 23.37 0.00 0.00 142441.72 9861.61 109351.50 00:24:24.301 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:24.301 Verification LBA range: start 0x0 length 0x400 00:24:24.301 Nvme10n1 : 0.86 298.55 18.66 0.00 0.00 174439.38 9924.02 245666.38 00:24:24.301 =================================================================================================================== 00:24:24.301 Total : 3690.64 230.67 0.00 0.00 154909.86 6303.94 245666.38 00:24:24.866 03:24:59 -- target/shutdown.sh@113 -- # sleep 1 00:24:25.799 03:25:00 -- target/shutdown.sh@114 -- # kill -0 4182269 00:24:25.799 03:25:00 -- target/shutdown.sh@116 -- # stoptarget 00:24:25.799 03:25:00 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:24:25.799 03:25:00 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:24:25.799 03:25:00 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:25.799 03:25:00 -- target/shutdown.sh@45 -- # nvmftestfini 00:24:25.799 03:25:00 -- nvmf/common.sh@477 -- # nvmfcleanup 00:24:25.799 03:25:00 -- nvmf/common.sh@117 -- # sync 00:24:25.799 03:25:00 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:24:25.799 03:25:00 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:24:25.799 03:25:00 -- nvmf/common.sh@120 -- # set +e 00:24:25.799 03:25:00 -- nvmf/common.sh@121 -- # for i in {1..20} 00:24:25.799 03:25:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:24:25.799 rmmod nvme_rdma 00:24:25.799 rmmod nvme_fabrics 00:24:25.799 03:25:00 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:24:25.799 03:25:00 -- nvmf/common.sh@124 -- # set -e 00:24:25.799 03:25:00 -- nvmf/common.sh@125 -- # return 0 00:24:25.799 03:25:00 -- nvmf/common.sh@478 -- # '[' -n 4182269 ']' 00:24:25.799 03:25:00 -- nvmf/common.sh@479 -- # killprocess 4182269 00:24:25.799 03:25:00 -- common/autotest_common.sh@936 -- # '[' -z 4182269 ']' 00:24:25.799 03:25:00 -- common/autotest_common.sh@940 -- # kill -0 4182269 00:24:25.800 03:25:00 -- common/autotest_common.sh@941 -- # uname 00:24:25.800 03:25:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:25.800 03:25:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4182269 00:24:25.800 03:25:00 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:24:25.800 03:25:00 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:24:25.800 03:25:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4182269' 00:24:25.800 killing process with pid 4182269 00:24:25.800 03:25:00 -- common/autotest_common.sh@955 -- # kill 4182269 00:24:25.800 03:25:00 -- common/autotest_common.sh@960 -- # wait 4182269 00:24:25.800 [2024-04-25 03:25:00.216412] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:24:26.367 03:25:00 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:24:26.367 03:25:00 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:24:26.367 00:24:26.367 real 0m5.414s 00:24:26.367 user 0m22.038s 00:24:26.367 sys 0m1.104s 00:24:26.367 03:25:00 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:24:26.367 03:25:00 -- common/autotest_common.sh@10 -- # set +x 00:24:26.367 ************************************ 00:24:26.367 END TEST nvmf_shutdown_tc2 00:24:26.367 ************************************ 00:24:26.367 03:25:00 -- target/shutdown.sh@149 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:24:26.367 03:25:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:24:26.367 03:25:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:26.367 03:25:00 -- common/autotest_common.sh@10 -- # set +x 00:24:26.367 ************************************ 00:24:26.367 START TEST nvmf_shutdown_tc3 00:24:26.367 ************************************ 00:24:26.367 03:25:00 -- common/autotest_common.sh@1111 -- # nvmf_shutdown_tc3 00:24:26.367 03:25:00 -- target/shutdown.sh@121 -- # starttarget 00:24:26.367 03:25:00 -- target/shutdown.sh@15 -- # nvmftestinit 00:24:26.367 03:25:00 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:24:26.367 03:25:00 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:26.367 03:25:00 -- nvmf/common.sh@437 -- # prepare_net_devs 00:24:26.367 03:25:00 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:24:26.367 03:25:00 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:24:26.367 03:25:00 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:26.367 03:25:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:26.367 03:25:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:26.367 03:25:00 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:24:26.367 03:25:00 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:24:26.367 03:25:00 -- nvmf/common.sh@285 -- # xtrace_disable 00:24:26.367 03:25:00 -- common/autotest_common.sh@10 -- # set +x 00:24:26.367 03:25:00 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:26.367 03:25:00 -- nvmf/common.sh@291 -- # pci_devs=() 00:24:26.367 03:25:00 -- nvmf/common.sh@291 -- # local -a pci_devs 00:24:26.367 03:25:00 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:24:26.367 03:25:00 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:24:26.367 03:25:00 -- nvmf/common.sh@293 -- # pci_drivers=() 00:24:26.367 03:25:00 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:24:26.367 03:25:00 -- nvmf/common.sh@295 -- # net_devs=() 00:24:26.367 03:25:00 -- nvmf/common.sh@295 -- # local -ga net_devs 00:24:26.367 03:25:00 -- nvmf/common.sh@296 -- # e810=() 00:24:26.367 03:25:00 -- nvmf/common.sh@296 -- # local -ga e810 00:24:26.367 03:25:00 -- nvmf/common.sh@297 -- # x722=() 00:24:26.367 03:25:00 -- nvmf/common.sh@297 -- # local -ga x722 00:24:26.367 03:25:00 -- nvmf/common.sh@298 -- # mlx=() 00:24:26.367 03:25:00 -- nvmf/common.sh@298 -- # local -ga mlx 00:24:26.367 03:25:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:26.367 03:25:00 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:26.367 03:25:00 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:26.367 03:25:00 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:26.367 03:25:00 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:26.367 03:25:00 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:26.367 03:25:00 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:26.367 03:25:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:26.367 03:25:00 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:26.367 03:25:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:26.367 03:25:00 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:26.367 03:25:00 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:24:26.367 03:25:00 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:24:26.367 03:25:00 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:24:26.367 03:25:00 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:24:26.367 03:25:00 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:24:26.367 03:25:00 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:24:26.367 03:25:00 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:24:26.367 03:25:00 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:24:26.367 03:25:00 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:26.367 03:25:00 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:24:26.367 Found 0000:af:00.0 (0x8086 - 0x159b) 00:24:26.367 03:25:00 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:24:26.367 03:25:00 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:24:26.367 03:25:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:26.367 03:25:00 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:26.367 03:25:00 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:24:26.367 03:25:00 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:24:26.367 03:25:00 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:26.367 03:25:00 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:24:26.367 Found 0000:af:00.1 (0x8086 - 0x159b) 00:24:26.367 03:25:00 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:24:26.367 03:25:00 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:24:26.367 03:25:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:26.367 03:25:00 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:26.367 03:25:00 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:24:26.367 03:25:00 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:24:26.367 03:25:00 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:24:26.367 03:25:00 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:24:26.367 03:25:00 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:24:26.367 03:25:00 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:24:26.367 03:25:00 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:24:26.367 03:25:00 -- nvmf/common.sh@377 -- # modinfo irdma 00:24:26.367 03:25:00 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:24:26.367 03:25:00 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:26.367 03:25:00 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:26.367 03:25:00 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:26.367 03:25:00 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:26.367 03:25:00 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:24:26.367 Found net devices under 0000:af:00.0: cvl_0_0 00:24:26.367 03:25:00 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:26.367 03:25:00 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:26.367 03:25:00 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:26.367 03:25:00 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:26.367 03:25:00 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:26.367 03:25:00 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:24:26.367 Found net devices under 0000:af:00.1: cvl_0_1 00:24:26.367 03:25:00 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:26.367 03:25:00 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:24:26.367 03:25:00 -- nvmf/common.sh@403 -- # is_hw=yes 00:24:26.367 03:25:00 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:24:26.367 03:25:00 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:24:26.367 03:25:00 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:24:26.367 03:25:00 -- nvmf/common.sh@409 -- # rdma_device_init 00:24:26.367 03:25:00 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:24:26.367 03:25:00 -- nvmf/common.sh@58 -- # uname 00:24:26.367 03:25:00 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:24:26.367 03:25:00 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:24:26.367 03:25:00 -- nvmf/common.sh@63 -- # modprobe ib_core 00:24:26.367 03:25:00 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:24:26.367 03:25:00 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:24:26.367 03:25:00 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:24:26.367 03:25:00 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:24:26.367 03:25:00 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:24:26.367 03:25:00 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:24:26.367 03:25:00 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:24:26.367 03:25:00 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:24:26.367 03:25:00 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:24:26.367 03:25:00 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:24:26.367 03:25:00 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:24:26.367 03:25:00 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:24:26.626 03:25:00 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:24:26.626 03:25:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:26.626 03:25:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:26.626 03:25:00 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:24:26.626 03:25:00 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:24:26.626 03:25:00 -- nvmf/common.sh@105 -- # continue 2 00:24:26.626 03:25:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:26.626 03:25:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:26.626 03:25:00 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:24:26.626 03:25:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:26.626 03:25:00 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:24:26.626 03:25:00 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:24:26.626 03:25:00 -- nvmf/common.sh@105 -- # continue 2 00:24:26.626 03:25:00 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:24:26.626 03:25:00 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:24:26.626 03:25:00 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:24:26.626 03:25:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:24:26.626 03:25:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:26.626 03:25:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:26.626 03:25:00 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:24:26.626 03:25:00 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:24:26.626 03:25:00 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:24:26.626 50: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:24:26.626 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:24:26.626 altname enp175s0f0np0 00:24:26.626 altname ens801f0np0 00:24:26.626 inet 192.168.100.8/24 scope global cvl_0_0 00:24:26.626 valid_lft forever preferred_lft forever 00:24:26.626 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:24:26.626 valid_lft forever preferred_lft forever 00:24:26.626 03:25:00 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:24:26.626 03:25:00 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:24:26.626 03:25:00 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:24:26.626 03:25:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:24:26.626 03:25:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:26.627 03:25:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:26.627 03:25:00 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:24:26.627 03:25:00 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:24:26.627 03:25:00 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:24:26.627 51: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:24:26.627 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:24:26.627 altname enp175s0f1np1 00:24:26.627 altname ens801f1np1 00:24:26.627 inet 192.168.100.9/24 scope global cvl_0_1 00:24:26.627 valid_lft forever preferred_lft forever 00:24:26.627 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:24:26.627 valid_lft forever preferred_lft forever 00:24:26.627 03:25:00 -- nvmf/common.sh@411 -- # return 0 00:24:26.627 03:25:00 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:24:26.627 03:25:00 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:24:26.627 03:25:00 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:24:26.627 03:25:00 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:24:26.627 03:25:00 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:24:26.627 03:25:00 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:24:26.627 03:25:00 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:24:26.627 03:25:00 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:24:26.627 03:25:00 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:24:26.627 03:25:00 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:24:26.627 03:25:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:26.627 03:25:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:26.627 03:25:00 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:24:26.627 03:25:00 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:24:26.627 03:25:00 -- nvmf/common.sh@105 -- # continue 2 00:24:26.627 03:25:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:26.627 03:25:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:26.627 03:25:00 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:24:26.627 03:25:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:26.627 03:25:00 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:24:26.627 03:25:00 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:24:26.627 03:25:00 -- nvmf/common.sh@105 -- # continue 2 00:24:26.627 03:25:00 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:24:26.627 03:25:00 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:24:26.627 03:25:00 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:24:26.627 03:25:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:24:26.627 03:25:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:26.627 03:25:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:26.627 03:25:00 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:24:26.627 03:25:00 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:24:26.627 03:25:00 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:24:26.627 03:25:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:24:26.627 03:25:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:26.627 03:25:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:26.627 03:25:00 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:24:26.627 192.168.100.9' 00:24:26.627 03:25:00 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:24:26.627 192.168.100.9' 00:24:26.627 03:25:00 -- nvmf/common.sh@446 -- # head -n 1 00:24:26.627 03:25:00 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:24:26.627 03:25:00 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:24:26.627 192.168.100.9' 00:24:26.627 03:25:00 -- nvmf/common.sh@447 -- # tail -n +2 00:24:26.627 03:25:00 -- nvmf/common.sh@447 -- # head -n 1 00:24:26.627 03:25:00 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:24:26.627 03:25:00 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:24:26.627 03:25:00 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:24:26.627 03:25:00 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:24:26.627 03:25:00 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:24:26.627 03:25:00 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:24:26.627 03:25:01 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:24:26.627 03:25:01 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:24:26.627 03:25:01 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:26.627 03:25:01 -- common/autotest_common.sh@10 -- # set +x 00:24:26.627 03:25:01 -- nvmf/common.sh@470 -- # nvmfpid=4183357 00:24:26.627 03:25:01 -- nvmf/common.sh@471 -- # waitforlisten 4183357 00:24:26.627 03:25:01 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:24:26.627 03:25:01 -- common/autotest_common.sh@817 -- # '[' -z 4183357 ']' 00:24:26.627 03:25:01 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:26.627 03:25:01 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:26.627 03:25:01 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:26.627 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:26.627 03:25:01 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:26.627 03:25:01 -- common/autotest_common.sh@10 -- # set +x 00:24:26.627 [2024-04-25 03:25:01.053694] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:24:26.627 [2024-04-25 03:25:01.053743] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:26.627 EAL: No free 2048 kB hugepages reported on node 1 00:24:26.627 [2024-04-25 03:25:01.114432] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:26.885 [2024-04-25 03:25:01.188133] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:26.885 [2024-04-25 03:25:01.188174] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:26.885 [2024-04-25 03:25:01.188181] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:24:26.885 [2024-04-25 03:25:01.188186] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:24:26.886 [2024-04-25 03:25:01.188191] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:26.886 [2024-04-25 03:25:01.188290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:26.886 [2024-04-25 03:25:01.188398] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:26.886 [2024-04-25 03:25:01.188507] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:26.886 [2024-04-25 03:25:01.188508] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:24:27.452 03:25:01 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:27.452 03:25:01 -- common/autotest_common.sh@850 -- # return 0 00:24:27.452 03:25:01 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:24:27.452 03:25:01 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:27.452 03:25:01 -- common/autotest_common.sh@10 -- # set +x 00:24:27.452 03:25:01 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:27.452 03:25:01 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:24:27.452 03:25:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:27.452 03:25:01 -- common/autotest_common.sh@10 -- # set +x 00:24:27.452 [2024-04-25 03:25:01.903291] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x1697190/0x16967d0) succeed. 00:24:27.452 [2024-04-25 03:25:01.913434] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x1698500/0x1696d50) succeed. 00:24:27.452 [2024-04-25 03:25:01.913455] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:24:27.452 03:25:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:27.453 03:25:01 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:24:27.453 03:25:01 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:24:27.453 03:25:01 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:27.453 03:25:01 -- common/autotest_common.sh@10 -- # set +x 00:24:27.453 03:25:01 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:27.453 03:25:01 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:27.453 03:25:01 -- target/shutdown.sh@28 -- # cat 00:24:27.453 03:25:01 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:27.453 03:25:01 -- target/shutdown.sh@28 -- # cat 00:24:27.453 03:25:01 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:27.453 03:25:01 -- target/shutdown.sh@28 -- # cat 00:24:27.453 03:25:01 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:27.453 03:25:01 -- target/shutdown.sh@28 -- # cat 00:24:27.453 03:25:01 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:27.453 03:25:01 -- target/shutdown.sh@28 -- # cat 00:24:27.453 03:25:01 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:27.453 03:25:01 -- target/shutdown.sh@28 -- # cat 00:24:27.453 03:25:01 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:27.453 03:25:01 -- target/shutdown.sh@28 -- # cat 00:24:27.453 03:25:01 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:27.453 03:25:01 -- target/shutdown.sh@28 -- # cat 00:24:27.711 03:25:01 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:27.711 03:25:01 -- target/shutdown.sh@28 -- # cat 00:24:27.711 03:25:01 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:27.711 03:25:01 -- target/shutdown.sh@28 -- # cat 00:24:27.711 03:25:01 -- target/shutdown.sh@35 -- # rpc_cmd 00:24:27.711 03:25:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:27.711 03:25:01 -- common/autotest_common.sh@10 -- # set +x 00:24:27.711 Malloc1 00:24:27.711 [2024-04-25 03:25:02.004206] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:24:27.711 Malloc2 00:24:27.711 Malloc3 00:24:27.711 Malloc4 00:24:27.711 Malloc5 00:24:27.711 Malloc6 00:24:27.969 Malloc7 00:24:27.969 Malloc8 00:24:27.969 Malloc9 00:24:27.969 Malloc10 00:24:27.969 03:25:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:27.969 03:25:02 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:24:27.969 03:25:02 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:27.969 03:25:02 -- common/autotest_common.sh@10 -- # set +x 00:24:27.969 03:25:02 -- target/shutdown.sh@125 -- # perfpid=4183630 00:24:27.969 03:25:02 -- target/shutdown.sh@126 -- # waitforlisten 4183630 /var/tmp/bdevperf.sock 00:24:27.969 03:25:02 -- common/autotest_common.sh@817 -- # '[' -z 4183630 ']' 00:24:27.969 03:25:02 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:27.969 03:25:02 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:27.970 03:25:02 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:27.970 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:27.970 03:25:02 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:27.970 03:25:02 -- common/autotest_common.sh@10 -- # set +x 00:24:27.970 03:25:02 -- target/shutdown.sh@124 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:24:27.970 03:25:02 -- target/shutdown.sh@124 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:27.970 03:25:02 -- nvmf/common.sh@521 -- # config=() 00:24:27.970 03:25:02 -- nvmf/common.sh@521 -- # local subsystem config 00:24:27.970 03:25:02 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:27.970 03:25:02 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:27.970 { 00:24:27.970 "params": { 00:24:27.970 "name": "Nvme$subsystem", 00:24:27.970 "trtype": "$TEST_TRANSPORT", 00:24:27.970 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:27.970 "adrfam": "ipv4", 00:24:27.970 "trsvcid": "$NVMF_PORT", 00:24:27.970 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:27.970 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:27.970 "hdgst": ${hdgst:-false}, 00:24:27.970 "ddgst": ${ddgst:-false} 00:24:27.970 }, 00:24:27.970 "method": "bdev_nvme_attach_controller" 00:24:27.970 } 00:24:27.970 EOF 00:24:27.970 )") 00:24:27.970 03:25:02 -- nvmf/common.sh@543 -- # cat 00:24:27.970 03:25:02 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:27.970 03:25:02 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:27.970 { 00:24:27.970 "params": { 00:24:27.970 "name": "Nvme$subsystem", 00:24:27.970 "trtype": "$TEST_TRANSPORT", 00:24:27.970 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:27.970 "adrfam": "ipv4", 00:24:27.970 "trsvcid": "$NVMF_PORT", 00:24:27.970 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:27.970 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:27.970 "hdgst": ${hdgst:-false}, 00:24:27.970 "ddgst": ${ddgst:-false} 00:24:27.970 }, 00:24:27.970 "method": "bdev_nvme_attach_controller" 00:24:27.970 } 00:24:27.970 EOF 00:24:27.970 )") 00:24:27.970 03:25:02 -- nvmf/common.sh@543 -- # cat 00:24:27.970 03:25:02 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:27.970 03:25:02 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:27.970 { 00:24:27.970 "params": { 00:24:27.970 "name": "Nvme$subsystem", 00:24:27.970 "trtype": "$TEST_TRANSPORT", 00:24:27.970 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:27.970 "adrfam": "ipv4", 00:24:27.970 "trsvcid": "$NVMF_PORT", 00:24:27.970 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:27.970 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:27.970 "hdgst": ${hdgst:-false}, 00:24:27.970 "ddgst": ${ddgst:-false} 00:24:27.970 }, 00:24:27.970 "method": "bdev_nvme_attach_controller" 00:24:27.970 } 00:24:27.970 EOF 00:24:27.970 )") 00:24:27.970 03:25:02 -- nvmf/common.sh@543 -- # cat 00:24:27.970 03:25:02 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:27.970 03:25:02 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:27.970 { 00:24:27.970 "params": { 00:24:27.970 "name": "Nvme$subsystem", 00:24:27.970 "trtype": "$TEST_TRANSPORT", 00:24:27.970 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:27.970 "adrfam": "ipv4", 00:24:27.970 "trsvcid": "$NVMF_PORT", 00:24:27.970 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:27.970 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:27.970 "hdgst": ${hdgst:-false}, 00:24:27.970 "ddgst": ${ddgst:-false} 00:24:27.970 }, 00:24:27.970 "method": "bdev_nvme_attach_controller" 00:24:27.970 } 00:24:27.970 EOF 00:24:27.970 )") 00:24:27.970 03:25:02 -- nvmf/common.sh@543 -- # cat 00:24:27.970 03:25:02 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:27.970 03:25:02 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:27.970 { 00:24:27.970 "params": { 00:24:27.970 "name": "Nvme$subsystem", 00:24:27.970 "trtype": "$TEST_TRANSPORT", 00:24:27.970 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:27.970 "adrfam": "ipv4", 00:24:27.970 "trsvcid": "$NVMF_PORT", 00:24:27.970 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:27.970 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:27.970 "hdgst": ${hdgst:-false}, 00:24:27.970 "ddgst": ${ddgst:-false} 00:24:27.970 }, 00:24:27.970 "method": "bdev_nvme_attach_controller" 00:24:27.970 } 00:24:27.970 EOF 00:24:27.970 )") 00:24:27.970 03:25:02 -- nvmf/common.sh@543 -- # cat 00:24:27.970 03:25:02 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:27.970 03:25:02 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:27.970 { 00:24:27.970 "params": { 00:24:27.970 "name": "Nvme$subsystem", 00:24:27.970 "trtype": "$TEST_TRANSPORT", 00:24:27.970 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:27.970 "adrfam": "ipv4", 00:24:27.970 "trsvcid": "$NVMF_PORT", 00:24:27.970 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:27.970 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:27.970 "hdgst": ${hdgst:-false}, 00:24:27.970 "ddgst": ${ddgst:-false} 00:24:27.970 }, 00:24:27.970 "method": "bdev_nvme_attach_controller" 00:24:27.970 } 00:24:27.970 EOF 00:24:27.970 )") 00:24:27.970 03:25:02 -- nvmf/common.sh@543 -- # cat 00:24:28.230 03:25:02 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:28.230 03:25:02 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:28.230 { 00:24:28.230 "params": { 00:24:28.230 "name": "Nvme$subsystem", 00:24:28.230 "trtype": "$TEST_TRANSPORT", 00:24:28.230 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:28.230 "adrfam": "ipv4", 00:24:28.230 "trsvcid": "$NVMF_PORT", 00:24:28.230 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:28.230 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:28.230 "hdgst": ${hdgst:-false}, 00:24:28.230 "ddgst": ${ddgst:-false} 00:24:28.230 }, 00:24:28.230 "method": "bdev_nvme_attach_controller" 00:24:28.230 } 00:24:28.230 EOF 00:24:28.230 )") 00:24:28.230 03:25:02 -- nvmf/common.sh@543 -- # cat 00:24:28.230 [2024-04-25 03:25:02.474428] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:24:28.230 [2024-04-25 03:25:02.474474] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4183630 ] 00:24:28.230 03:25:02 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:28.230 03:25:02 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:28.230 { 00:24:28.230 "params": { 00:24:28.230 "name": "Nvme$subsystem", 00:24:28.230 "trtype": "$TEST_TRANSPORT", 00:24:28.230 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:28.230 "adrfam": "ipv4", 00:24:28.230 "trsvcid": "$NVMF_PORT", 00:24:28.230 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:28.230 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:28.230 "hdgst": ${hdgst:-false}, 00:24:28.230 "ddgst": ${ddgst:-false} 00:24:28.230 }, 00:24:28.230 "method": "bdev_nvme_attach_controller" 00:24:28.230 } 00:24:28.230 EOF 00:24:28.230 )") 00:24:28.230 03:25:02 -- nvmf/common.sh@543 -- # cat 00:24:28.230 03:25:02 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:28.230 03:25:02 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:28.230 { 00:24:28.230 "params": { 00:24:28.230 "name": "Nvme$subsystem", 00:24:28.230 "trtype": "$TEST_TRANSPORT", 00:24:28.230 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:28.230 "adrfam": "ipv4", 00:24:28.230 "trsvcid": "$NVMF_PORT", 00:24:28.230 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:28.230 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:28.230 "hdgst": ${hdgst:-false}, 00:24:28.230 "ddgst": ${ddgst:-false} 00:24:28.230 }, 00:24:28.230 "method": "bdev_nvme_attach_controller" 00:24:28.230 } 00:24:28.230 EOF 00:24:28.230 )") 00:24:28.230 03:25:02 -- nvmf/common.sh@543 -- # cat 00:24:28.230 03:25:02 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:28.230 03:25:02 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:28.230 { 00:24:28.230 "params": { 00:24:28.230 "name": "Nvme$subsystem", 00:24:28.230 "trtype": "$TEST_TRANSPORT", 00:24:28.230 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:28.230 "adrfam": "ipv4", 00:24:28.230 "trsvcid": "$NVMF_PORT", 00:24:28.230 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:28.230 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:28.230 "hdgst": ${hdgst:-false}, 00:24:28.230 "ddgst": ${ddgst:-false} 00:24:28.230 }, 00:24:28.230 "method": "bdev_nvme_attach_controller" 00:24:28.230 } 00:24:28.230 EOF 00:24:28.230 )") 00:24:28.230 03:25:02 -- nvmf/common.sh@543 -- # cat 00:24:28.230 03:25:02 -- nvmf/common.sh@545 -- # jq . 00:24:28.230 03:25:02 -- nvmf/common.sh@546 -- # IFS=, 00:24:28.230 EAL: No free 2048 kB hugepages reported on node 1 00:24:28.230 03:25:02 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:24:28.230 "params": { 00:24:28.230 "name": "Nvme1", 00:24:28.230 "trtype": "rdma", 00:24:28.230 "traddr": "192.168.100.8", 00:24:28.230 "adrfam": "ipv4", 00:24:28.230 "trsvcid": "4420", 00:24:28.230 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:28.230 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:28.230 "hdgst": false, 00:24:28.230 "ddgst": false 00:24:28.230 }, 00:24:28.230 "method": "bdev_nvme_attach_controller" 00:24:28.230 },{ 00:24:28.230 "params": { 00:24:28.230 "name": "Nvme2", 00:24:28.230 "trtype": "rdma", 00:24:28.230 "traddr": "192.168.100.8", 00:24:28.230 "adrfam": "ipv4", 00:24:28.230 "trsvcid": "4420", 00:24:28.230 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:28.230 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:28.230 "hdgst": false, 00:24:28.230 "ddgst": false 00:24:28.230 }, 00:24:28.230 "method": "bdev_nvme_attach_controller" 00:24:28.230 },{ 00:24:28.230 "params": { 00:24:28.230 "name": "Nvme3", 00:24:28.230 "trtype": "rdma", 00:24:28.230 "traddr": "192.168.100.8", 00:24:28.230 "adrfam": "ipv4", 00:24:28.230 "trsvcid": "4420", 00:24:28.230 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:28.230 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:28.230 "hdgst": false, 00:24:28.230 "ddgst": false 00:24:28.230 }, 00:24:28.230 "method": "bdev_nvme_attach_controller" 00:24:28.230 },{ 00:24:28.230 "params": { 00:24:28.230 "name": "Nvme4", 00:24:28.230 "trtype": "rdma", 00:24:28.230 "traddr": "192.168.100.8", 00:24:28.230 "adrfam": "ipv4", 00:24:28.230 "trsvcid": "4420", 00:24:28.230 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:28.230 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:28.230 "hdgst": false, 00:24:28.230 "ddgst": false 00:24:28.230 }, 00:24:28.230 "method": "bdev_nvme_attach_controller" 00:24:28.230 },{ 00:24:28.230 "params": { 00:24:28.230 "name": "Nvme5", 00:24:28.230 "trtype": "rdma", 00:24:28.230 "traddr": "192.168.100.8", 00:24:28.230 "adrfam": "ipv4", 00:24:28.230 "trsvcid": "4420", 00:24:28.230 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:28.230 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:28.230 "hdgst": false, 00:24:28.230 "ddgst": false 00:24:28.230 }, 00:24:28.230 "method": "bdev_nvme_attach_controller" 00:24:28.230 },{ 00:24:28.230 "params": { 00:24:28.230 "name": "Nvme6", 00:24:28.230 "trtype": "rdma", 00:24:28.230 "traddr": "192.168.100.8", 00:24:28.230 "adrfam": "ipv4", 00:24:28.230 "trsvcid": "4420", 00:24:28.230 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:28.230 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:28.230 "hdgst": false, 00:24:28.230 "ddgst": false 00:24:28.230 }, 00:24:28.230 "method": "bdev_nvme_attach_controller" 00:24:28.230 },{ 00:24:28.230 "params": { 00:24:28.230 "name": "Nvme7", 00:24:28.230 "trtype": "rdma", 00:24:28.230 "traddr": "192.168.100.8", 00:24:28.230 "adrfam": "ipv4", 00:24:28.230 "trsvcid": "4420", 00:24:28.230 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:28.230 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:28.230 "hdgst": false, 00:24:28.230 "ddgst": false 00:24:28.230 }, 00:24:28.230 "method": "bdev_nvme_attach_controller" 00:24:28.230 },{ 00:24:28.230 "params": { 00:24:28.230 "name": "Nvme8", 00:24:28.230 "trtype": "rdma", 00:24:28.230 "traddr": "192.168.100.8", 00:24:28.230 "adrfam": "ipv4", 00:24:28.230 "trsvcid": "4420", 00:24:28.230 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:28.230 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:28.230 "hdgst": false, 00:24:28.230 "ddgst": false 00:24:28.230 }, 00:24:28.230 "method": "bdev_nvme_attach_controller" 00:24:28.230 },{ 00:24:28.230 "params": { 00:24:28.230 "name": "Nvme9", 00:24:28.230 "trtype": "rdma", 00:24:28.230 "traddr": "192.168.100.8", 00:24:28.230 "adrfam": "ipv4", 00:24:28.230 "trsvcid": "4420", 00:24:28.230 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:28.230 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:28.230 "hdgst": false, 00:24:28.230 "ddgst": false 00:24:28.230 }, 00:24:28.230 "method": "bdev_nvme_attach_controller" 00:24:28.230 },{ 00:24:28.230 "params": { 00:24:28.230 "name": "Nvme10", 00:24:28.230 "trtype": "rdma", 00:24:28.230 "traddr": "192.168.100.8", 00:24:28.230 "adrfam": "ipv4", 00:24:28.230 "trsvcid": "4420", 00:24:28.230 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:28.230 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:28.230 "hdgst": false, 00:24:28.230 "ddgst": false 00:24:28.230 }, 00:24:28.230 "method": "bdev_nvme_attach_controller" 00:24:28.230 }' 00:24:28.230 [2024-04-25 03:25:02.536482] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:28.230 [2024-04-25 03:25:02.606190] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:29.163 Running I/O for 10 seconds... 00:24:29.163 03:25:03 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:29.163 03:25:03 -- common/autotest_common.sh@850 -- # return 0 00:24:29.163 03:25:03 -- target/shutdown.sh@127 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:24:29.163 03:25:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:29.163 03:25:03 -- common/autotest_common.sh@10 -- # set +x 00:24:29.163 03:25:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:29.163 03:25:03 -- target/shutdown.sh@130 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:29.163 03:25:03 -- target/shutdown.sh@132 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:24:29.163 03:25:03 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:24:29.163 03:25:03 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:24:29.163 03:25:03 -- target/shutdown.sh@57 -- # local ret=1 00:24:29.163 03:25:03 -- target/shutdown.sh@58 -- # local i 00:24:29.163 03:25:03 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:24:29.163 03:25:03 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:24:29.163 03:25:03 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:24:29.163 03:25:03 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:24:29.163 03:25:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:29.163 03:25:03 -- common/autotest_common.sh@10 -- # set +x 00:24:29.420 03:25:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:29.420 03:25:03 -- target/shutdown.sh@60 -- # read_io_count=3 00:24:29.420 03:25:03 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:24:29.420 03:25:03 -- target/shutdown.sh@67 -- # sleep 0.25 00:24:29.678 03:25:04 -- target/shutdown.sh@59 -- # (( i-- )) 00:24:29.678 03:25:04 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:24:29.678 03:25:04 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:24:29.678 03:25:04 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:24:29.678 03:25:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:29.678 03:25:04 -- common/autotest_common.sh@10 -- # set +x 00:24:29.936 03:25:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:29.936 03:25:04 -- target/shutdown.sh@60 -- # read_io_count=195 00:24:29.936 03:25:04 -- target/shutdown.sh@63 -- # '[' 195 -ge 100 ']' 00:24:29.936 03:25:04 -- target/shutdown.sh@64 -- # ret=0 00:24:29.936 03:25:04 -- target/shutdown.sh@65 -- # break 00:24:29.936 03:25:04 -- target/shutdown.sh@69 -- # return 0 00:24:29.936 03:25:04 -- target/shutdown.sh@135 -- # killprocess 4183357 00:24:29.936 03:25:04 -- common/autotest_common.sh@936 -- # '[' -z 4183357 ']' 00:24:29.936 03:25:04 -- common/autotest_common.sh@940 -- # kill -0 4183357 00:24:29.936 03:25:04 -- common/autotest_common.sh@941 -- # uname 00:24:29.936 03:25:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:29.936 03:25:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4183357 00:24:29.936 03:25:04 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:24:29.936 03:25:04 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:24:29.936 03:25:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4183357' 00:24:29.936 killing process with pid 4183357 00:24:29.936 03:25:04 -- common/autotest_common.sh@955 -- # kill 4183357 00:24:29.936 03:25:04 -- common/autotest_common.sh@960 -- # wait 4183357 00:24:29.936 [2024-04-25 03:25:04.309721] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:24:30.506 03:25:04 -- target/shutdown.sh@136 -- # nvmfpid= 00:24:30.506 03:25:04 -- target/shutdown.sh@139 -- # sleep 1 00:24:30.506 [2024-04-25 03:25:04.862951] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:24:30.506 [2024-04-25 03:25:04.863339] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192563c0 was disconnected and freed. reset controller. 00:24:30.506 [2024-04-25 03:25:04.863361] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:24:30.506 [2024-04-25 03:25:04.863624] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256180 was disconnected and freed. reset controller. 00:24:30.506 [2024-04-25 03:25:04.863637] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:24:30.506 [2024-04-25 03:25:04.863836] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20001b806c00 was disconnected and freed. reset controller. 00:24:30.506 [2024-04-25 03:25:04.863848] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:24:30.506 [2024-04-25 03:25:04.863868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:32768 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b1f0000 len:0x10000 key:0xa55235f3 00:24:30.506 [2024-04-25 03:25:04.863877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.506 [2024-04-25 03:25:04.863895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b1dff80 len:0x10000 key:0xa55235f3 00:24:30.506 [2024-04-25 03:25:04.863902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.506 [2024-04-25 03:25:04.863911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:33024 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b1cff00 len:0x10000 key:0xa55235f3 00:24:30.506 [2024-04-25 03:25:04.863918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.506 [2024-04-25 03:25:04.863926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:33152 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b1bfe80 len:0x10000 key:0xa55235f3 00:24:30.506 [2024-04-25 03:25:04.863932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.506 [2024-04-25 03:25:04.863941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:33280 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b1afe00 len:0x10000 key:0xa55235f3 00:24:30.506 [2024-04-25 03:25:04.863947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.506 [2024-04-25 03:25:04.863955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:33408 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b19fd80 len:0x10000 key:0xa55235f3 00:24:30.506 [2024-04-25 03:25:04.863976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.506 [2024-04-25 03:25:04.863984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33536 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b18fd00 len:0x10000 key:0xa55235f3 00:24:30.506 [2024-04-25 03:25:04.863991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.506 [2024-04-25 03:25:04.863999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:33664 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b17fc80 len:0x10000 key:0xa55235f3 00:24:30.506 [2024-04-25 03:25:04.864005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.506 [2024-04-25 03:25:04.864014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:33792 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b16fc00 len:0x10000 key:0xa55235f3 00:24:30.506 [2024-04-25 03:25:04.864020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.506 [2024-04-25 03:25:04.864028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:33920 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b15fb80 len:0x10000 key:0xa55235f3 00:24:30.506 [2024-04-25 03:25:04.864034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.506 [2024-04-25 03:25:04.864042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:34048 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b14fb00 len:0x10000 key:0xa55235f3 00:24:30.506 [2024-04-25 03:25:04.864049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.506 [2024-04-25 03:25:04.864057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:34176 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b13fa80 len:0x10000 key:0xa55235f3 00:24:30.506 [2024-04-25 03:25:04.864063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.506 [2024-04-25 03:25:04.864071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34304 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b12fa00 len:0x10000 key:0xa55235f3 00:24:30.506 [2024-04-25 03:25:04.864077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.506 [2024-04-25 03:25:04.864087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:34432 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b11f980 len:0x10000 key:0xa55235f3 00:24:30.506 [2024-04-25 03:25:04.864094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.506 [2024-04-25 03:25:04.864102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:34560 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b10f900 len:0x10000 key:0xa55235f3 00:24:30.506 [2024-04-25 03:25:04.864108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.506 [2024-04-25 03:25:04.864116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:34688 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0ff880 len:0x10000 key:0xa55235f3 00:24:30.506 [2024-04-25 03:25:04.864123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.506 [2024-04-25 03:25:04.864131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:34816 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0ef800 len:0x10000 key:0xa55235f3 00:24:30.506 [2024-04-25 03:25:04.864150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.506 [2024-04-25 03:25:04.864157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:34944 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0df780 len:0x10000 key:0xa55235f3 00:24:30.506 [2024-04-25 03:25:04.864163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.506 [2024-04-25 03:25:04.864171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35072 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0cf700 len:0x10000 key:0xa55235f3 00:24:30.506 [2024-04-25 03:25:04.864178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.506 [2024-04-25 03:25:04.864185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:35200 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0bf680 len:0x10000 key:0xa55235f3 00:24:30.506 [2024-04-25 03:25:04.864191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.506 [2024-04-25 03:25:04.864199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:35328 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0af600 len:0x10000 key:0xa55235f3 00:24:30.507 [2024-04-25 03:25:04.864206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:35456 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b09f580 len:0x10000 key:0xa55235f3 00:24:30.507 [2024-04-25 03:25:04.864219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:35584 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b08f500 len:0x10000 key:0xa55235f3 00:24:30.507 [2024-04-25 03:25:04.864234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:35712 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b07f480 len:0x10000 key:0xa55235f3 00:24:30.507 [2024-04-25 03:25:04.864248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35840 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b06f400 len:0x10000 key:0xa55235f3 00:24:30.507 [2024-04-25 03:25:04.864261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:35968 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b05f380 len:0x10000 key:0xa55235f3 00:24:30.507 [2024-04-25 03:25:04.864275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:36096 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b04f300 len:0x10000 key:0xa55235f3 00:24:30.507 [2024-04-25 03:25:04.864289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:36224 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b03f280 len:0x10000 key:0xa55235f3 00:24:30.507 [2024-04-25 03:25:04.864304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36352 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b02f200 len:0x10000 key:0xa55235f3 00:24:30.507 [2024-04-25 03:25:04.864319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b01f180 len:0x10000 key:0xa55235f3 00:24:30.507 [2024-04-25 03:25:04.864333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:36608 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b00f100 len:0x10000 key:0xa55235f3 00:24:30.507 [2024-04-25 03:25:04.864347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:36736 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3f0000 len:0x10000 key:0x5f355d21 00:24:30.507 [2024-04-25 03:25:04.864360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:36864 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3dff80 len:0x10000 key:0x5f355d21 00:24:30.507 [2024-04-25 03:25:04.864374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:36992 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3cff00 len:0x10000 key:0x5f355d21 00:24:30.507 [2024-04-25 03:25:04.864388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:37120 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3bfe80 len:0x10000 key:0x5f355d21 00:24:30.507 [2024-04-25 03:25:04.864402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:37248 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3afe00 len:0x10000 key:0x5f355d21 00:24:30.507 [2024-04-25 03:25:04.864416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:37376 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b39fd80 len:0x10000 key:0x5f355d21 00:24:30.507 [2024-04-25 03:25:04.864430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:37504 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b38fd00 len:0x10000 key:0x5f355d21 00:24:30.507 [2024-04-25 03:25:04.864444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37632 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b37fc80 len:0x10000 key:0x5f355d21 00:24:30.507 [2024-04-25 03:25:04.864458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:37760 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b36fc00 len:0x10000 key:0x5f355d21 00:24:30.507 [2024-04-25 03:25:04.864474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:37888 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b35fb80 len:0x10000 key:0x5f355d21 00:24:30.507 [2024-04-25 03:25:04.864487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:38016 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b34fb00 len:0x10000 key:0x5f355d21 00:24:30.507 [2024-04-25 03:25:04.864502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:38144 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b33fa80 len:0x10000 key:0x5f355d21 00:24:30.507 [2024-04-25 03:25:04.864516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:38272 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b32fa00 len:0x10000 key:0x5f355d21 00:24:30.507 [2024-04-25 03:25:04.864530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:38400 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b31f980 len:0x10000 key:0x5f355d21 00:24:30.507 [2024-04-25 03:25:04.864543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:38528 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b30f900 len:0x10000 key:0x5f355d21 00:24:30.507 [2024-04-25 03:25:04.864557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:38656 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2ff880 len:0x10000 key:0x5f355d21 00:24:30.507 [2024-04-25 03:25:04.864571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:38784 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2ef800 len:0x10000 key:0x5f355d21 00:24:30.507 [2024-04-25 03:25:04.864585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:38912 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2df780 len:0x10000 key:0x5f355d21 00:24:30.507 [2024-04-25 03:25:04.864599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39040 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2cf700 len:0x10000 key:0x5f355d21 00:24:30.507 [2024-04-25 03:25:04.864613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:39168 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2bf680 len:0x10000 key:0x5f355d21 00:24:30.507 [2024-04-25 03:25:04.864631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:39296 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2af600 len:0x10000 key:0x5f355d21 00:24:30.507 [2024-04-25 03:25:04.864645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39424 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b29f580 len:0x10000 key:0x5f355d21 00:24:30.507 [2024-04-25 03:25:04.864659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:39552 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b28f500 len:0x10000 key:0x5f355d21 00:24:30.507 [2024-04-25 03:25:04.864673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:39680 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b27f480 len:0x10000 key:0x5f355d21 00:24:30.507 [2024-04-25 03:25:04.864687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:39808 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b26f400 len:0x10000 key:0x5f355d21 00:24:30.507 [2024-04-25 03:25:04.864700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.507 [2024-04-25 03:25:04.864708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:39936 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b25f380 len:0x10000 key:0x5f355d21 00:24:30.508 [2024-04-25 03:25:04.864714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.864722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b24f300 len:0x10000 key:0x5f355d21 00:24:30.508 [2024-04-25 03:25:04.864729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.864737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:40192 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b23f280 len:0x10000 key:0x5f355d21 00:24:30.508 [2024-04-25 03:25:04.864743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.864751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:40320 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b22f200 len:0x10000 key:0x5f355d21 00:24:30.508 [2024-04-25 03:25:04.864757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.864766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:40448 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b21f180 len:0x10000 key:0x5f355d21 00:24:30.508 [2024-04-25 03:25:04.864772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.864781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:40576 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b20f100 len:0x10000 key:0x5f355d21 00:24:30.508 [2024-04-25 03:25:04.864787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.864794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:40704 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b5f0000 len:0x10000 key:0x21e1b297 00:24:30.508 [2024-04-25 03:25:04.864801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.864808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:40832 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ae0f700 len:0x10000 key:0xcc87caf4 00:24:30.508 [2024-04-25 03:25:04.864815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2d95d10 sqhd:69c0 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.865095] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20001b8069c0 was disconnected and freed. reset controller. 00:24:30.508 [2024-04-25 03:25:04.865109] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:24:30.508 [2024-04-25 03:25:04.865117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:24576 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b4cfd00 len:0x10000 key:0x21e1b297 00:24:30.508 [2024-04-25 03:25:04.865123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.865133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:24704 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b4bfc80 len:0x10000 key:0x21e1b297 00:24:30.508 [2024-04-25 03:25:04.865140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.865148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:24832 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b4afc00 len:0x10000 key:0x21e1b297 00:24:30.508 [2024-04-25 03:25:04.865155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.865163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:24960 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b49fb80 len:0x10000 key:0x21e1b297 00:24:30.508 [2024-04-25 03:25:04.865170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.865182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:25088 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b48fb00 len:0x10000 key:0x21e1b297 00:24:30.508 [2024-04-25 03:25:04.865189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.865197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:25216 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b47fa80 len:0x10000 key:0x21e1b297 00:24:30.508 [2024-04-25 03:25:04.865203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.865211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25344 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b46fa00 len:0x10000 key:0x21e1b297 00:24:30.508 [2024-04-25 03:25:04.865218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.865228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25472 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b45f980 len:0x10000 key:0x21e1b297 00:24:30.508 [2024-04-25 03:25:04.865234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.865242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:25600 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b44f900 len:0x10000 key:0x21e1b297 00:24:30.508 [2024-04-25 03:25:04.865248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.865256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:25728 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b43f880 len:0x10000 key:0x21e1b297 00:24:30.508 [2024-04-25 03:25:04.865263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.865271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:25856 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b42f800 len:0x10000 key:0x21e1b297 00:24:30.508 [2024-04-25 03:25:04.865277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.865285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:25984 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b41f780 len:0x10000 key:0x21e1b297 00:24:30.508 [2024-04-25 03:25:04.865291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.865298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:26112 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b40f700 len:0x10000 key:0x21e1b297 00:24:30.508 [2024-04-25 03:25:04.865304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.865312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:26240 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7f0000 len:0x10000 key:0x3079f9b3 00:24:30.508 [2024-04-25 03:25:04.865319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.865327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:26368 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7dff80 len:0x10000 key:0x3079f9b3 00:24:30.508 [2024-04-25 03:25:04.865333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.865340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:26496 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7cff00 len:0x10000 key:0x3079f9b3 00:24:30.508 [2024-04-25 03:25:04.865346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.865354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:26624 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7bfe80 len:0x10000 key:0x3079f9b3 00:24:30.508 [2024-04-25 03:25:04.865360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.865368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:26752 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7afe00 len:0x10000 key:0x3079f9b3 00:24:30.508 [2024-04-25 03:25:04.865374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.865382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:26880 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b79fd80 len:0x10000 key:0x3079f9b3 00:24:30.508 [2024-04-25 03:25:04.865389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.865397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:27008 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b78fd00 len:0x10000 key:0x3079f9b3 00:24:30.508 [2024-04-25 03:25:04.865403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.865411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:27136 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b77fc80 len:0x10000 key:0x3079f9b3 00:24:30.508 [2024-04-25 03:25:04.865417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.865426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:27264 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b76fc00 len:0x10000 key:0x3079f9b3 00:24:30.508 [2024-04-25 03:25:04.865432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.865439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:27392 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b75fb80 len:0x10000 key:0x3079f9b3 00:24:30.508 [2024-04-25 03:25:04.865445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.865454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:27520 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b74fb00 len:0x10000 key:0x3079f9b3 00:24:30.508 [2024-04-25 03:25:04.865461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.865468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:27648 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b73fa80 len:0x10000 key:0x3079f9b3 00:24:30.508 [2024-04-25 03:25:04.865475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.865483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:27776 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b72fa00 len:0x10000 key:0x3079f9b3 00:24:30.508 [2024-04-25 03:25:04.865489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.865497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27904 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b71f980 len:0x10000 key:0x3079f9b3 00:24:30.508 [2024-04-25 03:25:04.865503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.508 [2024-04-25 03:25:04.865511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:28032 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b70f900 len:0x10000 key:0x3079f9b3 00:24:30.509 [2024-04-25 03:25:04.865517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:28160 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6ff880 len:0x10000 key:0x3079f9b3 00:24:30.509 [2024-04-25 03:25:04.865531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:28288 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6ef800 len:0x10000 key:0x3079f9b3 00:24:30.509 [2024-04-25 03:25:04.865547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:28416 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6df780 len:0x10000 key:0x3079f9b3 00:24:30.509 [2024-04-25 03:25:04.865561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:28544 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6cf700 len:0x10000 key:0x3079f9b3 00:24:30.509 [2024-04-25 03:25:04.865576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:28672 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6bf680 len:0x10000 key:0x3079f9b3 00:24:30.509 [2024-04-25 03:25:04.865590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:28800 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6af600 len:0x10000 key:0x3079f9b3 00:24:30.509 [2024-04-25 03:25:04.865605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:28928 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b69f580 len:0x10000 key:0x3079f9b3 00:24:30.509 [2024-04-25 03:25:04.865619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:29056 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b68f500 len:0x10000 key:0x3079f9b3 00:24:30.509 [2024-04-25 03:25:04.865633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:29184 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b67f480 len:0x10000 key:0x3079f9b3 00:24:30.509 [2024-04-25 03:25:04.865649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:29312 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b66f400 len:0x10000 key:0x3079f9b3 00:24:30.509 [2024-04-25 03:25:04.865663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:29440 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b65f380 len:0x10000 key:0x3079f9b3 00:24:30.509 [2024-04-25 03:25:04.865678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:29568 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b64f300 len:0x10000 key:0x3079f9b3 00:24:30.509 [2024-04-25 03:25:04.865692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:29696 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b63f280 len:0x10000 key:0x3079f9b3 00:24:30.509 [2024-04-25 03:25:04.865707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:29824 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b62f200 len:0x10000 key:0x3079f9b3 00:24:30.509 [2024-04-25 03:25:04.865721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:29952 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b61f180 len:0x10000 key:0x3079f9b3 00:24:30.509 [2024-04-25 03:25:04.865735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:30080 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b60f100 len:0x10000 key:0x3079f9b3 00:24:30.509 [2024-04-25 03:25:04.865749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:30208 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9f0000 len:0x10000 key:0xf59f3d04 00:24:30.509 [2024-04-25 03:25:04.865764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:30336 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9dff80 len:0x10000 key:0xf59f3d04 00:24:30.509 [2024-04-25 03:25:04.865778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:30464 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9cff00 len:0x10000 key:0xf59f3d04 00:24:30.509 [2024-04-25 03:25:04.865792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:30592 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9bfe80 len:0x10000 key:0xf59f3d04 00:24:30.509 [2024-04-25 03:25:04.865806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:30720 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9afe00 len:0x10000 key:0xf59f3d04 00:24:30.509 [2024-04-25 03:25:04.865821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:30848 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b99fd80 len:0x10000 key:0xf59f3d04 00:24:30.509 [2024-04-25 03:25:04.865834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:30976 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b98fd00 len:0x10000 key:0xf59f3d04 00:24:30.509 [2024-04-25 03:25:04.865848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:31104 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b97fc80 len:0x10000 key:0xf59f3d04 00:24:30.509 [2024-04-25 03:25:04.865873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:31232 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b96fc00 len:0x10000 key:0xf59f3d04 00:24:30.509 [2024-04-25 03:25:04.865887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:31360 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b95fb80 len:0x10000 key:0xf59f3d04 00:24:30.509 [2024-04-25 03:25:04.865901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:31488 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b94fb00 len:0x10000 key:0xf59f3d04 00:24:30.509 [2024-04-25 03:25:04.865916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:31616 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b93fa80 len:0x10000 key:0xf59f3d04 00:24:30.509 [2024-04-25 03:25:04.865931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:31744 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b92fa00 len:0x10000 key:0xf59f3d04 00:24:30.509 [2024-04-25 03:25:04.865945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.865953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:31872 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b91f980 len:0x10000 key:0xf59f3d04 00:24:30.509 [2024-04-25 03:25:04.874272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.874283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:32000 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b90f900 len:0x10000 key:0xf59f3d04 00:24:30.509 [2024-04-25 03:25:04.874290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.874300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:32128 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8ff880 len:0x10000 key:0xf59f3d04 00:24:30.509 [2024-04-25 03:25:04.874306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.874314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:32256 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8ef800 len:0x10000 key:0xf59f3d04 00:24:30.509 [2024-04-25 03:25:04.874320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.874328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32384 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8df780 len:0x10000 key:0xf59f3d04 00:24:30.509 [2024-04-25 03:25:04.874334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.874342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:32512 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8cf700 len:0x10000 key:0xf59f3d04 00:24:30.509 [2024-04-25 03:25:04.874350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.509 [2024-04-25 03:25:04.874358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:32640 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b4dfd80 len:0x10000 key:0x21e1b297 00:24:30.510 [2024-04-25 03:25:04.874364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:14556f0 sqhd:6780 p:0 m:0 dnr:0 00:24:30.510 [2024-04-25 03:25:04.875047] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20001b806780 was disconnected and freed. reset controller. 00:24:30.510 [2024-04-25 03:25:04.875122] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:24:30.510 [2024-04-25 03:25:04.875137] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.510 [2024-04-25 03:25:04.875146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2d50060 sqhd:5380 p:0 m:0 dnr:0 00:24:30.510 [2024-04-25 03:25:04.875157] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.510 [2024-04-25 03:25:04.875165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2d50060 sqhd:5380 p:0 m:0 dnr:0 00:24:30.510 [2024-04-25 03:25:04.875174] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.510 [2024-04-25 03:25:04.875182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2d50060 sqhd:5380 p:0 m:0 dnr:0 00:24:30.510 [2024-04-25 03:25:04.875191] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.510 [2024-04-25 03:25:04.875199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2d50060 sqhd:5380 p:0 m:0 dnr:0 00:24:30.510 [2024-04-25 03:25:04.875363] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:30.510 [2024-04-25 03:25:04.875375] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:24:30.510 [2024-04-25 03:25:04.875389] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:24:30.510 [2024-04-25 03:25:04.875399] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.510 [2024-04-25 03:25:04.875408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1bd8930 sqhd:d080 p:0 m:0 dnr:0 00:24:30.510 [2024-04-25 03:25:04.875417] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.510 [2024-04-25 03:25:04.875425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1bd8930 sqhd:d080 p:0 m:0 dnr:0 00:24:30.510 [2024-04-25 03:25:04.875436] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.510 [2024-04-25 03:25:04.875445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1bd8930 sqhd:d080 p:0 m:0 dnr:0 00:24:30.510 [2024-04-25 03:25:04.875453] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.510 [2024-04-25 03:25:04.875462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1bd8930 sqhd:d080 p:0 m:0 dnr:0 00:24:30.510 [2024-04-25 03:25:04.875594] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:30.510 [2024-04-25 03:25:04.875607] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:30.510 [2024-04-25 03:25:04.875621] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:24:30.510 [2024-04-25 03:25:04.875630] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.510 [2024-04-25 03:25:04.875639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2d50620 sqhd:9c00 p:0 m:0 dnr:0 00:24:30.510 [2024-04-25 03:25:04.875649] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.510 [2024-04-25 03:25:04.875657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2d50620 sqhd:9c00 p:0 m:0 dnr:0 00:24:30.510 [2024-04-25 03:25:04.875666] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.510 [2024-04-25 03:25:04.875675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2d50620 sqhd:9c00 p:0 m:0 dnr:0 00:24:30.510 [2024-04-25 03:25:04.875684] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.510 [2024-04-25 03:25:04.875692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2d50620 sqhd:9c00 p:0 m:0 dnr:0 00:24:30.510 [2024-04-25 03:25:04.875819] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:30.510 [2024-04-25 03:25:04.875829] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:24:30.510 [2024-04-25 03:25:04.875843] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:24:30.510 [2024-04-25 03:25:04.875853] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.510 [2024-04-25 03:25:04.875874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1bd63f0 sqhd:f280 p:0 m:0 dnr:0 00:24:30.510 [2024-04-25 03:25:04.875883] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.510 [2024-04-25 03:25:04.875892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1bd63f0 sqhd:f280 p:0 m:0 dnr:0 00:24:30.510 [2024-04-25 03:25:04.875901] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.510 [2024-04-25 03:25:04.875909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1bd63f0 sqhd:f280 p:0 m:0 dnr:0 00:24:30.510 [2024-04-25 03:25:04.875918] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.510 [2024-04-25 03:25:04.875926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1bd63f0 sqhd:f280 p:0 m:0 dnr:0 00:24:30.510 [2024-04-25 03:25:04.876057] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:30.510 [2024-04-25 03:25:04.876068] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:24:30.510 [2024-04-25 03:25:04.876075] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:30.510 [2024-04-25 03:25:04.876088] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:24:30.510 [2024-04-25 03:25:04.876101] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.510 [2024-04-25 03:25:04.876109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2d50900 sqhd:60c0 p:0 m:0 dnr:0 00:24:30.510 [2024-04-25 03:25:04.876119] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.510 [2024-04-25 03:25:04.876127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2d50900 sqhd:60c0 p:0 m:0 dnr:0 00:24:30.510 [2024-04-25 03:25:04.876136] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.510 [2024-04-25 03:25:04.876146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2d50900 sqhd:60c0 p:0 m:0 dnr:0 00:24:30.510 [2024-04-25 03:25:04.876155] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.510 [2024-04-25 03:25:04.876163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2d50900 sqhd:60c0 p:0 m:0 dnr:0 00:24:30.510 [2024-04-25 03:25:04.876291] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:30.511 [2024-04-25 03:25:04.876302] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:24:30.511 [2024-04-25 03:25:04.876315] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:24:30.511 [2024-04-25 03:25:04.876325] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.511 [2024-04-25 03:25:04.876333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1bd8f10 sqhd:c140 p:0 m:0 dnr:0 00:24:30.511 [2024-04-25 03:25:04.876341] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.511 [2024-04-25 03:25:04.876350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1bd8f10 sqhd:c140 p:0 m:0 dnr:0 00:24:30.511 [2024-04-25 03:25:04.876359] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.511 [2024-04-25 03:25:04.876367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1bd8f10 sqhd:c140 p:0 m:0 dnr:0 00:24:30.511 [2024-04-25 03:25:04.876376] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.511 [2024-04-25 03:25:04.876384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1bd8f10 sqhd:c140 p:0 m:0 dnr:0 00:24:30.511 [2024-04-25 03:25:04.876512] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:30.511 [2024-04-25 03:25:04.876523] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:24:30.511 [2024-04-25 03:25:04.876530] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:30.511 [2024-04-25 03:25:04.876541] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:24:30.511 [2024-04-25 03:25:04.876551] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.511 [2024-04-25 03:25:04.876559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1cd8e20 sqhd:8cc0 p:0 m:0 dnr:0 00:24:30.511 [2024-04-25 03:25:04.876570] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.511 [2024-04-25 03:25:04.876578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1cd8e20 sqhd:8cc0 p:0 m:0 dnr:0 00:24:30.511 [2024-04-25 03:25:04.876587] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.511 [2024-04-25 03:25:04.876595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1cd8e20 sqhd:8cc0 p:0 m:0 dnr:0 00:24:30.511 [2024-04-25 03:25:04.876604] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.511 [2024-04-25 03:25:04.876612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1cd8e20 sqhd:8cc0 p:0 m:0 dnr:0 00:24:30.511 [2024-04-25 03:25:04.876738] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:30.511 [2024-04-25 03:25:04.876748] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:24:30.511 [2024-04-25 03:25:04.876755] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:30.511 [2024-04-25 03:25:04.876767] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:24:30.511 [2024-04-25 03:25:04.876776] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.511 [2024-04-25 03:25:04.876785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1bd2570 sqhd:54c0 p:0 m:0 dnr:0 00:24:30.511 [2024-04-25 03:25:04.876794] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.511 [2024-04-25 03:25:04.876802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1bd2570 sqhd:54c0 p:0 m:0 dnr:0 00:24:30.511 [2024-04-25 03:25:04.876810] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.511 [2024-04-25 03:25:04.876822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1bd2570 sqhd:54c0 p:0 m:0 dnr:0 00:24:30.511 [2024-04-25 03:25:04.876831] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.511 [2024-04-25 03:25:04.876839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1bd2570 sqhd:54c0 p:0 m:0 dnr:0 00:24:30.511 [2024-04-25 03:25:04.876975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:30.511 [2024-04-25 03:25:04.876986] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:24:30.511 [2024-04-25 03:25:04.876993] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:30.511 [2024-04-25 03:25:04.877006] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:24:30.511 [2024-04-25 03:25:04.877016] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.511 [2024-04-25 03:25:04.877024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1bd8d80 sqhd:d440 p:0 m:0 dnr:0 00:24:30.511 [2024-04-25 03:25:04.877033] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.511 [2024-04-25 03:25:04.877044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1bd8d80 sqhd:d440 p:0 m:0 dnr:0 00:24:30.511 [2024-04-25 03:25:04.877053] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.511 [2024-04-25 03:25:04.877061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1bd8d80 sqhd:d440 p:0 m:0 dnr:0 00:24:30.511 [2024-04-25 03:25:04.877070] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.511 [2024-04-25 03:25:04.877078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1bd8d80 sqhd:d440 p:0 m:0 dnr:0 00:24:30.511 [2024-04-25 03:25:04.877206] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:30.511 [2024-04-25 03:25:04.877216] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:24:30.511 [2024-04-25 03:25:04.877223] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:30.511 [2024-04-25 03:25:04.877236] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:24:30.511 [2024-04-25 03:25:04.877244] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.511 [2024-04-25 03:25:04.877252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2d50340 sqhd:a540 p:0 m:0 dnr:0 00:24:30.511 [2024-04-25 03:25:04.877261] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.511 [2024-04-25 03:25:04.877270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2d50340 sqhd:a540 p:0 m:0 dnr:0 00:24:30.511 [2024-04-25 03:25:04.877278] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.511 [2024-04-25 03:25:04.877286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2d50340 sqhd:a540 p:0 m:0 dnr:0 00:24:30.511 [2024-04-25 03:25:04.877295] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:24:30.511 [2024-04-25 03:25:04.877304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2d50340 sqhd:a540 p:0 m:0 dnr:0 00:24:30.511 [2024-04-25 03:25:04.877431] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:30.511 [2024-04-25 03:25:04.877442] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:24:30.511 [2024-04-25 03:25:04.877455] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:24:30.511 [2024-04-25 03:25:04.877651] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256f00 was disconnected and freed. reset controller. 00:24:30.511 [2024-04-25 03:25:04.877662] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:30.511 [2024-04-25 03:25:04.877672] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:24:30.511 [2024-04-25 03:25:04.877873] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256cc0 was disconnected and freed. reset controller. 00:24:30.511 [2024-04-25 03:25:04.877885] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:30.511 [2024-04-25 03:25:04.877895] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:24:30.511 [2024-04-25 03:25:04.878094] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256a80 was disconnected and freed. reset controller. 00:24:30.511 [2024-04-25 03:25:04.878106] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:30.511 [2024-04-25 03:25:04.878115] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:24:30.511 [2024-04-25 03:25:04.878310] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256840 was disconnected and freed. reset controller. 00:24:30.511 [2024-04-25 03:25:04.878321] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:30.511 [2024-04-25 03:25:04.878330] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:24:30.511 [2024-04-25 03:25:04.895070] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256600 was disconnected and freed. reset controller. 00:24:30.511 [2024-04-25 03:25:04.895087] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:30.511 [2024-04-25 03:25:04.896781] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:24:30.511 [2024-04-25 03:25:04.896795] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:24:30.511 [2024-04-25 03:25:04.896803] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:24:30.511 [2024-04-25 03:25:04.896853] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:30.511 [2024-04-25 03:25:04.896870] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:30.511 [2024-04-25 03:25:04.896878] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:30.512 [2024-04-25 03:25:04.896887] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:30.512 [2024-04-25 03:25:04.896896] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:30.512 [2024-04-25 03:25:04.896905] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:30.512 [2024-04-25 03:25:04.896916] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:30.512 [2024-04-25 03:25:04.896964] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:24:30.512 [2024-04-25 03:25:04.896973] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:24:30.512 [2024-04-25 03:25:04.896981] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:30.512 [2024-04-25 03:25:04.896988] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:24:30.512 [2024-04-25 03:25:04.896994] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:24:30.512 [2024-04-25 03:25:04.897001] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:24:30.512 [2024-04-25 03:25:04.897485] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:24:30.512 [2024-04-25 03:25:04.911216] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:24:30.512 [2024-04-25 03:25:04.911235] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:24:30.512 [2024-04-25 03:25:04.911241] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192bd440 00:24:30.512 [2024-04-25 03:25:04.911258] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:24:30.512 [2024-04-25 03:25:04.911265] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:24:30.512 [2024-04-25 03:25:04.911270] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192b54c0 00:24:30.512 [2024-04-25 03:25:04.911281] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:24:30.512 [2024-04-25 03:25:04.911287] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:24:30.512 [2024-04-25 03:25:04.911292] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x20001929c140 00:24:30.512 [2024-04-25 03:25:04.911329] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:24:30.512 [2024-04-25 03:25:04.911336] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:24:30.512 [2024-04-25 03:25:04.911341] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192d9c00 00:24:30.512 [2024-04-25 03:25:04.911353] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:24:30.512 [2024-04-25 03:25:04.911359] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:24:30.512 [2024-04-25 03:25:04.911363] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ba540 00:24:30.512 [2024-04-25 03:25:04.911375] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:24:30.512 [2024-04-25 03:25:04.911382] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:24:30.512 [2024-04-25 03:25:04.911386] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e5380 00:24:30.512 [2024-04-25 03:25:04.911399] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:24:30.512 [2024-04-25 03:25:04.911405] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:24:30.512 [2024-04-25 03:25:04.911410] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:24:30.512 [2024-04-25 03:25:04.911422] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:24:30.512 [2024-04-25 03:25:04.911428] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:24:30.512 [2024-04-25 03:25:04.911433] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x20001928f280 00:24:30.512 [2024-04-25 03:25:04.911445] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:24:30.512 [2024-04-25 03:25:04.911452] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:24:30.512 [2024-04-25 03:25:04.911456] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x200019298cc0 00:24:30.512 [2024-04-25 03:25:04.911670] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:24:30.512 [2024-04-25 03:25:04.911678] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:24:30.512 [2024-04-25 03:25:04.911683] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192c60c0 00:24:31.078 task offset: 32768 on job bdev=Nvme9n1 fails 00:24:31.078 00:24:31.078 Latency(us) 00:24:31.078 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:31.078 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:31.078 Job: Nvme1n1 ended in about 1.92 seconds with error 00:24:31.078 Verification LBA range: start 0x0 length 0x400 00:24:31.078 Nvme1n1 : 1.92 132.99 8.31 33.25 0.00 375920.74 63913.20 1002638.38 00:24:31.078 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:31.078 Job: Nvme2n1 ended in about 1.93 seconds with error 00:24:31.078 Verification LBA range: start 0x0 length 0x400 00:24:31.078 Nvme2n1 : 1.93 132.95 8.31 33.24 0.00 372905.69 57422.02 1002638.38 00:24:31.078 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:31.078 Job: Nvme3n1 ended in about 1.93 seconds with error 00:24:31.078 Verification LBA range: start 0x0 length 0x400 00:24:31.078 Nvme3n1 : 1.93 166.13 10.38 33.23 0.00 308228.84 7801.90 1002638.38 00:24:31.078 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:31.078 Job: Nvme4n1 ended in about 1.93 seconds with error 00:24:31.078 Verification LBA range: start 0x0 length 0x400 00:24:31.078 Nvme4n1 : 1.93 166.08 10.38 33.22 0.00 305715.04 23717.79 1002638.38 00:24:31.078 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:31.078 Job: Nvme5n1 ended in about 1.93 seconds with error 00:24:31.078 Verification LBA range: start 0x0 length 0x400 00:24:31.078 Nvme5n1 : 1.93 158.77 9.92 33.21 0.00 314712.81 36450.50 1002638.38 00:24:31.078 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:31.078 Job: Nvme6n1 ended in about 1.93 seconds with error 00:24:31.078 Verification LBA range: start 0x0 length 0x400 00:24:31.078 Nvme6n1 : 1.93 141.60 8.85 33.20 0.00 342667.07 49183.21 1002638.38 00:24:31.078 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:31.078 Job: Nvme7n1 ended in about 1.93 seconds with error 00:24:31.078 Verification LBA range: start 0x0 length 0x400 00:24:31.078 Nvme7n1 : 1.93 147.78 9.24 33.19 0.00 328123.17 53926.77 1006632.96 00:24:31.078 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:31.078 Job: Nvme8n1 ended in about 1.93 seconds with error 00:24:31.078 Verification LBA range: start 0x0 length 0x400 00:24:31.078 Nvme8n1 : 1.93 139.44 8.71 33.18 0.00 340996.00 56423.38 1006632.96 00:24:31.078 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:31.078 Job: Nvme9n1 ended in about 1.43 seconds with error 00:24:31.078 Verification LBA range: start 0x0 length 0x400 00:24:31.078 Nvme9n1 : 1.43 179.24 11.20 44.81 0.00 257344.66 63663.54 627148.31 00:24:31.078 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:31.078 Job: Nvme10n1 ended in about 1.43 seconds with error 00:24:31.078 Verification LBA range: start 0x0 length 0x400 00:24:31.078 Nvme10n1 : 1.43 134.35 8.40 44.78 0.00 317849.60 63913.20 611170.01 00:24:31.078 =================================================================================================================== 00:24:31.078 Total : 1499.32 93.71 355.28 0.00 325848.77 7801.90 1006632.96 00:24:31.078 [2024-04-25 03:25:05.417620] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:24:31.337 03:25:05 -- target/shutdown.sh@142 -- # kill -9 4183630 00:24:31.337 03:25:05 -- target/shutdown.sh@144 -- # stoptarget 00:24:31.337 03:25:05 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:24:31.337 03:25:05 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:24:31.337 03:25:05 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:31.337 03:25:05 -- target/shutdown.sh@45 -- # nvmftestfini 00:24:31.337 03:25:05 -- nvmf/common.sh@477 -- # nvmfcleanup 00:24:31.337 03:25:05 -- nvmf/common.sh@117 -- # sync 00:24:31.337 03:25:05 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:24:31.337 03:25:05 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:24:31.337 03:25:05 -- nvmf/common.sh@120 -- # set +e 00:24:31.337 03:25:05 -- nvmf/common.sh@121 -- # for i in {1..20} 00:24:31.337 03:25:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:24:31.337 rmmod nvme_rdma 00:24:31.337 rmmod nvme_fabrics 00:24:31.337 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh: line 121: 4183630 Killed $rootdir/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") -q 64 -o 65536 -w verify -t 10 00:24:31.337 03:25:05 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:24:31.337 03:25:05 -- nvmf/common.sh@124 -- # set -e 00:24:31.337 03:25:05 -- nvmf/common.sh@125 -- # return 0 00:24:31.337 03:25:05 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:24:31.337 03:25:05 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:24:31.337 03:25:05 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:24:31.337 00:24:31.337 real 0m4.989s 00:24:31.337 user 0m17.093s 00:24:31.337 sys 0m1.176s 00:24:31.337 03:25:05 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:24:31.337 03:25:05 -- common/autotest_common.sh@10 -- # set +x 00:24:31.337 ************************************ 00:24:31.337 END TEST nvmf_shutdown_tc3 00:24:31.337 ************************************ 00:24:31.337 03:25:05 -- target/shutdown.sh@151 -- # trap - SIGINT SIGTERM EXIT 00:24:31.337 00:24:31.337 real 0m23.221s 00:24:31.337 user 1m9.117s 00:24:31.337 sys 0m8.158s 00:24:31.337 03:25:05 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:24:31.337 03:25:05 -- common/autotest_common.sh@10 -- # set +x 00:24:31.337 ************************************ 00:24:31.337 END TEST nvmf_shutdown 00:24:31.337 ************************************ 00:24:31.337 03:25:05 -- nvmf/nvmf.sh@84 -- # timing_exit target 00:24:31.337 03:25:05 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:31.337 03:25:05 -- common/autotest_common.sh@10 -- # set +x 00:24:31.596 03:25:05 -- nvmf/nvmf.sh@86 -- # timing_enter host 00:24:31.596 03:25:05 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:31.596 03:25:05 -- common/autotest_common.sh@10 -- # set +x 00:24:31.596 03:25:05 -- nvmf/nvmf.sh@88 -- # [[ 0 -eq 0 ]] 00:24:31.596 03:25:05 -- nvmf/nvmf.sh@89 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=rdma 00:24:31.596 03:25:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:31.596 03:25:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:31.596 03:25:05 -- common/autotest_common.sh@10 -- # set +x 00:24:31.596 ************************************ 00:24:31.596 START TEST nvmf_multicontroller 00:24:31.596 ************************************ 00:24:31.596 03:25:05 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=rdma 00:24:31.596 * Looking for test storage... 00:24:31.596 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host 00:24:31.596 03:25:06 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:24:31.596 03:25:06 -- nvmf/common.sh@7 -- # uname -s 00:24:31.596 03:25:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:31.596 03:25:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:31.596 03:25:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:31.596 03:25:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:31.596 03:25:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:31.596 03:25:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:31.596 03:25:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:31.596 03:25:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:31.596 03:25:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:31.596 03:25:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:31.596 03:25:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:24:31.596 03:25:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:24:31.596 03:25:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:31.596 03:25:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:31.596 03:25:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:31.596 03:25:06 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:24:31.596 03:25:06 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:24:31.596 03:25:06 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:31.596 03:25:06 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:31.596 03:25:06 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:31.596 03:25:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:31.596 03:25:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:31.596 03:25:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:31.596 03:25:06 -- paths/export.sh@5 -- # export PATH 00:24:31.596 03:25:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:31.596 03:25:06 -- nvmf/common.sh@47 -- # : 0 00:24:31.596 03:25:06 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:24:31.596 03:25:06 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:24:31.596 03:25:06 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:24:31.596 03:25:06 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:31.596 03:25:06 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:31.596 03:25:06 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:24:31.596 03:25:06 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:24:31.596 03:25:06 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:24:31.855 03:25:06 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:24:31.855 03:25:06 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:24:31.855 03:25:06 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:24:31.855 03:25:06 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:24:31.855 03:25:06 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:24:31.855 03:25:06 -- host/multicontroller.sh@18 -- # '[' rdma == rdma ']' 00:24:31.855 03:25:06 -- host/multicontroller.sh@19 -- # echo 'Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target.' 00:24:31.855 Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target. 00:24:31.855 03:25:06 -- host/multicontroller.sh@20 -- # exit 0 00:24:31.855 00:24:31.855 real 0m0.110s 00:24:31.855 user 0m0.059s 00:24:31.855 sys 0m0.057s 00:24:31.855 03:25:06 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:24:31.855 03:25:06 -- common/autotest_common.sh@10 -- # set +x 00:24:31.855 ************************************ 00:24:31.855 END TEST nvmf_multicontroller 00:24:31.855 ************************************ 00:24:31.855 03:25:06 -- nvmf/nvmf.sh@90 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=rdma 00:24:31.855 03:25:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:31.855 03:25:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:31.855 03:25:06 -- common/autotest_common.sh@10 -- # set +x 00:24:31.855 ************************************ 00:24:31.855 START TEST nvmf_aer 00:24:31.855 ************************************ 00:24:31.856 03:25:06 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=rdma 00:24:31.856 * Looking for test storage... 00:24:31.856 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host 00:24:31.856 03:25:06 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:24:31.856 03:25:06 -- nvmf/common.sh@7 -- # uname -s 00:24:31.856 03:25:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:31.856 03:25:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:31.856 03:25:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:31.856 03:25:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:31.856 03:25:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:31.856 03:25:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:31.856 03:25:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:31.856 03:25:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:31.856 03:25:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:31.856 03:25:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:31.856 03:25:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:24:31.856 03:25:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:24:31.856 03:25:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:31.856 03:25:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:31.856 03:25:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:31.856 03:25:06 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:24:31.856 03:25:06 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:24:31.856 03:25:06 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:31.856 03:25:06 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:31.856 03:25:06 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:31.856 03:25:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:31.856 03:25:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:31.856 03:25:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:31.856 03:25:06 -- paths/export.sh@5 -- # export PATH 00:24:31.856 03:25:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:31.856 03:25:06 -- nvmf/common.sh@47 -- # : 0 00:24:31.856 03:25:06 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:24:31.856 03:25:06 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:24:31.856 03:25:06 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:24:31.856 03:25:06 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:31.856 03:25:06 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:31.856 03:25:06 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:24:31.856 03:25:06 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:24:31.856 03:25:06 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:24:31.856 03:25:06 -- host/aer.sh@11 -- # nvmftestinit 00:24:31.856 03:25:06 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:24:31.856 03:25:06 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:31.856 03:25:06 -- nvmf/common.sh@437 -- # prepare_net_devs 00:24:31.856 03:25:06 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:24:31.856 03:25:06 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:24:31.856 03:25:06 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:31.856 03:25:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:31.856 03:25:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:32.114 03:25:06 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:24:32.114 03:25:06 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:24:32.114 03:25:06 -- nvmf/common.sh@285 -- # xtrace_disable 00:24:32.114 03:25:06 -- common/autotest_common.sh@10 -- # set +x 00:24:38.740 03:25:12 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:38.740 03:25:12 -- nvmf/common.sh@291 -- # pci_devs=() 00:24:38.740 03:25:12 -- nvmf/common.sh@291 -- # local -a pci_devs 00:24:38.740 03:25:12 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:24:38.740 03:25:12 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:24:38.740 03:25:12 -- nvmf/common.sh@293 -- # pci_drivers=() 00:24:38.740 03:25:12 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:24:38.740 03:25:12 -- nvmf/common.sh@295 -- # net_devs=() 00:24:38.740 03:25:12 -- nvmf/common.sh@295 -- # local -ga net_devs 00:24:38.740 03:25:12 -- nvmf/common.sh@296 -- # e810=() 00:24:38.740 03:25:12 -- nvmf/common.sh@296 -- # local -ga e810 00:24:38.740 03:25:12 -- nvmf/common.sh@297 -- # x722=() 00:24:38.740 03:25:12 -- nvmf/common.sh@297 -- # local -ga x722 00:24:38.740 03:25:12 -- nvmf/common.sh@298 -- # mlx=() 00:24:38.740 03:25:12 -- nvmf/common.sh@298 -- # local -ga mlx 00:24:38.740 03:25:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:38.740 03:25:12 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:38.740 03:25:12 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:38.740 03:25:12 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:38.740 03:25:12 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:38.740 03:25:12 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:38.741 03:25:12 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:38.741 03:25:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:38.741 03:25:12 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:38.741 03:25:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:38.741 03:25:12 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:38.741 03:25:12 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:24:38.741 03:25:12 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:24:38.741 03:25:12 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:24:38.741 03:25:12 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:24:38.741 03:25:12 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:24:38.741 03:25:12 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:24:38.741 03:25:12 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:24:38.741 03:25:12 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:24:38.741 03:25:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:38.741 03:25:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:24:38.741 Found 0000:af:00.0 (0x8086 - 0x159b) 00:24:38.741 03:25:12 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:24:38.741 03:25:12 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:24:38.741 03:25:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:38.741 03:25:12 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:38.741 03:25:12 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:24:38.741 03:25:12 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:24:38.741 03:25:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:38.741 03:25:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:24:38.741 Found 0000:af:00.1 (0x8086 - 0x159b) 00:24:38.741 03:25:12 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:24:38.741 03:25:12 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:24:38.741 03:25:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:38.741 03:25:12 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:38.741 03:25:12 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:24:38.741 03:25:12 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:24:38.741 03:25:12 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:24:38.741 03:25:12 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:24:38.741 03:25:12 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:24:38.741 03:25:12 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:24:38.741 03:25:12 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:24:38.741 03:25:12 -- nvmf/common.sh@377 -- # modinfo irdma 00:24:38.741 03:25:12 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:24:38.741 03:25:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:38.741 03:25:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:38.741 03:25:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:38.741 03:25:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:38.741 03:25:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:24:38.741 Found net devices under 0000:af:00.0: cvl_0_0 00:24:38.741 03:25:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:38.741 03:25:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:38.741 03:25:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:38.741 03:25:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:38.741 03:25:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:38.741 03:25:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:24:38.741 Found net devices under 0000:af:00.1: cvl_0_1 00:24:38.741 03:25:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:38.741 03:25:12 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:24:38.741 03:25:12 -- nvmf/common.sh@403 -- # is_hw=yes 00:24:38.741 03:25:12 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:24:38.741 03:25:12 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:24:38.741 03:25:12 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:24:38.741 03:25:12 -- nvmf/common.sh@409 -- # rdma_device_init 00:24:38.741 03:25:12 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:24:38.741 03:25:12 -- nvmf/common.sh@58 -- # uname 00:24:38.741 03:25:12 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:24:38.741 03:25:12 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:24:38.741 03:25:12 -- nvmf/common.sh@63 -- # modprobe ib_core 00:24:38.741 03:25:12 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:24:38.741 03:25:12 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:24:38.741 03:25:12 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:24:38.741 03:25:12 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:24:38.741 03:25:12 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:24:38.741 03:25:12 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:24:38.741 03:25:12 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:24:38.741 03:25:12 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:24:38.741 03:25:12 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:24:38.741 03:25:12 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:24:38.741 03:25:12 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:24:38.741 03:25:12 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:24:38.741 03:25:12 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:24:38.741 03:25:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:38.741 03:25:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:38.741 03:25:12 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:24:38.741 03:25:12 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:24:38.741 03:25:12 -- nvmf/common.sh@105 -- # continue 2 00:24:38.741 03:25:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:38.741 03:25:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:38.741 03:25:12 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:24:38.741 03:25:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:38.741 03:25:12 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:24:38.741 03:25:12 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:24:38.741 03:25:12 -- nvmf/common.sh@105 -- # continue 2 00:24:38.741 03:25:12 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:24:38.741 03:25:12 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:24:38.741 03:25:12 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:24:38.741 03:25:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:24:38.741 03:25:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:38.741 03:25:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:38.741 03:25:12 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:24:38.741 03:25:12 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:24:38.741 03:25:12 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:24:38.741 50: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:24:38.741 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:24:38.741 altname enp175s0f0np0 00:24:38.741 altname ens801f0np0 00:24:38.741 inet 192.168.100.8/24 scope global cvl_0_0 00:24:38.741 valid_lft forever preferred_lft forever 00:24:38.741 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:24:38.741 valid_lft forever preferred_lft forever 00:24:38.741 03:25:12 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:24:38.741 03:25:12 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:24:38.741 03:25:12 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:24:38.741 03:25:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:24:38.741 03:25:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:38.741 03:25:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:38.741 03:25:12 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:24:38.741 03:25:12 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:24:38.741 03:25:12 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:24:38.741 51: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:24:38.741 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:24:38.741 altname enp175s0f1np1 00:24:38.741 altname ens801f1np1 00:24:38.741 inet 192.168.100.9/24 scope global cvl_0_1 00:24:38.741 valid_lft forever preferred_lft forever 00:24:38.741 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:24:38.741 valid_lft forever preferred_lft forever 00:24:38.741 03:25:12 -- nvmf/common.sh@411 -- # return 0 00:24:38.741 03:25:12 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:24:38.741 03:25:12 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:24:38.741 03:25:12 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:24:38.741 03:25:12 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:24:38.741 03:25:12 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:24:38.741 03:25:12 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:24:38.741 03:25:12 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:24:38.741 03:25:12 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:24:38.741 03:25:12 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:24:38.741 03:25:12 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:24:38.741 03:25:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:38.741 03:25:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:38.741 03:25:12 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:24:38.741 03:25:12 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:24:38.741 03:25:12 -- nvmf/common.sh@105 -- # continue 2 00:24:38.741 03:25:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:38.741 03:25:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:38.741 03:25:12 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:24:38.741 03:25:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:38.741 03:25:12 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:24:38.741 03:25:12 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:24:38.741 03:25:12 -- nvmf/common.sh@105 -- # continue 2 00:24:38.741 03:25:12 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:24:38.741 03:25:12 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:24:38.741 03:25:12 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:24:38.741 03:25:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:24:38.741 03:25:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:38.741 03:25:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:38.741 03:25:12 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:24:38.741 03:25:12 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:24:38.741 03:25:12 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:24:38.741 03:25:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:24:38.741 03:25:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:38.741 03:25:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:38.741 03:25:12 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:24:38.741 192.168.100.9' 00:24:38.741 03:25:12 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:24:38.741 192.168.100.9' 00:24:38.741 03:25:12 -- nvmf/common.sh@446 -- # head -n 1 00:24:38.742 03:25:12 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:24:38.742 03:25:12 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:24:38.742 192.168.100.9' 00:24:38.742 03:25:12 -- nvmf/common.sh@447 -- # tail -n +2 00:24:38.742 03:25:12 -- nvmf/common.sh@447 -- # head -n 1 00:24:38.742 03:25:12 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:24:38.742 03:25:12 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:24:38.742 03:25:12 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:24:38.742 03:25:12 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:24:38.742 03:25:12 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:24:38.742 03:25:12 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:24:38.742 03:25:12 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:24:38.742 03:25:12 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:24:38.742 03:25:12 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:38.742 03:25:12 -- common/autotest_common.sh@10 -- # set +x 00:24:38.742 03:25:12 -- nvmf/common.sh@470 -- # nvmfpid=4187758 00:24:38.742 03:25:12 -- nvmf/common.sh@471 -- # waitforlisten 4187758 00:24:38.742 03:25:12 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:24:38.742 03:25:12 -- common/autotest_common.sh@817 -- # '[' -z 4187758 ']' 00:24:38.742 03:25:12 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:38.742 03:25:12 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:38.742 03:25:12 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:38.742 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:38.742 03:25:12 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:38.742 03:25:12 -- common/autotest_common.sh@10 -- # set +x 00:24:38.742 [2024-04-25 03:25:12.503924] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:24:38.742 [2024-04-25 03:25:12.503967] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:38.742 EAL: No free 2048 kB hugepages reported on node 1 00:24:38.742 [2024-04-25 03:25:12.558887] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:38.742 [2024-04-25 03:25:12.629530] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:38.742 [2024-04-25 03:25:12.629571] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:38.742 [2024-04-25 03:25:12.629577] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:24:38.742 [2024-04-25 03:25:12.629582] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:24:38.742 [2024-04-25 03:25:12.629587] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:38.742 [2024-04-25 03:25:12.629661] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:38.742 [2024-04-25 03:25:12.629753] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:38.742 [2024-04-25 03:25:12.629843] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:38.742 [2024-04-25 03:25:12.629845] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:39.000 03:25:13 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:39.000 03:25:13 -- common/autotest_common.sh@850 -- # return 0 00:24:39.000 03:25:13 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:24:39.000 03:25:13 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:39.000 03:25:13 -- common/autotest_common.sh@10 -- # set +x 00:24:39.000 03:25:13 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:39.000 03:25:13 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:24:39.000 03:25:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:39.000 03:25:13 -- common/autotest_common.sh@10 -- # set +x 00:24:39.000 [2024-04-25 03:25:13.360451] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x18a2ea0/0x18a24e0) succeed. 00:24:39.001 [2024-04-25 03:25:13.370565] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x18a4210/0x18a2a60) succeed. 00:24:39.001 [2024-04-25 03:25:13.370586] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:24:39.001 03:25:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:39.001 03:25:13 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:24:39.001 03:25:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:39.001 03:25:13 -- common/autotest_common.sh@10 -- # set +x 00:24:39.001 Malloc0 00:24:39.001 03:25:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:39.001 03:25:13 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:24:39.001 03:25:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:39.001 03:25:13 -- common/autotest_common.sh@10 -- # set +x 00:24:39.001 03:25:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:39.001 03:25:13 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:24:39.001 03:25:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:39.001 03:25:13 -- common/autotest_common.sh@10 -- # set +x 00:24:39.001 03:25:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:39.001 03:25:13 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:24:39.001 03:25:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:39.001 03:25:13 -- common/autotest_common.sh@10 -- # set +x 00:24:39.001 [2024-04-25 03:25:13.425631] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:24:39.001 03:25:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:39.001 03:25:13 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:24:39.001 03:25:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:39.001 03:25:13 -- common/autotest_common.sh@10 -- # set +x 00:24:39.001 [2024-04-25 03:25:13.433528] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:24:39.001 [ 00:24:39.001 { 00:24:39.001 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:24:39.001 "subtype": "Discovery", 00:24:39.001 "listen_addresses": [], 00:24:39.001 "allow_any_host": true, 00:24:39.001 "hosts": [] 00:24:39.001 }, 00:24:39.001 { 00:24:39.001 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:24:39.001 "subtype": "NVMe", 00:24:39.001 "listen_addresses": [ 00:24:39.001 { 00:24:39.001 "transport": "RDMA", 00:24:39.001 "trtype": "RDMA", 00:24:39.001 "adrfam": "IPv4", 00:24:39.001 "traddr": "192.168.100.8", 00:24:39.001 "trsvcid": "4420" 00:24:39.001 } 00:24:39.001 ], 00:24:39.001 "allow_any_host": true, 00:24:39.001 "hosts": [], 00:24:39.001 "serial_number": "SPDK00000000000001", 00:24:39.001 "model_number": "SPDK bdev Controller", 00:24:39.001 "max_namespaces": 2, 00:24:39.001 "min_cntlid": 1, 00:24:39.001 "max_cntlid": 65519, 00:24:39.001 "namespaces": [ 00:24:39.001 { 00:24:39.001 "nsid": 1, 00:24:39.001 "bdev_name": "Malloc0", 00:24:39.001 "name": "Malloc0", 00:24:39.001 "nguid": "C19B6CE0E8FF41709E06D5B6DEDF6D25", 00:24:39.001 "uuid": "c19b6ce0-e8ff-4170-9e06-d5b6dedf6d25" 00:24:39.001 } 00:24:39.001 ] 00:24:39.001 } 00:24:39.001 ] 00:24:39.001 03:25:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:39.001 03:25:13 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:24:39.001 03:25:13 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:24:39.001 03:25:13 -- host/aer.sh@33 -- # aerpid=4187905 00:24:39.001 03:25:13 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:24:39.001 03:25:13 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:24:39.001 03:25:13 -- common/autotest_common.sh@1251 -- # local i=0 00:24:39.001 03:25:13 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:24:39.001 03:25:13 -- common/autotest_common.sh@1253 -- # '[' 0 -lt 200 ']' 00:24:39.001 03:25:13 -- common/autotest_common.sh@1254 -- # i=1 00:24:39.001 03:25:13 -- common/autotest_common.sh@1255 -- # sleep 0.1 00:24:39.001 EAL: No free 2048 kB hugepages reported on node 1 00:24:39.260 03:25:13 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:24:39.260 03:25:13 -- common/autotest_common.sh@1253 -- # '[' 1 -lt 200 ']' 00:24:39.260 03:25:13 -- common/autotest_common.sh@1254 -- # i=2 00:24:39.260 03:25:13 -- common/autotest_common.sh@1255 -- # sleep 0.1 00:24:39.260 03:25:13 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:24:39.260 03:25:13 -- common/autotest_common.sh@1258 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:24:39.260 03:25:13 -- common/autotest_common.sh@1262 -- # return 0 00:24:39.260 03:25:13 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:24:39.260 03:25:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:39.260 03:25:13 -- common/autotest_common.sh@10 -- # set +x 00:24:39.260 Malloc1 00:24:39.260 03:25:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:39.260 03:25:13 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:24:39.260 03:25:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:39.260 03:25:13 -- common/autotest_common.sh@10 -- # set +x 00:24:39.260 03:25:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:39.260 03:25:13 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:24:39.260 03:25:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:39.260 03:25:13 -- common/autotest_common.sh@10 -- # set +x 00:24:39.260 [ 00:24:39.260 { 00:24:39.260 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:24:39.260 "subtype": "Discovery", 00:24:39.260 "listen_addresses": [], 00:24:39.260 "allow_any_host": true, 00:24:39.260 "hosts": [] 00:24:39.260 }, 00:24:39.260 { 00:24:39.260 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:24:39.260 "subtype": "NVMe", 00:24:39.260 "listen_addresses": [ 00:24:39.260 { 00:24:39.260 "transport": "RDMA", 00:24:39.260 "trtype": "RDMA", 00:24:39.260 "adrfam": "IPv4", 00:24:39.260 "traddr": "192.168.100.8", 00:24:39.260 "trsvcid": "4420" 00:24:39.260 } 00:24:39.260 ], 00:24:39.260 "allow_any_host": true, 00:24:39.260 "hosts": [], 00:24:39.260 "serial_number": "SPDK00000000000001", 00:24:39.260 "model_number": "SPDK bdev Controller", 00:24:39.260 "max_namespaces": 2, 00:24:39.260 "min_cntlid": 1, 00:24:39.260 "max_cntlid": 65519, 00:24:39.260 "namespaces": [ 00:24:39.260 { 00:24:39.260 "nsid": 1, 00:24:39.260 "bdev_name": "Malloc0", 00:24:39.260 "name": "Malloc0", 00:24:39.260 "nguid": "C19B6CE0E8FF41709E06D5B6DEDF6D25", 00:24:39.260 "uuid": "c19b6ce0-e8ff-4170-9e06-d5b6dedf6d25" 00:24:39.260 }, 00:24:39.260 { 00:24:39.260 "nsid": 2, 00:24:39.260 "bdev_name": "Malloc1", 00:24:39.260 "name": "Malloc1", 00:24:39.260 "nguid": "8720D5B9EB6B498D82199D613EDB8471", 00:24:39.260 "uuid": "8720d5b9-eb6b-498d-8219-9d613edb8471" 00:24:39.260 } 00:24:39.260 ] 00:24:39.260 } 00:24:39.260 ] 00:24:39.260 03:25:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:39.260 03:25:13 -- host/aer.sh@43 -- # wait 4187905 00:24:39.260 Asynchronous Event Request test 00:24:39.260 Attaching to 192.168.100.8 00:24:39.260 Attached to 192.168.100.8 00:24:39.260 Registering asynchronous event callbacks... 00:24:39.260 Starting namespace attribute notice tests for all controllers... 00:24:39.260 192.168.100.8: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:24:39.260 aer_cb - Changed Namespace 00:24:39.260 Cleaning up... 00:24:39.260 03:25:13 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:24:39.260 03:25:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:39.260 03:25:13 -- common/autotest_common.sh@10 -- # set +x 00:24:39.519 03:25:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:39.519 03:25:13 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:24:39.519 03:25:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:39.519 03:25:13 -- common/autotest_common.sh@10 -- # set +x 00:24:39.519 03:25:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:39.519 03:25:13 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:39.519 03:25:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:39.519 03:25:13 -- common/autotest_common.sh@10 -- # set +x 00:24:39.519 03:25:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:39.519 03:25:13 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:24:39.519 03:25:13 -- host/aer.sh@51 -- # nvmftestfini 00:24:39.519 03:25:13 -- nvmf/common.sh@477 -- # nvmfcleanup 00:24:39.519 03:25:13 -- nvmf/common.sh@117 -- # sync 00:24:39.519 03:25:13 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:24:39.519 03:25:13 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:24:39.519 03:25:13 -- nvmf/common.sh@120 -- # set +e 00:24:39.519 03:25:13 -- nvmf/common.sh@121 -- # for i in {1..20} 00:24:39.519 03:25:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:24:39.519 rmmod nvme_rdma 00:24:39.519 rmmod nvme_fabrics 00:24:39.519 03:25:13 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:24:39.519 03:25:13 -- nvmf/common.sh@124 -- # set -e 00:24:39.519 03:25:13 -- nvmf/common.sh@125 -- # return 0 00:24:39.519 03:25:13 -- nvmf/common.sh@478 -- # '[' -n 4187758 ']' 00:24:39.519 03:25:13 -- nvmf/common.sh@479 -- # killprocess 4187758 00:24:39.519 03:25:13 -- common/autotest_common.sh@936 -- # '[' -z 4187758 ']' 00:24:39.519 03:25:13 -- common/autotest_common.sh@940 -- # kill -0 4187758 00:24:39.519 03:25:13 -- common/autotest_common.sh@941 -- # uname 00:24:39.519 03:25:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:39.519 03:25:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4187758 00:24:39.519 03:25:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:39.519 03:25:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:39.519 03:25:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4187758' 00:24:39.519 killing process with pid 4187758 00:24:39.519 03:25:13 -- common/autotest_common.sh@955 -- # kill 4187758 00:24:39.519 [2024-04-25 03:25:13.893631] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:24:39.519 03:25:13 -- common/autotest_common.sh@960 -- # wait 4187758 00:24:39.519 [2024-04-25 03:25:13.928173] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:24:39.778 03:25:14 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:24:39.778 03:25:14 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:24:39.778 00:24:39.778 real 0m7.891s 00:24:39.778 user 0m7.616s 00:24:39.778 sys 0m5.041s 00:24:39.778 03:25:14 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:24:39.778 03:25:14 -- common/autotest_common.sh@10 -- # set +x 00:24:39.778 ************************************ 00:24:39.778 END TEST nvmf_aer 00:24:39.778 ************************************ 00:24:39.778 03:25:14 -- nvmf/nvmf.sh@91 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=rdma 00:24:39.778 03:25:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:39.778 03:25:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:39.778 03:25:14 -- common/autotest_common.sh@10 -- # set +x 00:24:40.037 ************************************ 00:24:40.037 START TEST nvmf_async_init 00:24:40.037 ************************************ 00:24:40.037 03:25:14 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=rdma 00:24:40.037 * Looking for test storage... 00:24:40.037 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host 00:24:40.037 03:25:14 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:24:40.037 03:25:14 -- nvmf/common.sh@7 -- # uname -s 00:24:40.037 03:25:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:40.037 03:25:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:40.037 03:25:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:40.037 03:25:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:40.037 03:25:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:40.037 03:25:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:40.037 03:25:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:40.037 03:25:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:40.037 03:25:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:40.037 03:25:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:40.037 03:25:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:24:40.037 03:25:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:24:40.037 03:25:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:40.037 03:25:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:40.037 03:25:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:40.037 03:25:14 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:24:40.037 03:25:14 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:24:40.037 03:25:14 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:40.037 03:25:14 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:40.037 03:25:14 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:40.037 03:25:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:40.037 03:25:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:40.037 03:25:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:40.037 03:25:14 -- paths/export.sh@5 -- # export PATH 00:24:40.038 03:25:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:40.038 03:25:14 -- nvmf/common.sh@47 -- # : 0 00:24:40.038 03:25:14 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:24:40.038 03:25:14 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:24:40.038 03:25:14 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:24:40.038 03:25:14 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:40.038 03:25:14 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:40.038 03:25:14 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:24:40.038 03:25:14 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:24:40.038 03:25:14 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:24:40.038 03:25:14 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:24:40.038 03:25:14 -- host/async_init.sh@14 -- # null_block_size=512 00:24:40.038 03:25:14 -- host/async_init.sh@15 -- # null_bdev=null0 00:24:40.038 03:25:14 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:24:40.038 03:25:14 -- host/async_init.sh@20 -- # uuidgen 00:24:40.038 03:25:14 -- host/async_init.sh@20 -- # tr -d - 00:24:40.038 03:25:14 -- host/async_init.sh@20 -- # nguid=d9d120c116d64b45999b98f0c54f3d86 00:24:40.038 03:25:14 -- host/async_init.sh@22 -- # nvmftestinit 00:24:40.038 03:25:14 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:24:40.038 03:25:14 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:40.038 03:25:14 -- nvmf/common.sh@437 -- # prepare_net_devs 00:24:40.038 03:25:14 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:24:40.038 03:25:14 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:24:40.038 03:25:14 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:40.038 03:25:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:40.038 03:25:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:40.038 03:25:14 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:24:40.038 03:25:14 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:24:40.038 03:25:14 -- nvmf/common.sh@285 -- # xtrace_disable 00:24:40.038 03:25:14 -- common/autotest_common.sh@10 -- # set +x 00:24:46.599 03:25:20 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:46.599 03:25:20 -- nvmf/common.sh@291 -- # pci_devs=() 00:24:46.599 03:25:20 -- nvmf/common.sh@291 -- # local -a pci_devs 00:24:46.599 03:25:20 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:24:46.599 03:25:20 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:24:46.599 03:25:20 -- nvmf/common.sh@293 -- # pci_drivers=() 00:24:46.599 03:25:20 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:24:46.599 03:25:20 -- nvmf/common.sh@295 -- # net_devs=() 00:24:46.599 03:25:20 -- nvmf/common.sh@295 -- # local -ga net_devs 00:24:46.599 03:25:20 -- nvmf/common.sh@296 -- # e810=() 00:24:46.599 03:25:20 -- nvmf/common.sh@296 -- # local -ga e810 00:24:46.599 03:25:20 -- nvmf/common.sh@297 -- # x722=() 00:24:46.599 03:25:20 -- nvmf/common.sh@297 -- # local -ga x722 00:24:46.599 03:25:20 -- nvmf/common.sh@298 -- # mlx=() 00:24:46.599 03:25:20 -- nvmf/common.sh@298 -- # local -ga mlx 00:24:46.599 03:25:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:46.599 03:25:20 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:46.599 03:25:20 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:46.599 03:25:20 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:46.599 03:25:20 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:46.599 03:25:20 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:46.599 03:25:20 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:46.599 03:25:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:46.599 03:25:20 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:46.599 03:25:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:46.599 03:25:20 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:46.599 03:25:20 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:24:46.599 03:25:20 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:24:46.599 03:25:20 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:24:46.599 03:25:20 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:24:46.599 03:25:20 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:24:46.599 03:25:20 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:24:46.599 03:25:20 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:24:46.599 03:25:20 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:24:46.599 03:25:20 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:46.599 03:25:20 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:24:46.599 Found 0000:af:00.0 (0x8086 - 0x159b) 00:24:46.599 03:25:20 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:24:46.599 03:25:20 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:24:46.599 03:25:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:46.599 03:25:20 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:46.599 03:25:20 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:24:46.599 03:25:20 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:24:46.599 03:25:20 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:46.599 03:25:20 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:24:46.599 Found 0000:af:00.1 (0x8086 - 0x159b) 00:24:46.599 03:25:20 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:24:46.599 03:25:20 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:24:46.599 03:25:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:46.599 03:25:20 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:46.599 03:25:20 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:24:46.599 03:25:20 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:24:46.599 03:25:20 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:24:46.599 03:25:20 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:24:46.599 03:25:20 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:24:46.599 03:25:20 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:24:46.599 03:25:20 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:24:46.599 03:25:20 -- nvmf/common.sh@377 -- # modinfo irdma 00:24:46.599 03:25:20 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:24:46.599 03:25:20 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:46.599 03:25:20 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:46.599 03:25:20 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:46.599 03:25:20 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:46.599 03:25:20 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:24:46.599 Found net devices under 0000:af:00.0: cvl_0_0 00:24:46.599 03:25:20 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:46.599 03:25:20 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:46.599 03:25:20 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:46.599 03:25:20 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:46.599 03:25:20 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:46.599 03:25:20 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:24:46.599 Found net devices under 0000:af:00.1: cvl_0_1 00:24:46.599 03:25:20 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:46.599 03:25:20 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:24:46.599 03:25:20 -- nvmf/common.sh@403 -- # is_hw=yes 00:24:46.600 03:25:20 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:24:46.600 03:25:20 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:24:46.600 03:25:20 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:24:46.600 03:25:20 -- nvmf/common.sh@409 -- # rdma_device_init 00:24:46.600 03:25:20 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:24:46.600 03:25:20 -- nvmf/common.sh@58 -- # uname 00:24:46.600 03:25:20 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:24:46.600 03:25:20 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:24:46.600 03:25:20 -- nvmf/common.sh@63 -- # modprobe ib_core 00:24:46.600 03:25:20 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:24:46.600 03:25:20 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:24:46.600 03:25:20 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:24:46.600 03:25:20 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:24:46.600 03:25:20 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:24:46.600 03:25:20 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:24:46.600 03:25:20 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:24:46.600 03:25:20 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:24:46.600 03:25:20 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:24:46.600 03:25:20 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:24:46.600 03:25:20 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:24:46.600 03:25:20 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:24:46.600 03:25:20 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:24:46.600 03:25:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:46.600 03:25:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:46.600 03:25:20 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:24:46.600 03:25:20 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:24:46.600 03:25:20 -- nvmf/common.sh@105 -- # continue 2 00:24:46.600 03:25:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:46.600 03:25:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:46.600 03:25:20 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:24:46.600 03:25:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:46.600 03:25:20 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:24:46.600 03:25:20 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:24:46.600 03:25:20 -- nvmf/common.sh@105 -- # continue 2 00:24:46.600 03:25:20 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:24:46.600 03:25:20 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:24:46.600 03:25:20 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:24:46.600 03:25:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:24:46.600 03:25:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:46.600 03:25:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:46.600 03:25:20 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:24:46.600 03:25:20 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:24:46.600 03:25:20 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:24:46.600 50: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:24:46.600 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:24:46.600 altname enp175s0f0np0 00:24:46.600 altname ens801f0np0 00:24:46.600 inet 192.168.100.8/24 scope global cvl_0_0 00:24:46.600 valid_lft forever preferred_lft forever 00:24:46.600 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:24:46.600 valid_lft forever preferred_lft forever 00:24:46.600 03:25:20 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:24:46.600 03:25:20 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:24:46.600 03:25:20 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:24:46.600 03:25:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:24:46.600 03:25:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:46.600 03:25:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:46.600 03:25:20 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:24:46.600 03:25:20 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:24:46.600 03:25:20 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:24:46.600 51: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:24:46.600 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:24:46.600 altname enp175s0f1np1 00:24:46.600 altname ens801f1np1 00:24:46.600 inet 192.168.100.9/24 scope global cvl_0_1 00:24:46.600 valid_lft forever preferred_lft forever 00:24:46.600 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:24:46.600 valid_lft forever preferred_lft forever 00:24:46.600 03:25:20 -- nvmf/common.sh@411 -- # return 0 00:24:46.600 03:25:20 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:24:46.600 03:25:20 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:24:46.600 03:25:20 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:24:46.600 03:25:20 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:24:46.600 03:25:20 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:24:46.600 03:25:20 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:24:46.600 03:25:20 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:24:46.600 03:25:20 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:24:46.600 03:25:20 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:24:46.600 03:25:20 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:24:46.600 03:25:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:46.600 03:25:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:46.600 03:25:20 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:24:46.600 03:25:20 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:24:46.600 03:25:20 -- nvmf/common.sh@105 -- # continue 2 00:24:46.600 03:25:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:46.600 03:25:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:46.600 03:25:20 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:24:46.600 03:25:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:46.600 03:25:20 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:24:46.600 03:25:20 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:24:46.600 03:25:20 -- nvmf/common.sh@105 -- # continue 2 00:24:46.600 03:25:20 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:24:46.600 03:25:20 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:24:46.600 03:25:20 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:24:46.600 03:25:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:24:46.600 03:25:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:46.600 03:25:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:46.600 03:25:20 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:24:46.600 03:25:20 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:24:46.600 03:25:20 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:24:46.600 03:25:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:24:46.600 03:25:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:46.600 03:25:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:46.600 03:25:20 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:24:46.600 192.168.100.9' 00:24:46.600 03:25:20 -- nvmf/common.sh@446 -- # head -n 1 00:24:46.600 03:25:20 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:24:46.600 192.168.100.9' 00:24:46.600 03:25:20 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:24:46.600 03:25:20 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:24:46.600 192.168.100.9' 00:24:46.600 03:25:20 -- nvmf/common.sh@447 -- # tail -n +2 00:24:46.600 03:25:20 -- nvmf/common.sh@447 -- # head -n 1 00:24:46.600 03:25:20 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:24:46.600 03:25:20 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:24:46.600 03:25:20 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:24:46.600 03:25:20 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:24:46.600 03:25:20 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:24:46.600 03:25:20 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:24:46.600 03:25:20 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:24:46.600 03:25:20 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:24:46.600 03:25:20 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:46.600 03:25:20 -- common/autotest_common.sh@10 -- # set +x 00:24:46.600 03:25:20 -- nvmf/common.sh@470 -- # nvmfpid=4191409 00:24:46.600 03:25:20 -- nvmf/common.sh@471 -- # waitforlisten 4191409 00:24:46.600 03:25:20 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:24:46.600 03:25:20 -- common/autotest_common.sh@817 -- # '[' -z 4191409 ']' 00:24:46.600 03:25:20 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:46.600 03:25:20 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:46.600 03:25:20 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:46.600 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:46.600 03:25:20 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:46.600 03:25:20 -- common/autotest_common.sh@10 -- # set +x 00:24:46.600 [2024-04-25 03:25:20.443425] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:24:46.600 [2024-04-25 03:25:20.443467] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:46.600 EAL: No free 2048 kB hugepages reported on node 1 00:24:46.600 [2024-04-25 03:25:20.503593] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:46.600 [2024-04-25 03:25:20.579461] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:46.600 [2024-04-25 03:25:20.579493] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:46.600 [2024-04-25 03:25:20.579500] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:24:46.600 [2024-04-25 03:25:20.579506] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:24:46.600 [2024-04-25 03:25:20.579511] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:46.600 [2024-04-25 03:25:20.579530] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:46.859 03:25:21 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:46.859 03:25:21 -- common/autotest_common.sh@850 -- # return 0 00:24:46.859 03:25:21 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:24:46.859 03:25:21 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:46.859 03:25:21 -- common/autotest_common.sh@10 -- # set +x 00:24:46.859 03:25:21 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:46.859 03:25:21 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:24:46.859 03:25:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:46.859 03:25:21 -- common/autotest_common.sh@10 -- # set +x 00:24:46.859 [2024-04-25 03:25:21.286261] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x1e2ecb0/0x1e2e2f0) succeed. 00:24:46.859 [2024-04-25 03:25:21.295053] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x1e2ff60/0x1e2e870) succeed. 00:24:46.859 [2024-04-25 03:25:21.295075] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:24:46.859 03:25:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:46.859 03:25:21 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:24:46.859 03:25:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:46.859 03:25:21 -- common/autotest_common.sh@10 -- # set +x 00:24:46.859 null0 00:24:46.859 03:25:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:46.859 03:25:21 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:24:46.859 03:25:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:46.859 03:25:21 -- common/autotest_common.sh@10 -- # set +x 00:24:46.859 03:25:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:46.859 03:25:21 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:24:46.859 03:25:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:46.859 03:25:21 -- common/autotest_common.sh@10 -- # set +x 00:24:46.859 03:25:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:46.859 03:25:21 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g d9d120c116d64b45999b98f0c54f3d86 00:24:46.859 03:25:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:46.859 03:25:21 -- common/autotest_common.sh@10 -- # set +x 00:24:46.859 03:25:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:46.859 03:25:21 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:24:46.859 03:25:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:46.859 03:25:21 -- common/autotest_common.sh@10 -- # set +x 00:24:46.859 [2024-04-25 03:25:21.340510] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:24:46.859 03:25:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:46.860 03:25:21 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -a 192.168.100.8 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:24:46.860 03:25:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:46.860 03:25:21 -- common/autotest_common.sh@10 -- # set +x 00:24:47.118 nvme0n1 00:24:47.118 03:25:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:47.118 03:25:21 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:24:47.118 03:25:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:47.118 03:25:21 -- common/autotest_common.sh@10 -- # set +x 00:24:47.118 [ 00:24:47.118 { 00:24:47.118 "name": "nvme0n1", 00:24:47.118 "aliases": [ 00:24:47.118 "d9d120c1-16d6-4b45-999b-98f0c54f3d86" 00:24:47.118 ], 00:24:47.118 "product_name": "NVMe disk", 00:24:47.118 "block_size": 512, 00:24:47.118 "num_blocks": 2097152, 00:24:47.118 "uuid": "d9d120c1-16d6-4b45-999b-98f0c54f3d86", 00:24:47.118 "assigned_rate_limits": { 00:24:47.118 "rw_ios_per_sec": 0, 00:24:47.118 "rw_mbytes_per_sec": 0, 00:24:47.118 "r_mbytes_per_sec": 0, 00:24:47.118 "w_mbytes_per_sec": 0 00:24:47.118 }, 00:24:47.118 "claimed": false, 00:24:47.118 "zoned": false, 00:24:47.118 "supported_io_types": { 00:24:47.118 "read": true, 00:24:47.118 "write": true, 00:24:47.118 "unmap": false, 00:24:47.118 "write_zeroes": true, 00:24:47.118 "flush": true, 00:24:47.118 "reset": true, 00:24:47.118 "compare": true, 00:24:47.118 "compare_and_write": true, 00:24:47.118 "abort": true, 00:24:47.118 "nvme_admin": true, 00:24:47.118 "nvme_io": true 00:24:47.118 }, 00:24:47.118 "memory_domains": [ 00:24:47.118 { 00:24:47.118 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:24:47.118 "dma_device_type": 0 00:24:47.118 } 00:24:47.118 ], 00:24:47.118 "driver_specific": { 00:24:47.118 "nvme": [ 00:24:47.118 { 00:24:47.118 "trid": { 00:24:47.118 "trtype": "RDMA", 00:24:47.118 "adrfam": "IPv4", 00:24:47.118 "traddr": "192.168.100.8", 00:24:47.118 "trsvcid": "4420", 00:24:47.118 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:24:47.118 }, 00:24:47.118 "ctrlr_data": { 00:24:47.118 "cntlid": 1, 00:24:47.118 "vendor_id": "0x8086", 00:24:47.118 "model_number": "SPDK bdev Controller", 00:24:47.118 "serial_number": "00000000000000000000", 00:24:47.118 "firmware_revision": "24.05", 00:24:47.118 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:24:47.118 "oacs": { 00:24:47.118 "security": 0, 00:24:47.118 "format": 0, 00:24:47.118 "firmware": 0, 00:24:47.118 "ns_manage": 0 00:24:47.118 }, 00:24:47.118 "multi_ctrlr": true, 00:24:47.118 "ana_reporting": false 00:24:47.118 }, 00:24:47.118 "vs": { 00:24:47.118 "nvme_version": "1.3" 00:24:47.118 }, 00:24:47.118 "ns_data": { 00:24:47.118 "id": 1, 00:24:47.118 "can_share": true 00:24:47.118 } 00:24:47.118 } 00:24:47.118 ], 00:24:47.118 "mp_policy": "active_passive" 00:24:47.118 } 00:24:47.118 } 00:24:47.118 ] 00:24:47.118 03:25:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:47.118 03:25:21 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:24:47.118 03:25:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:47.118 03:25:21 -- common/autotest_common.sh@10 -- # set +x 00:24:47.118 [2024-04-25 03:25:21.442063] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:24:47.118 [2024-04-25 03:25:21.462637] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:47.118 [2024-04-25 03:25:21.485323] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:24:47.118 03:25:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:47.118 03:25:21 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:24:47.118 03:25:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:47.118 03:25:21 -- common/autotest_common.sh@10 -- # set +x 00:24:47.118 [ 00:24:47.118 { 00:24:47.118 "name": "nvme0n1", 00:24:47.118 "aliases": [ 00:24:47.118 "d9d120c1-16d6-4b45-999b-98f0c54f3d86" 00:24:47.118 ], 00:24:47.118 "product_name": "NVMe disk", 00:24:47.118 "block_size": 512, 00:24:47.118 "num_blocks": 2097152, 00:24:47.118 "uuid": "d9d120c1-16d6-4b45-999b-98f0c54f3d86", 00:24:47.118 "assigned_rate_limits": { 00:24:47.118 "rw_ios_per_sec": 0, 00:24:47.118 "rw_mbytes_per_sec": 0, 00:24:47.118 "r_mbytes_per_sec": 0, 00:24:47.118 "w_mbytes_per_sec": 0 00:24:47.118 }, 00:24:47.118 "claimed": false, 00:24:47.118 "zoned": false, 00:24:47.119 "supported_io_types": { 00:24:47.119 "read": true, 00:24:47.119 "write": true, 00:24:47.119 "unmap": false, 00:24:47.119 "write_zeroes": true, 00:24:47.119 "flush": true, 00:24:47.119 "reset": true, 00:24:47.119 "compare": true, 00:24:47.119 "compare_and_write": true, 00:24:47.119 "abort": true, 00:24:47.119 "nvme_admin": true, 00:24:47.119 "nvme_io": true 00:24:47.119 }, 00:24:47.119 "memory_domains": [ 00:24:47.119 { 00:24:47.119 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:24:47.119 "dma_device_type": 0 00:24:47.119 } 00:24:47.119 ], 00:24:47.119 "driver_specific": { 00:24:47.119 "nvme": [ 00:24:47.119 { 00:24:47.119 "trid": { 00:24:47.119 "trtype": "RDMA", 00:24:47.119 "adrfam": "IPv4", 00:24:47.119 "traddr": "192.168.100.8", 00:24:47.119 "trsvcid": "4420", 00:24:47.119 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:24:47.119 }, 00:24:47.119 "ctrlr_data": { 00:24:47.119 "cntlid": 2, 00:24:47.119 "vendor_id": "0x8086", 00:24:47.119 "model_number": "SPDK bdev Controller", 00:24:47.119 "serial_number": "00000000000000000000", 00:24:47.119 "firmware_revision": "24.05", 00:24:47.119 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:24:47.119 "oacs": { 00:24:47.119 "security": 0, 00:24:47.119 "format": 0, 00:24:47.119 "firmware": 0, 00:24:47.119 "ns_manage": 0 00:24:47.119 }, 00:24:47.119 "multi_ctrlr": true, 00:24:47.119 "ana_reporting": false 00:24:47.119 }, 00:24:47.119 "vs": { 00:24:47.119 "nvme_version": "1.3" 00:24:47.119 }, 00:24:47.119 "ns_data": { 00:24:47.119 "id": 1, 00:24:47.119 "can_share": true 00:24:47.119 } 00:24:47.119 } 00:24:47.119 ], 00:24:47.119 "mp_policy": "active_passive" 00:24:47.119 } 00:24:47.119 } 00:24:47.119 ] 00:24:47.119 03:25:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:47.119 03:25:21 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:47.119 03:25:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:47.119 03:25:21 -- common/autotest_common.sh@10 -- # set +x 00:24:47.119 03:25:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:47.119 03:25:21 -- host/async_init.sh@53 -- # mktemp 00:24:47.119 03:25:21 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.LLsFjuEGcW 00:24:47.119 03:25:21 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:24:47.119 03:25:21 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.LLsFjuEGcW 00:24:47.119 03:25:21 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:24:47.119 03:25:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:47.119 03:25:21 -- common/autotest_common.sh@10 -- # set +x 00:24:47.119 03:25:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:47.119 03:25:21 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4421 --secure-channel 00:24:47.119 03:25:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:47.119 03:25:21 -- common/autotest_common.sh@10 -- # set +x 00:24:47.119 [2024-04-25 03:25:21.555873] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:24:47.119 03:25:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:47.119 03:25:21 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.LLsFjuEGcW 00:24:47.119 03:25:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:47.119 03:25:21 -- common/autotest_common.sh@10 -- # set +x 00:24:47.119 03:25:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:47.119 03:25:21 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -a 192.168.100.8 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.LLsFjuEGcW 00:24:47.119 03:25:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:47.119 03:25:21 -- common/autotest_common.sh@10 -- # set +x 00:24:47.119 [2024-04-25 03:25:21.571901] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:24:47.377 nvme0n1 00:24:47.377 03:25:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:47.377 03:25:21 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:24:47.378 03:25:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:47.378 03:25:21 -- common/autotest_common.sh@10 -- # set +x 00:24:47.378 [ 00:24:47.378 { 00:24:47.378 "name": "nvme0n1", 00:24:47.378 "aliases": [ 00:24:47.378 "d9d120c1-16d6-4b45-999b-98f0c54f3d86" 00:24:47.378 ], 00:24:47.378 "product_name": "NVMe disk", 00:24:47.378 "block_size": 512, 00:24:47.378 "num_blocks": 2097152, 00:24:47.378 "uuid": "d9d120c1-16d6-4b45-999b-98f0c54f3d86", 00:24:47.378 "assigned_rate_limits": { 00:24:47.378 "rw_ios_per_sec": 0, 00:24:47.378 "rw_mbytes_per_sec": 0, 00:24:47.378 "r_mbytes_per_sec": 0, 00:24:47.378 "w_mbytes_per_sec": 0 00:24:47.378 }, 00:24:47.378 "claimed": false, 00:24:47.378 "zoned": false, 00:24:47.378 "supported_io_types": { 00:24:47.378 "read": true, 00:24:47.378 "write": true, 00:24:47.378 "unmap": false, 00:24:47.378 "write_zeroes": true, 00:24:47.378 "flush": true, 00:24:47.378 "reset": true, 00:24:47.378 "compare": true, 00:24:47.378 "compare_and_write": true, 00:24:47.378 "abort": true, 00:24:47.378 "nvme_admin": true, 00:24:47.378 "nvme_io": true 00:24:47.378 }, 00:24:47.378 "memory_domains": [ 00:24:47.378 { 00:24:47.378 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:24:47.378 "dma_device_type": 0 00:24:47.378 } 00:24:47.378 ], 00:24:47.378 "driver_specific": { 00:24:47.378 "nvme": [ 00:24:47.378 { 00:24:47.378 "trid": { 00:24:47.378 "trtype": "RDMA", 00:24:47.378 "adrfam": "IPv4", 00:24:47.378 "traddr": "192.168.100.8", 00:24:47.378 "trsvcid": "4421", 00:24:47.378 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:24:47.378 }, 00:24:47.378 "ctrlr_data": { 00:24:47.378 "cntlid": 3, 00:24:47.378 "vendor_id": "0x8086", 00:24:47.378 "model_number": "SPDK bdev Controller", 00:24:47.378 "serial_number": "00000000000000000000", 00:24:47.378 "firmware_revision": "24.05", 00:24:47.378 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:24:47.378 "oacs": { 00:24:47.378 "security": 0, 00:24:47.378 "format": 0, 00:24:47.378 "firmware": 0, 00:24:47.378 "ns_manage": 0 00:24:47.378 }, 00:24:47.378 "multi_ctrlr": true, 00:24:47.378 "ana_reporting": false 00:24:47.378 }, 00:24:47.378 "vs": { 00:24:47.378 "nvme_version": "1.3" 00:24:47.378 }, 00:24:47.378 "ns_data": { 00:24:47.378 "id": 1, 00:24:47.378 "can_share": true 00:24:47.378 } 00:24:47.378 } 00:24:47.378 ], 00:24:47.378 "mp_policy": "active_passive" 00:24:47.378 } 00:24:47.378 } 00:24:47.378 ] 00:24:47.378 03:25:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:47.378 03:25:21 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:47.378 03:25:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:47.378 03:25:21 -- common/autotest_common.sh@10 -- # set +x 00:24:47.378 03:25:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:47.378 03:25:21 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.LLsFjuEGcW 00:24:47.378 03:25:21 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:24:47.378 03:25:21 -- host/async_init.sh@78 -- # nvmftestfini 00:24:47.378 03:25:21 -- nvmf/common.sh@477 -- # nvmfcleanup 00:24:47.378 03:25:21 -- nvmf/common.sh@117 -- # sync 00:24:47.378 03:25:21 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:24:47.378 03:25:21 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:24:47.378 03:25:21 -- nvmf/common.sh@120 -- # set +e 00:24:47.378 03:25:21 -- nvmf/common.sh@121 -- # for i in {1..20} 00:24:47.378 03:25:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:24:47.378 rmmod nvme_rdma 00:24:47.378 rmmod nvme_fabrics 00:24:47.378 03:25:21 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:24:47.378 03:25:21 -- nvmf/common.sh@124 -- # set -e 00:24:47.378 03:25:21 -- nvmf/common.sh@125 -- # return 0 00:24:47.378 03:25:21 -- nvmf/common.sh@478 -- # '[' -n 4191409 ']' 00:24:47.378 03:25:21 -- nvmf/common.sh@479 -- # killprocess 4191409 00:24:47.378 03:25:21 -- common/autotest_common.sh@936 -- # '[' -z 4191409 ']' 00:24:47.378 03:25:21 -- common/autotest_common.sh@940 -- # kill -0 4191409 00:24:47.378 03:25:21 -- common/autotest_common.sh@941 -- # uname 00:24:47.378 03:25:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:47.378 03:25:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4191409 00:24:47.378 03:25:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:47.378 03:25:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:47.378 03:25:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4191409' 00:24:47.378 killing process with pid 4191409 00:24:47.378 03:25:21 -- common/autotest_common.sh@955 -- # kill 4191409 00:24:47.378 03:25:21 -- common/autotest_common.sh@960 -- # wait 4191409 00:24:47.378 [2024-04-25 03:25:21.807306] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:24:47.636 03:25:21 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:24:47.636 03:25:21 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:24:47.636 00:24:47.636 real 0m7.698s 00:24:47.636 user 0m3.500s 00:24:47.636 sys 0m4.849s 00:24:47.636 03:25:21 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:24:47.636 03:25:21 -- common/autotest_common.sh@10 -- # set +x 00:24:47.636 ************************************ 00:24:47.636 END TEST nvmf_async_init 00:24:47.636 ************************************ 00:24:47.636 03:25:22 -- nvmf/nvmf.sh@92 -- # run_test dma /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=rdma 00:24:47.636 03:25:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:47.636 03:25:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:47.636 03:25:22 -- common/autotest_common.sh@10 -- # set +x 00:24:47.896 ************************************ 00:24:47.896 START TEST dma 00:24:47.896 ************************************ 00:24:47.896 03:25:22 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=rdma 00:24:47.896 * Looking for test storage... 00:24:47.896 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host 00:24:47.896 03:25:22 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:24:47.896 03:25:22 -- nvmf/common.sh@7 -- # uname -s 00:24:47.896 03:25:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:47.896 03:25:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:47.896 03:25:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:47.896 03:25:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:47.896 03:25:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:47.896 03:25:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:47.896 03:25:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:47.896 03:25:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:47.896 03:25:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:47.896 03:25:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:47.896 03:25:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:24:47.896 03:25:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:24:47.896 03:25:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:47.896 03:25:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:47.896 03:25:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:47.896 03:25:22 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:24:47.896 03:25:22 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:24:47.896 03:25:22 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:47.896 03:25:22 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:47.896 03:25:22 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:47.896 03:25:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:47.896 03:25:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:47.896 03:25:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:47.896 03:25:22 -- paths/export.sh@5 -- # export PATH 00:24:47.896 03:25:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:47.896 03:25:22 -- nvmf/common.sh@47 -- # : 0 00:24:47.896 03:25:22 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:24:47.896 03:25:22 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:24:47.896 03:25:22 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:24:47.896 03:25:22 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:47.896 03:25:22 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:47.896 03:25:22 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:24:47.896 03:25:22 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:24:47.896 03:25:22 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:24:47.896 03:25:22 -- host/dma.sh@12 -- # '[' rdma '!=' rdma ']' 00:24:47.896 03:25:22 -- host/dma.sh@16 -- # MALLOC_BDEV_SIZE=256 00:24:47.896 03:25:22 -- host/dma.sh@17 -- # MALLOC_BLOCK_SIZE=512 00:24:47.896 03:25:22 -- host/dma.sh@18 -- # subsystem=0 00:24:47.896 03:25:22 -- host/dma.sh@93 -- # nvmftestinit 00:24:47.896 03:25:22 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:24:47.896 03:25:22 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:47.896 03:25:22 -- nvmf/common.sh@437 -- # prepare_net_devs 00:24:47.896 03:25:22 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:24:47.896 03:25:22 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:24:47.896 03:25:22 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:47.896 03:25:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:47.896 03:25:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:47.896 03:25:22 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:24:47.896 03:25:22 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:24:47.896 03:25:22 -- nvmf/common.sh@285 -- # xtrace_disable 00:24:47.896 03:25:22 -- common/autotest_common.sh@10 -- # set +x 00:24:54.457 03:25:27 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:54.457 03:25:27 -- nvmf/common.sh@291 -- # pci_devs=() 00:24:54.457 03:25:27 -- nvmf/common.sh@291 -- # local -a pci_devs 00:24:54.457 03:25:27 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:24:54.457 03:25:27 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:24:54.457 03:25:27 -- nvmf/common.sh@293 -- # pci_drivers=() 00:24:54.457 03:25:27 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:24:54.457 03:25:27 -- nvmf/common.sh@295 -- # net_devs=() 00:24:54.457 03:25:27 -- nvmf/common.sh@295 -- # local -ga net_devs 00:24:54.457 03:25:27 -- nvmf/common.sh@296 -- # e810=() 00:24:54.457 03:25:27 -- nvmf/common.sh@296 -- # local -ga e810 00:24:54.457 03:25:27 -- nvmf/common.sh@297 -- # x722=() 00:24:54.457 03:25:27 -- nvmf/common.sh@297 -- # local -ga x722 00:24:54.457 03:25:27 -- nvmf/common.sh@298 -- # mlx=() 00:24:54.457 03:25:27 -- nvmf/common.sh@298 -- # local -ga mlx 00:24:54.457 03:25:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:54.457 03:25:27 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:54.457 03:25:27 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:54.457 03:25:27 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:54.457 03:25:27 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:54.457 03:25:27 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:54.457 03:25:27 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:54.457 03:25:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:54.457 03:25:27 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:54.457 03:25:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:54.457 03:25:27 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:54.457 03:25:27 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:24:54.457 03:25:27 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:24:54.457 03:25:27 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:24:54.457 03:25:27 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:24:54.457 03:25:27 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:24:54.457 03:25:27 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:24:54.457 03:25:27 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:24:54.457 03:25:27 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:24:54.457 03:25:27 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:54.457 03:25:27 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:24:54.457 Found 0000:af:00.0 (0x8086 - 0x159b) 00:24:54.457 03:25:27 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:24:54.457 03:25:27 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:24:54.458 03:25:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:54.458 03:25:27 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:54.458 03:25:27 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:24:54.458 03:25:27 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:24:54.458 03:25:27 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:54.458 03:25:27 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:24:54.458 Found 0000:af:00.1 (0x8086 - 0x159b) 00:24:54.458 03:25:27 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:24:54.458 03:25:27 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:24:54.458 03:25:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:54.458 03:25:27 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:54.458 03:25:27 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:24:54.458 03:25:27 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:24:54.458 03:25:27 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:24:54.458 03:25:27 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:24:54.458 03:25:27 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:24:54.458 03:25:27 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:24:54.458 03:25:27 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:24:54.458 03:25:27 -- nvmf/common.sh@377 -- # modinfo irdma 00:24:54.458 03:25:27 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:24:54.458 03:25:27 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:54.458 03:25:27 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:54.458 03:25:27 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:54.458 03:25:27 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:54.458 03:25:27 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:24:54.458 Found net devices under 0000:af:00.0: cvl_0_0 00:24:54.458 03:25:27 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:54.458 03:25:27 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:54.458 03:25:27 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:54.458 03:25:27 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:54.458 03:25:27 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:54.458 03:25:27 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:24:54.458 Found net devices under 0000:af:00.1: cvl_0_1 00:24:54.458 03:25:27 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:54.458 03:25:27 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:24:54.458 03:25:27 -- nvmf/common.sh@403 -- # is_hw=yes 00:24:54.458 03:25:27 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:24:54.458 03:25:27 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:24:54.458 03:25:27 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:24:54.458 03:25:27 -- nvmf/common.sh@409 -- # rdma_device_init 00:24:54.458 03:25:27 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:24:54.458 03:25:27 -- nvmf/common.sh@58 -- # uname 00:24:54.458 03:25:27 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:24:54.458 03:25:27 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:24:54.458 03:25:27 -- nvmf/common.sh@63 -- # modprobe ib_core 00:24:54.458 03:25:27 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:24:54.458 03:25:27 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:24:54.458 03:25:27 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:24:54.458 03:25:27 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:24:54.458 03:25:27 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:24:54.458 03:25:27 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:24:54.458 03:25:27 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:24:54.458 03:25:27 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:24:54.458 03:25:27 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:24:54.458 03:25:27 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:24:54.458 03:25:27 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:24:54.458 03:25:27 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:24:54.458 03:25:27 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:24:54.458 03:25:27 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:54.458 03:25:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:54.458 03:25:27 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:24:54.458 03:25:27 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:24:54.458 03:25:27 -- nvmf/common.sh@105 -- # continue 2 00:24:54.458 03:25:27 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:54.458 03:25:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:54.458 03:25:27 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:24:54.458 03:25:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:54.458 03:25:27 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:24:54.458 03:25:27 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:24:54.458 03:25:27 -- nvmf/common.sh@105 -- # continue 2 00:24:54.458 03:25:27 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:24:54.458 03:25:27 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:24:54.458 03:25:27 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:24:54.458 03:25:27 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:24:54.458 03:25:27 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:54.458 03:25:27 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:54.458 03:25:27 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:24:54.458 03:25:27 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:24:54.458 03:25:27 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:24:54.458 50: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:24:54.458 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:24:54.458 altname enp175s0f0np0 00:24:54.458 altname ens801f0np0 00:24:54.458 inet 192.168.100.8/24 scope global cvl_0_0 00:24:54.458 valid_lft forever preferred_lft forever 00:24:54.458 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:24:54.458 valid_lft forever preferred_lft forever 00:24:54.458 03:25:27 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:24:54.458 03:25:27 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:24:54.458 03:25:27 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:24:54.458 03:25:27 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:24:54.458 03:25:27 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:54.458 03:25:27 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:54.458 03:25:28 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:24:54.458 03:25:28 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:24:54.458 03:25:28 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:24:54.458 51: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:24:54.458 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:24:54.458 altname enp175s0f1np1 00:24:54.458 altname ens801f1np1 00:24:54.458 inet 192.168.100.9/24 scope global cvl_0_1 00:24:54.458 valid_lft forever preferred_lft forever 00:24:54.458 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:24:54.458 valid_lft forever preferred_lft forever 00:24:54.458 03:25:28 -- nvmf/common.sh@411 -- # return 0 00:24:54.458 03:25:28 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:24:54.458 03:25:28 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:24:54.458 03:25:28 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:24:54.458 03:25:28 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:24:54.458 03:25:28 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:24:54.458 03:25:28 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:24:54.458 03:25:28 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:24:54.458 03:25:28 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:24:54.458 03:25:28 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:24:54.458 03:25:28 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:24:54.458 03:25:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:54.458 03:25:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:54.458 03:25:28 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:24:54.458 03:25:28 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:24:54.458 03:25:28 -- nvmf/common.sh@105 -- # continue 2 00:24:54.458 03:25:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:54.458 03:25:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:54.458 03:25:28 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:24:54.458 03:25:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:54.458 03:25:28 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:24:54.458 03:25:28 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:24:54.458 03:25:28 -- nvmf/common.sh@105 -- # continue 2 00:24:54.458 03:25:28 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:24:54.458 03:25:28 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:24:54.458 03:25:28 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:24:54.458 03:25:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:24:54.458 03:25:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:54.458 03:25:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:54.458 03:25:28 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:24:54.458 03:25:28 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:24:54.458 03:25:28 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:24:54.458 03:25:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:24:54.458 03:25:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:54.458 03:25:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:54.458 03:25:28 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:24:54.458 192.168.100.9' 00:24:54.458 03:25:28 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:24:54.458 192.168.100.9' 00:24:54.458 03:25:28 -- nvmf/common.sh@446 -- # head -n 1 00:24:54.458 03:25:28 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:24:54.458 03:25:28 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:24:54.458 192.168.100.9' 00:24:54.458 03:25:28 -- nvmf/common.sh@447 -- # tail -n +2 00:24:54.458 03:25:28 -- nvmf/common.sh@447 -- # head -n 1 00:24:54.458 03:25:28 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:24:54.458 03:25:28 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:24:54.458 03:25:28 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:24:54.458 03:25:28 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:24:54.458 03:25:28 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:24:54.458 03:25:28 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:24:54.458 03:25:28 -- host/dma.sh@94 -- # nvmfappstart -m 0x3 00:24:54.458 03:25:28 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:24:54.458 03:25:28 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:54.458 03:25:28 -- common/autotest_common.sh@10 -- # set +x 00:24:54.458 03:25:28 -- nvmf/common.sh@470 -- # nvmfpid=1528 00:24:54.458 03:25:28 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:24:54.458 03:25:28 -- nvmf/common.sh@471 -- # waitforlisten 1528 00:24:54.459 03:25:28 -- common/autotest_common.sh@817 -- # '[' -z 1528 ']' 00:24:54.459 03:25:28 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:54.459 03:25:28 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:54.459 03:25:28 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:54.459 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:54.459 03:25:28 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:54.459 03:25:28 -- common/autotest_common.sh@10 -- # set +x 00:24:54.459 [2024-04-25 03:25:28.159020] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:24:54.459 [2024-04-25 03:25:28.159067] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:54.459 EAL: No free 2048 kB hugepages reported on node 1 00:24:54.459 [2024-04-25 03:25:28.218507] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:24:54.459 [2024-04-25 03:25:28.289517] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:54.459 [2024-04-25 03:25:28.289552] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:54.459 [2024-04-25 03:25:28.289559] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:24:54.459 [2024-04-25 03:25:28.289565] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:24:54.459 [2024-04-25 03:25:28.289569] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:54.459 [2024-04-25 03:25:28.289625] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:54.459 [2024-04-25 03:25:28.289627] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:54.459 03:25:28 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:54.459 03:25:28 -- common/autotest_common.sh@850 -- # return 0 00:24:54.459 03:25:28 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:24:54.459 03:25:28 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:54.459 03:25:28 -- common/autotest_common.sh@10 -- # set +x 00:24:54.716 03:25:28 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:54.716 03:25:28 -- host/dma.sh@96 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:24:54.716 03:25:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:54.716 03:25:28 -- common/autotest_common.sh@10 -- # set +x 00:24:54.716 [2024-04-25 03:25:28.999767] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x1ac37f0/0x1ac2e30) succeed. 00:24:54.716 [2024-04-25 03:25:29.009579] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x1ac4a60/0x1ac33b0) succeed. 00:24:54.716 [2024-04-25 03:25:29.009607] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:24:54.716 03:25:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:54.716 03:25:29 -- host/dma.sh@97 -- # rpc_cmd bdev_malloc_create 256 512 -b Malloc0 00:24:54.717 03:25:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:54.717 03:25:29 -- common/autotest_common.sh@10 -- # set +x 00:24:54.717 Malloc0 00:24:54.717 03:25:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:54.717 03:25:29 -- host/dma.sh@98 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK00000000000001 00:24:54.717 03:25:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:54.717 03:25:29 -- common/autotest_common.sh@10 -- # set +x 00:24:54.717 03:25:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:54.717 03:25:29 -- host/dma.sh@99 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Malloc0 00:24:54.717 03:25:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:54.717 03:25:29 -- common/autotest_common.sh@10 -- # set +x 00:24:54.717 03:25:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:54.717 03:25:29 -- host/dma.sh@100 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:24:54.717 03:25:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:54.717 03:25:29 -- common/autotest_common.sh@10 -- # set +x 00:24:54.717 [2024-04-25 03:25:29.096928] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:24:54.717 03:25:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:54.717 03:25:29 -- host/dma.sh@104 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randrw -M 70 -t 5 -m 0xc --json /dev/fd/62 -b Nvme0n1 -f -x translate 00:24:54.717 03:25:29 -- host/dma.sh@104 -- # gen_nvmf_target_json 0 00:24:54.717 03:25:29 -- nvmf/common.sh@521 -- # config=() 00:24:54.717 03:25:29 -- nvmf/common.sh@521 -- # local subsystem config 00:24:54.717 03:25:29 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:24:54.717 03:25:29 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:24:54.717 { 00:24:54.717 "params": { 00:24:54.717 "name": "Nvme$subsystem", 00:24:54.717 "trtype": "$TEST_TRANSPORT", 00:24:54.717 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:54.717 "adrfam": "ipv4", 00:24:54.717 "trsvcid": "$NVMF_PORT", 00:24:54.717 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:54.717 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:54.717 "hdgst": ${hdgst:-false}, 00:24:54.717 "ddgst": ${ddgst:-false} 00:24:54.717 }, 00:24:54.717 "method": "bdev_nvme_attach_controller" 00:24:54.717 } 00:24:54.717 EOF 00:24:54.717 )") 00:24:54.717 03:25:29 -- nvmf/common.sh@543 -- # cat 00:24:54.717 03:25:29 -- nvmf/common.sh@545 -- # jq . 00:24:54.717 03:25:29 -- nvmf/common.sh@546 -- # IFS=, 00:24:54.717 03:25:29 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:24:54.717 "params": { 00:24:54.717 "name": "Nvme0", 00:24:54.717 "trtype": "rdma", 00:24:54.717 "traddr": "192.168.100.8", 00:24:54.717 "adrfam": "ipv4", 00:24:54.717 "trsvcid": "4420", 00:24:54.717 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:24:54.717 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:24:54.717 "hdgst": false, 00:24:54.717 "ddgst": false 00:24:54.717 }, 00:24:54.717 "method": "bdev_nvme_attach_controller" 00:24:54.717 }' 00:24:54.717 [2024-04-25 03:25:29.144497] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:24:54.717 [2024-04-25 03:25:29.144534] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1681 ] 00:24:54.717 EAL: No free 2048 kB hugepages reported on node 1 00:24:54.717 [2024-04-25 03:25:29.197765] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:24:54.975 [2024-04-25 03:25:29.268415] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:54.975 [2024-04-25 03:25:29.268418] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:00.235 bdev Nvme0n1 reports 1 memory domains 00:25:00.235 bdev Nvme0n1 supports RDMA memory domain 00:25:00.235 Initialization complete, running randrw IO for 5 sec on 2 cores 00:25:00.235 ========================================================================== 00:25:00.235 Latency [us] 00:25:00.235 IOPS MiB/s Average min max 00:25:00.235 Core 2: 21703.02 84.78 736.44 263.59 10918.63 00:25:00.235 Core 3: 22069.33 86.21 724.20 255.26 10720.69 00:25:00.235 ========================================================================== 00:25:00.235 Total : 43772.35 170.99 730.27 255.26 10918.63 00:25:00.235 00:25:00.235 Total operations: 218918, translate 218918 pull_push 0 memzero 0 00:25:00.235 03:25:34 -- host/dma.sh@107 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randrw -M 70 -t 5 -m 0xc --json /dev/fd/62 -b Malloc0 -x pull_push 00:25:00.235 03:25:34 -- host/dma.sh@107 -- # gen_malloc_json 00:25:00.235 03:25:34 -- host/dma.sh@21 -- # jq . 00:25:00.235 [2024-04-25 03:25:34.713028] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:25:00.235 [2024-04-25 03:25:34.713082] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2572 ] 00:25:00.493 EAL: No free 2048 kB hugepages reported on node 1 00:25:00.493 [2024-04-25 03:25:34.770979] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:25:00.493 [2024-04-25 03:25:34.837631] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:00.493 [2024-04-25 03:25:34.837633] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:05.759 bdev Malloc0 reports 2 memory domains 00:25:05.759 bdev Malloc0 doesn't support RDMA memory domain 00:25:05.759 Initialization complete, running randrw IO for 5 sec on 2 cores 00:25:05.759 ========================================================================== 00:25:05.759 Latency [us] 00:25:05.759 IOPS MiB/s Average min max 00:25:05.759 Core 2: 14633.73 57.16 1092.61 453.00 1941.61 00:25:05.759 Core 3: 14646.53 57.21 1091.65 482.69 2471.84 00:25:05.759 ========================================================================== 00:25:05.759 Total : 29280.26 114.38 1092.13 453.00 2471.84 00:25:05.759 00:25:05.759 Total operations: 146460, translate 0 pull_push 585840 memzero 0 00:25:05.759 03:25:40 -- host/dma.sh@110 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randread -M 70 -t 5 -m 0xc --json /dev/fd/62 -b lvs0/lvol0 -f -x memzero 00:25:05.759 03:25:40 -- host/dma.sh@110 -- # gen_lvol_nvme_json 0 00:25:05.759 03:25:40 -- host/dma.sh@48 -- # local subsystem=0 00:25:05.759 03:25:40 -- host/dma.sh@50 -- # jq . 00:25:05.759 Ignoring -M option 00:25:05.759 [2024-04-25 03:25:40.213290] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:25:05.759 [2024-04-25 03:25:40.213336] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3484 ] 00:25:05.759 EAL: No free 2048 kB hugepages reported on node 1 00:25:06.018 [2024-04-25 03:25:40.268564] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:25:06.018 [2024-04-25 03:25:40.338003] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:06.018 [2024-04-25 03:25:40.338005] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:06.276 [2024-04-25 03:25:40.547162] vbdev_lvol_rpc.c: 347:rpc_bdev_lvol_create: *WARNING*: vbdev_lvol_rpc_req_size: deprecated feature rpc_bdev_lvol_create/resize req.size to be removed in v23.09 00:25:11.586 [2024-04-25 03:25:45.575159] app.c: 937:log_deprecation_hits: *WARNING*: vbdev_lvol_rpc_req_size: deprecation 'rpc_bdev_lvol_create/resize req.size' scheduled for removal in v23.09 hit 1 times 00:25:11.586 bdev 79312c7e-ac5f-409b-846e-514962f1751d reports 1 memory domains 00:25:11.586 bdev 79312c7e-ac5f-409b-846e-514962f1751d supports RDMA memory domain 00:25:11.586 Initialization complete, running randread IO for 5 sec on 2 cores 00:25:11.586 ========================================================================== 00:25:11.586 Latency [us] 00:25:11.586 IOPS MiB/s Average min max 00:25:11.586 Core 2: 82563.19 322.51 193.08 84.81 3445.58 00:25:11.586 Core 3: 82731.38 323.17 192.68 81.60 3328.26 00:25:11.586 ========================================================================== 00:25:11.586 Total : 165294.57 645.68 192.88 81.60 3445.58 00:25:11.586 00:25:11.586 Total operations: 826553, translate 0 pull_push 0 memzero 826553 00:25:11.586 03:25:45 -- host/dma.sh@113 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 16 -o 4096 -w write -t 1 -r 'trtype:rdma adrfam:IPV4 traddr:192.168.100.8 trsvcid:4420' 00:25:11.586 EAL: No free 2048 kB hugepages reported on node 1 00:25:11.586 [2024-04-25 03:25:45.878256] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on RDMA/192.168.100.8/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:25:14.113 Initializing NVMe Controllers 00:25:14.113 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode0 00:25:14.113 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:25:14.113 Initialization complete. Launching workers. 00:25:14.113 ======================================================== 00:25:14.113 Latency(us) 00:25:14.113 Device Information : IOPS MiB/s Average min max 00:25:14.113 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 0: 2028.73 7.92 7948.63 4562.98 9403.84 00:25:14.113 ======================================================== 00:25:14.113 Total : 2028.73 7.92 7948.63 4562.98 9403.84 00:25:14.113 00:25:14.113 03:25:48 -- host/dma.sh@116 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randrw -M 70 -t 5 -m 0xc --json /dev/fd/62 -b lvs0/lvol0 -f -x translate 00:25:14.113 03:25:48 -- host/dma.sh@116 -- # gen_lvol_nvme_json 0 00:25:14.114 03:25:48 -- host/dma.sh@48 -- # local subsystem=0 00:25:14.114 03:25:48 -- host/dma.sh@50 -- # jq . 00:25:14.114 [2024-04-25 03:25:48.215167] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:25:14.114 [2024-04-25 03:25:48.215214] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4901 ] 00:25:14.114 EAL: No free 2048 kB hugepages reported on node 1 00:25:14.114 [2024-04-25 03:25:48.269266] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:25:14.114 [2024-04-25 03:25:48.339869] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:14.114 [2024-04-25 03:25:48.339870] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:14.114 [2024-04-25 03:25:48.555768] vbdev_lvol_rpc.c: 347:rpc_bdev_lvol_create: *WARNING*: vbdev_lvol_rpc_req_size: deprecated feature rpc_bdev_lvol_create/resize req.size to be removed in v23.09 00:25:19.376 [2024-04-25 03:25:53.584602] app.c: 937:log_deprecation_hits: *WARNING*: vbdev_lvol_rpc_req_size: deprecation 'rpc_bdev_lvol_create/resize req.size' scheduled for removal in v23.09 hit 1 times 00:25:19.376 bdev 85760673-ac7e-40d9-9a0a-728bd8764608 reports 1 memory domains 00:25:19.376 bdev 85760673-ac7e-40d9-9a0a-728bd8764608 supports RDMA memory domain 00:25:19.376 Initialization complete, running randrw IO for 5 sec on 2 cores 00:25:19.376 ========================================================================== 00:25:19.376 Latency [us] 00:25:19.376 IOPS MiB/s Average min max 00:25:19.376 Core 2: 20275.27 79.20 788.50 30.87 14248.86 00:25:19.376 Core 3: 20535.20 80.22 778.48 7.63 13282.78 00:25:19.376 ========================================================================== 00:25:19.376 Total : 40810.47 159.42 783.46 7.63 14248.86 00:25:19.376 00:25:19.376 Total operations: 204104, translate 203968 pull_push 0 memzero 136 00:25:19.376 03:25:53 -- host/dma.sh@118 -- # trap - SIGINT SIGTERM EXIT 00:25:19.376 03:25:53 -- host/dma.sh@120 -- # nvmftestfini 00:25:19.376 03:25:53 -- nvmf/common.sh@477 -- # nvmfcleanup 00:25:19.376 03:25:53 -- nvmf/common.sh@117 -- # sync 00:25:19.376 03:25:53 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:25:19.376 03:25:53 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:25:19.376 03:25:53 -- nvmf/common.sh@120 -- # set +e 00:25:19.376 03:25:53 -- nvmf/common.sh@121 -- # for i in {1..20} 00:25:19.376 03:25:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:25:19.376 rmmod nvme_rdma 00:25:19.376 rmmod nvme_fabrics 00:25:19.376 03:25:53 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:25:19.376 03:25:53 -- nvmf/common.sh@124 -- # set -e 00:25:19.376 03:25:53 -- nvmf/common.sh@125 -- # return 0 00:25:19.376 03:25:53 -- nvmf/common.sh@478 -- # '[' -n 1528 ']' 00:25:19.376 03:25:53 -- nvmf/common.sh@479 -- # killprocess 1528 00:25:19.376 03:25:53 -- common/autotest_common.sh@936 -- # '[' -z 1528 ']' 00:25:19.376 03:25:53 -- common/autotest_common.sh@940 -- # kill -0 1528 00:25:19.376 03:25:53 -- common/autotest_common.sh@941 -- # uname 00:25:19.376 03:25:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:19.376 03:25:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1528 00:25:19.635 03:25:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:19.635 03:25:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:19.635 03:25:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1528' 00:25:19.635 killing process with pid 1528 00:25:19.635 03:25:53 -- common/autotest_common.sh@955 -- # kill 1528 00:25:19.635 03:25:53 -- common/autotest_common.sh@960 -- # wait 1528 00:25:19.635 [2024-04-25 03:25:53.936992] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:25:19.894 03:25:54 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:25:19.894 03:25:54 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:25:19.894 00:25:19.894 real 0m32.057s 00:25:19.894 user 1m36.457s 00:25:19.894 sys 0m5.447s 00:25:19.894 03:25:54 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:25:19.894 03:25:54 -- common/autotest_common.sh@10 -- # set +x 00:25:19.894 ************************************ 00:25:19.894 END TEST dma 00:25:19.894 ************************************ 00:25:19.894 03:25:54 -- nvmf/nvmf.sh@95 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=rdma 00:25:19.894 03:25:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:19.894 03:25:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:19.894 03:25:54 -- common/autotest_common.sh@10 -- # set +x 00:25:19.894 ************************************ 00:25:19.894 START TEST nvmf_identify 00:25:19.894 ************************************ 00:25:19.894 03:25:54 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=rdma 00:25:20.153 * Looking for test storage... 00:25:20.153 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host 00:25:20.153 03:25:54 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:25:20.153 03:25:54 -- nvmf/common.sh@7 -- # uname -s 00:25:20.153 03:25:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:20.153 03:25:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:20.153 03:25:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:20.153 03:25:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:20.153 03:25:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:20.153 03:25:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:20.153 03:25:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:20.153 03:25:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:20.153 03:25:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:20.153 03:25:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:20.153 03:25:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:25:20.153 03:25:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:25:20.153 03:25:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:20.153 03:25:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:20.153 03:25:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:20.153 03:25:54 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:25:20.153 03:25:54 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:25:20.153 03:25:54 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:20.153 03:25:54 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:20.153 03:25:54 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:20.153 03:25:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:20.153 03:25:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:20.153 03:25:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:20.153 03:25:54 -- paths/export.sh@5 -- # export PATH 00:25:20.154 03:25:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:20.154 03:25:54 -- nvmf/common.sh@47 -- # : 0 00:25:20.154 03:25:54 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:25:20.154 03:25:54 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:25:20.154 03:25:54 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:25:20.154 03:25:54 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:20.154 03:25:54 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:20.154 03:25:54 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:25:20.154 03:25:54 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:25:20.154 03:25:54 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:25:20.154 03:25:54 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:20.154 03:25:54 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:20.154 03:25:54 -- host/identify.sh@14 -- # nvmftestinit 00:25:20.154 03:25:54 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:25:20.154 03:25:54 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:20.154 03:25:54 -- nvmf/common.sh@437 -- # prepare_net_devs 00:25:20.154 03:25:54 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:25:20.154 03:25:54 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:25:20.154 03:25:54 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:20.154 03:25:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:20.154 03:25:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:20.154 03:25:54 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:25:20.154 03:25:54 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:25:20.154 03:25:54 -- nvmf/common.sh@285 -- # xtrace_disable 00:25:20.154 03:25:54 -- common/autotest_common.sh@10 -- # set +x 00:25:26.718 03:26:00 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:26.718 03:26:00 -- nvmf/common.sh@291 -- # pci_devs=() 00:25:26.718 03:26:00 -- nvmf/common.sh@291 -- # local -a pci_devs 00:25:26.718 03:26:00 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:25:26.718 03:26:00 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:25:26.718 03:26:00 -- nvmf/common.sh@293 -- # pci_drivers=() 00:25:26.718 03:26:00 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:25:26.718 03:26:00 -- nvmf/common.sh@295 -- # net_devs=() 00:25:26.718 03:26:00 -- nvmf/common.sh@295 -- # local -ga net_devs 00:25:26.718 03:26:00 -- nvmf/common.sh@296 -- # e810=() 00:25:26.718 03:26:00 -- nvmf/common.sh@296 -- # local -ga e810 00:25:26.718 03:26:00 -- nvmf/common.sh@297 -- # x722=() 00:25:26.718 03:26:00 -- nvmf/common.sh@297 -- # local -ga x722 00:25:26.718 03:26:00 -- nvmf/common.sh@298 -- # mlx=() 00:25:26.718 03:26:00 -- nvmf/common.sh@298 -- # local -ga mlx 00:25:26.718 03:26:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:26.718 03:26:00 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:26.718 03:26:00 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:26.718 03:26:00 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:26.718 03:26:00 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:26.718 03:26:00 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:26.718 03:26:00 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:26.718 03:26:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:26.718 03:26:00 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:26.718 03:26:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:26.718 03:26:00 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:26.718 03:26:00 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:25:26.718 03:26:00 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:25:26.718 03:26:00 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:25:26.718 03:26:00 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:25:26.718 03:26:00 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:25:26.718 03:26:00 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:25:26.718 03:26:00 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:25:26.718 03:26:00 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:25:26.718 03:26:00 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:25:26.718 03:26:00 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:25:26.718 Found 0000:af:00.0 (0x8086 - 0x159b) 00:25:26.718 03:26:00 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:25:26.718 03:26:00 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:25:26.718 03:26:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:26.718 03:26:00 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:26.718 03:26:00 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:25:26.718 03:26:00 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:25:26.718 03:26:00 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:25:26.718 03:26:00 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:25:26.718 Found 0000:af:00.1 (0x8086 - 0x159b) 00:25:26.718 03:26:00 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:25:26.718 03:26:00 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:25:26.718 03:26:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:26.718 03:26:00 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:26.718 03:26:00 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:25:26.718 03:26:00 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:25:26.718 03:26:00 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:25:26.718 03:26:00 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:25:26.718 03:26:00 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:25:26.718 03:26:00 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:25:26.718 03:26:00 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:25:26.718 03:26:00 -- nvmf/common.sh@377 -- # modinfo irdma 00:25:26.718 03:26:00 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:25:26.718 03:26:00 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:25:26.718 03:26:00 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:26.718 03:26:00 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:25:26.718 03:26:00 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:26.719 03:26:00 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:25:26.719 Found net devices under 0000:af:00.0: cvl_0_0 00:25:26.719 03:26:00 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:25:26.719 03:26:00 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:25:26.719 03:26:00 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:26.719 03:26:00 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:25:26.719 03:26:00 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:26.719 03:26:00 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:25:26.719 Found net devices under 0000:af:00.1: cvl_0_1 00:25:26.719 03:26:00 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:25:26.719 03:26:00 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:25:26.719 03:26:00 -- nvmf/common.sh@403 -- # is_hw=yes 00:25:26.719 03:26:00 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:25:26.719 03:26:00 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:25:26.719 03:26:00 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:25:26.719 03:26:00 -- nvmf/common.sh@409 -- # rdma_device_init 00:25:26.719 03:26:00 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:25:26.719 03:26:00 -- nvmf/common.sh@58 -- # uname 00:25:26.719 03:26:00 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:25:26.719 03:26:00 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:25:26.719 03:26:00 -- nvmf/common.sh@63 -- # modprobe ib_core 00:25:26.719 03:26:00 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:25:26.719 03:26:00 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:25:26.719 03:26:00 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:25:26.719 03:26:00 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:25:26.719 03:26:00 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:25:26.719 03:26:00 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:25:26.719 03:26:00 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:25:26.719 03:26:00 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:25:26.719 03:26:00 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:25:26.719 03:26:00 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:25:26.719 03:26:00 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:25:26.719 03:26:00 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:25:26.719 03:26:00 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:25:26.719 03:26:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:25:26.719 03:26:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:26.719 03:26:00 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:25:26.719 03:26:00 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:25:26.719 03:26:00 -- nvmf/common.sh@105 -- # continue 2 00:25:26.719 03:26:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:25:26.719 03:26:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:26.719 03:26:00 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:25:26.719 03:26:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:26.719 03:26:00 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:25:26.719 03:26:00 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:25:26.719 03:26:00 -- nvmf/common.sh@105 -- # continue 2 00:25:26.719 03:26:00 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:25:26.719 03:26:00 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:25:26.719 03:26:00 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:25:26.719 03:26:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:25:26.719 03:26:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:25:26.719 03:26:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:25:26.719 03:26:00 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:25:26.719 03:26:00 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:25:26.719 03:26:00 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:25:26.719 50: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:25:26.719 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:25:26.719 altname enp175s0f0np0 00:25:26.719 altname ens801f0np0 00:25:26.719 inet 192.168.100.8/24 scope global cvl_0_0 00:25:26.719 valid_lft forever preferred_lft forever 00:25:26.719 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:25:26.719 valid_lft forever preferred_lft forever 00:25:26.719 03:26:00 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:25:26.719 03:26:00 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:25:26.719 03:26:00 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:25:26.719 03:26:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:25:26.719 03:26:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:25:26.719 03:26:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:25:26.719 03:26:00 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:25:26.719 03:26:00 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:25:26.719 03:26:00 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:25:26.719 51: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:25:26.719 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:25:26.719 altname enp175s0f1np1 00:25:26.719 altname ens801f1np1 00:25:26.719 inet 192.168.100.9/24 scope global cvl_0_1 00:25:26.719 valid_lft forever preferred_lft forever 00:25:26.719 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:25:26.719 valid_lft forever preferred_lft forever 00:25:26.719 03:26:00 -- nvmf/common.sh@411 -- # return 0 00:25:26.719 03:26:00 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:25:26.719 03:26:00 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:25:26.719 03:26:00 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:25:26.719 03:26:00 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:25:26.719 03:26:00 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:25:26.719 03:26:00 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:25:26.719 03:26:00 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:25:26.719 03:26:00 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:25:26.719 03:26:00 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:25:26.719 03:26:00 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:25:26.719 03:26:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:25:26.719 03:26:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:26.719 03:26:00 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:25:26.719 03:26:00 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:25:26.719 03:26:00 -- nvmf/common.sh@105 -- # continue 2 00:25:26.719 03:26:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:25:26.719 03:26:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:26.719 03:26:00 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:25:26.719 03:26:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:26.719 03:26:00 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:25:26.719 03:26:00 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:25:26.719 03:26:00 -- nvmf/common.sh@105 -- # continue 2 00:25:26.719 03:26:00 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:25:26.719 03:26:00 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:25:26.719 03:26:00 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:25:26.719 03:26:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:25:26.719 03:26:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:25:26.719 03:26:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:25:26.719 03:26:00 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:25:26.719 03:26:00 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:25:26.719 03:26:00 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:25:26.719 03:26:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:25:26.719 03:26:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:25:26.719 03:26:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:25:26.719 03:26:00 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:25:26.719 192.168.100.9' 00:25:26.719 03:26:00 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:25:26.719 192.168.100.9' 00:25:26.719 03:26:00 -- nvmf/common.sh@446 -- # head -n 1 00:25:26.719 03:26:00 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:25:26.720 03:26:00 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:25:26.720 192.168.100.9' 00:25:26.720 03:26:00 -- nvmf/common.sh@447 -- # tail -n +2 00:25:26.720 03:26:00 -- nvmf/common.sh@447 -- # head -n 1 00:25:26.720 03:26:00 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:25:26.720 03:26:00 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:25:26.720 03:26:00 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:25:26.720 03:26:00 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:25:26.720 03:26:00 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:25:26.720 03:26:00 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:25:26.720 03:26:00 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:25:26.720 03:26:00 -- common/autotest_common.sh@710 -- # xtrace_disable 00:25:26.720 03:26:00 -- common/autotest_common.sh@10 -- # set +x 00:25:26.720 03:26:00 -- host/identify.sh@19 -- # nvmfpid=9350 00:25:26.720 03:26:00 -- host/identify.sh@18 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:26.720 03:26:00 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:26.720 03:26:00 -- host/identify.sh@23 -- # waitforlisten 9350 00:25:26.720 03:26:00 -- common/autotest_common.sh@817 -- # '[' -z 9350 ']' 00:25:26.720 03:26:00 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:26.720 03:26:00 -- common/autotest_common.sh@822 -- # local max_retries=100 00:25:26.720 03:26:00 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:26.720 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:26.720 03:26:00 -- common/autotest_common.sh@826 -- # xtrace_disable 00:25:26.720 03:26:00 -- common/autotest_common.sh@10 -- # set +x 00:25:26.720 [2024-04-25 03:26:00.558139] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:25:26.720 [2024-04-25 03:26:00.558180] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:26.720 EAL: No free 2048 kB hugepages reported on node 1 00:25:26.720 [2024-04-25 03:26:00.617311] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:26.720 [2024-04-25 03:26:00.694423] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:26.720 [2024-04-25 03:26:00.694459] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:26.720 [2024-04-25 03:26:00.694466] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:25:26.720 [2024-04-25 03:26:00.694472] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:25:26.720 [2024-04-25 03:26:00.694477] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:26.720 [2024-04-25 03:26:00.694509] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:26.720 [2024-04-25 03:26:00.694605] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:26.720 [2024-04-25 03:26:00.694699] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:26.720 [2024-04-25 03:26:00.694700] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:26.978 03:26:01 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:25:26.978 03:26:01 -- common/autotest_common.sh@850 -- # return 0 00:25:26.978 03:26:01 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:25:26.978 03:26:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:26.978 03:26:01 -- common/autotest_common.sh@10 -- # set +x 00:25:26.978 [2024-04-25 03:26:01.380159] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x1724ea0/0x17244e0) succeed. 00:25:26.978 [2024-04-25 03:26:01.390400] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x1726210/0x1724a60) succeed. 00:25:26.978 [2024-04-25 03:26:01.390421] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:25:26.978 03:26:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:26.978 03:26:01 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:25:26.978 03:26:01 -- common/autotest_common.sh@716 -- # xtrace_disable 00:25:26.978 03:26:01 -- common/autotest_common.sh@10 -- # set +x 00:25:26.978 03:26:01 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:26.978 03:26:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:26.978 03:26:01 -- common/autotest_common.sh@10 -- # set +x 00:25:26.978 Malloc0 00:25:26.978 03:26:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:26.978 03:26:01 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:26.978 03:26:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:26.978 03:26:01 -- common/autotest_common.sh@10 -- # set +x 00:25:26.978 03:26:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:26.978 03:26:01 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:25:26.978 03:26:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:26.978 03:26:01 -- common/autotest_common.sh@10 -- # set +x 00:25:27.240 03:26:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:27.240 03:26:01 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:25:27.240 03:26:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:27.240 03:26:01 -- common/autotest_common.sh@10 -- # set +x 00:25:27.240 [2024-04-25 03:26:01.485517] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:25:27.240 03:26:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:27.240 03:26:01 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:25:27.240 03:26:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:27.240 03:26:01 -- common/autotest_common.sh@10 -- # set +x 00:25:27.240 03:26:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:27.240 03:26:01 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:25:27.240 03:26:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:27.240 03:26:01 -- common/autotest_common.sh@10 -- # set +x 00:25:27.240 [2024-04-25 03:26:01.501448] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:25:27.240 [ 00:25:27.240 { 00:25:27.240 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:27.240 "subtype": "Discovery", 00:25:27.240 "listen_addresses": [ 00:25:27.240 { 00:25:27.240 "transport": "RDMA", 00:25:27.240 "trtype": "RDMA", 00:25:27.240 "adrfam": "IPv4", 00:25:27.240 "traddr": "192.168.100.8", 00:25:27.240 "trsvcid": "4420" 00:25:27.240 } 00:25:27.240 ], 00:25:27.240 "allow_any_host": true, 00:25:27.240 "hosts": [] 00:25:27.240 }, 00:25:27.240 { 00:25:27.240 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:27.240 "subtype": "NVMe", 00:25:27.240 "listen_addresses": [ 00:25:27.240 { 00:25:27.240 "transport": "RDMA", 00:25:27.240 "trtype": "RDMA", 00:25:27.240 "adrfam": "IPv4", 00:25:27.240 "traddr": "192.168.100.8", 00:25:27.240 "trsvcid": "4420" 00:25:27.240 } 00:25:27.240 ], 00:25:27.240 "allow_any_host": true, 00:25:27.240 "hosts": [], 00:25:27.240 "serial_number": "SPDK00000000000001", 00:25:27.240 "model_number": "SPDK bdev Controller", 00:25:27.240 "max_namespaces": 32, 00:25:27.240 "min_cntlid": 1, 00:25:27.240 "max_cntlid": 65519, 00:25:27.240 "namespaces": [ 00:25:27.240 { 00:25:27.240 "nsid": 1, 00:25:27.240 "bdev_name": "Malloc0", 00:25:27.240 "name": "Malloc0", 00:25:27.240 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:25:27.240 "eui64": "ABCDEF0123456789", 00:25:27.240 "uuid": "ea9cd07e-059a-4f7b-a9ab-64fa4814b32a" 00:25:27.240 } 00:25:27.240 ] 00:25:27.240 } 00:25:27.240 ] 00:25:27.240 03:26:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:27.240 03:26:01 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:25:27.240 [2024-04-25 03:26:01.535509] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:25:27.240 [2024-04-25 03:26:01.535540] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid9398 ] 00:25:27.240 EAL: No free 2048 kB hugepages reported on node 1 00:25:27.240 [2024-04-25 03:26:01.568072] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:25:27.240 [2024-04-25 03:26:01.568144] nvme_rdma.c:2261:nvme_rdma_ctrlr_construct: *DEBUG*: successfully initialized the nvmf ctrlr 00:25:27.240 [2024-04-25 03:26:01.568157] nvme_rdma.c:1291:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: adrfam 1 ai_family 2 00:25:27.240 [2024-04-25 03:26:01.568161] nvme_rdma.c:1295:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: trsvcid is 4420 00:25:27.240 [2024-04-25 03:26:01.568190] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:25:27.240 [2024-04-25 03:26:01.584113] nvme_rdma.c: 510:nvme_rdma_qpair_process_cm_event: *DEBUG*: Requested queue depth 32. Target receive queue depth 32. 00:25:27.240 [2024-04-25 03:26:01.599161] nvme_rdma.c:1180:nvme_rdma_connect_established: *DEBUG*: rc =0 00:25:27.241 [2024-04-25 03:26:01.599170] nvme_rdma.c:1185:nvme_rdma_connect_established: *DEBUG*: RDMA requests created 00:25:27.241 [2024-04-25 03:26:01.599177] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599182] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599186] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599190] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599195] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599199] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599203] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599207] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599211] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599216] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599220] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599224] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599228] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599232] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599236] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599240] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599244] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599249] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599253] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599257] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599261] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599265] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599269] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599274] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599278] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599282] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599286] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599290] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599297] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599301] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599305] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599309] nvme_rdma.c:1199:nvme_rdma_connect_established: *DEBUG*: RDMA responses created 00:25:27.241 [2024-04-25 03:26:01.599314] nvme_rdma.c:1202:nvme_rdma_connect_established: *DEBUG*: rc =0 00:25:27.241 [2024-04-25 03:26:01.599316] nvme_rdma.c:1207:nvme_rdma_connect_established: *DEBUG*: RDMA responses submitted 00:25:27.241 [2024-04-25 03:26:01.599335] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.599347] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf200 len:0x400 key:0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.604860] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.241 [2024-04-25 03:26:01.604870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:25:27.241 [2024-04-25 03:26:01.604877] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.604883] nvme_fabric.c: 622:_nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:25:27.241 [2024-04-25 03:26:01.604889] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:25:27.241 [2024-04-25 03:26:01.604894] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:25:27.241 [2024-04-25 03:26:01.604906] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.604913] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.241 [2024-04-25 03:26:01.604944] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.241 [2024-04-25 03:26:01.604948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:10300 sqhd:0002 p:0 m:0 dnr:0 00:25:27.241 [2024-04-25 03:26:01.604955] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:25:27.241 [2024-04-25 03:26:01.604960] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.604964] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:25:27.241 [2024-04-25 03:26:01.604970] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.604976] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.241 [2024-04-25 03:26:01.605003] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.241 [2024-04-25 03:26:01.605007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1e01007f sqhd:0003 p:0 m:0 dnr:0 00:25:27.241 [2024-04-25 03:26:01.605012] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:25:27.241 [2024-04-25 03:26:01.605016] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.605021] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:25:27.241 [2024-04-25 03:26:01.605026] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.605035] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.241 [2024-04-25 03:26:01.605058] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.241 [2024-04-25 03:26:01.605062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0004 p:0 m:0 dnr:0 00:25:27.241 [2024-04-25 03:26:01.605068] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:25:27.241 [2024-04-25 03:26:01.605072] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.605078] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.605084] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.241 [2024-04-25 03:26:01.605110] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.241 [2024-04-25 03:26:01.605114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0005 p:0 m:0 dnr:0 00:25:27.241 [2024-04-25 03:26:01.605118] nvme_ctrlr.c:3749:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:25:27.241 [2024-04-25 03:26:01.605122] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:25:27.241 [2024-04-25 03:26:01.605126] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.605131] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:25:27.241 [2024-04-25 03:26:01.605235] nvme_ctrlr.c:3942:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:25:27.241 [2024-04-25 03:26:01.605239] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:25:27.241 [2024-04-25 03:26:01.605247] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x573e63ec 00:25:27.241 [2024-04-25 03:26:01.605253] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.242 [2024-04-25 03:26:01.605283] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.242 [2024-04-25 03:26:01.605287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0006 p:0 m:0 dnr:0 00:25:27.242 [2024-04-25 03:26:01.605291] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:25:27.242 [2024-04-25 03:26:01.605295] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x573e63ec 00:25:27.242 [2024-04-25 03:26:01.605301] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x573e63ec 00:25:27.242 [2024-04-25 03:26:01.605307] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.242 [2024-04-25 03:26:01.605331] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.242 [2024-04-25 03:26:01.605336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:25:27.242 [2024-04-25 03:26:01.605340] nvme_ctrlr.c:3784:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:25:27.242 [2024-04-25 03:26:01.605344] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:25:27.242 [2024-04-25 03:26:01.605349] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x573e63ec 00:25:27.242 [2024-04-25 03:26:01.605354] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:25:27.242 [2024-04-25 03:26:01.605365] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:25:27.242 [2024-04-25 03:26:01.605373] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x573e63ec 00:25:27.242 [2024-04-25 03:26:01.605379] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x573e63ec 00:25:27.242 [2024-04-25 03:26:01.605419] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.242 [2024-04-25 03:26:01.605424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0008 p:0 m:0 dnr:0 00:25:27.242 [2024-04-25 03:26:01.605431] nvme_ctrlr.c:1984:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:25:27.242 [2024-04-25 03:26:01.605435] nvme_ctrlr.c:1988:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:25:27.242 [2024-04-25 03:26:01.605439] nvme_ctrlr.c:1991:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:25:27.242 [2024-04-25 03:26:01.605446] nvme_ctrlr.c:2015:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 6 00:25:27.242 [2024-04-25 03:26:01.605451] nvme_ctrlr.c:2030:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:25:27.242 [2024-04-25 03:26:01.605455] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:25:27.242 [2024-04-25 03:26:01.605458] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x573e63ec 00:25:27.242 [2024-04-25 03:26:01.605464] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:25:27.242 [2024-04-25 03:26:01.605470] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x573e63ec 00:25:27.242 [2024-04-25 03:26:01.605476] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.242 [2024-04-25 03:26:01.605502] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.242 [2024-04-25 03:26:01.605506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0009 p:0 m:0 dnr:0 00:25:27.242 [2024-04-25 03:26:01.605513] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0500 length 0x40 lkey 0x573e63ec 00:25:27.242 [2024-04-25 03:26:01.605518] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:27.242 [2024-04-25 03:26:01.605523] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0640 length 0x40 lkey 0x573e63ec 00:25:27.242 [2024-04-25 03:26:01.605528] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:27.242 [2024-04-25 03:26:01.605533] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.242 [2024-04-25 03:26:01.605538] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:27.242 [2024-04-25 03:26:01.605543] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x573e63ec 00:25:27.242 [2024-04-25 03:26:01.605548] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:25:27.242 [2024-04-25 03:26:01.605555] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:25:27.242 [2024-04-25 03:26:01.605559] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x573e63ec 00:25:27.242 [2024-04-25 03:26:01.605567] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:25:27.242 [2024-04-25 03:26:01.605573] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x573e63ec 00:25:27.242 [2024-04-25 03:26:01.605579] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:0 cdw10:0000000f SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.242 [2024-04-25 03:26:01.605607] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.242 [2024-04-25 03:26:01.605611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:2710 sqhd:000a p:0 m:0 dnr:0 00:25:27.242 [2024-04-25 03:26:01.605616] nvme_ctrlr.c:2902:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:25:27.242 [2024-04-25 03:26:01.605620] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:25:27.242 [2024-04-25 03:26:01.605624] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x573e63ec 00:25:27.242 [2024-04-25 03:26:01.605631] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x573e63ec 00:25:27.242 [2024-04-25 03:26:01.605637] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x573e63ec 00:25:27.242 [2024-04-25 03:26:01.605669] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.242 [2024-04-25 03:26:01.605673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000b p:0 m:0 dnr:0 00:25:27.242 [2024-04-25 03:26:01.605678] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x573e63ec 00:25:27.242 [2024-04-25 03:26:01.605685] nvme_ctrlr.c:4036:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:25:27.242 [2024-04-25 03:26:01.605701] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x573e63ec 00:25:27.242 [2024-04-25 03:26:01.605708] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:0 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf000 len:0x400 key:0x573e63ec 00:25:27.242 [2024-04-25 03:26:01.605713] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x573e63ec 00:25:27.242 [2024-04-25 03:26:01.605719] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:25:27.242 [2024-04-25 03:26:01.605747] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.242 [2024-04-25 03:26:01.605752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000c p:0 m:0 dnr:0 00:25:27.242 [2024-04-25 03:26:01.605761] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0b40 length 0x40 lkey 0x573e63ec 00:25:27.242 [2024-04-25 03:26:01.605766] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0xc00 key:0x573e63ec 00:25:27.242 [2024-04-25 03:26:01.605771] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x573e63ec 00:25:27.242 [2024-04-25 03:26:01.605775] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.242 [2024-04-25 03:26:01.605779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:000d p:0 m:0 dnr:0 00:25:27.242 [2024-04-25 03:26:01.605785] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x573e63ec 00:25:27.242 [2024-04-25 03:26:01.605802] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.242 [2024-04-25 03:26:01.605806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:6 cdw0:0 sqhd:000e p:0 m:0 dnr:0 00:25:27.242 [2024-04-25 03:26:01.605814] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x573e63ec 00:25:27.242 [2024-04-25 03:26:01.605819] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:0 cdw10:00010070 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf000 len:0x8 key:0x573e63ec 00:25:27.242 [2024-04-25 03:26:01.605823] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x573e63ec 00:25:27.242 [2024-04-25 03:26:01.605851] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.242 [2024-04-25 03:26:01.605861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:000f p:0 m:0 dnr:0 00:25:27.242 [2024-04-25 03:26:01.605870] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x573e63ec 00:25:27.242 ===================================================== 00:25:27.242 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2014-08.org.nvmexpress.discovery 00:25:27.243 ===================================================== 00:25:27.243 Controller Capabilities/Features 00:25:27.243 ================================ 00:25:27.243 Vendor ID: 0000 00:25:27.243 Subsystem Vendor ID: 0000 00:25:27.243 Serial Number: .................... 00:25:27.243 Model Number: ........................................ 00:25:27.243 Firmware Version: 24.05 00:25:27.243 Recommended Arb Burst: 0 00:25:27.243 IEEE OUI Identifier: 00 00 00 00:25:27.243 Multi-path I/O 00:25:27.243 May have multiple subsystem ports: No 00:25:27.243 May have multiple controllers: No 00:25:27.243 Associated with SR-IOV VF: No 00:25:27.243 Max Data Transfer Size: 131072 00:25:27.243 Max Number of Namespaces: 0 00:25:27.243 Max Number of I/O Queues: 1024 00:25:27.243 NVMe Specification Version (VS): 1.3 00:25:27.243 NVMe Specification Version (Identify): 1.3 00:25:27.243 Maximum Queue Entries: 128 00:25:27.243 Contiguous Queues Required: Yes 00:25:27.243 Arbitration Mechanisms Supported 00:25:27.243 Weighted Round Robin: Not Supported 00:25:27.243 Vendor Specific: Not Supported 00:25:27.243 Reset Timeout: 15000 ms 00:25:27.243 Doorbell Stride: 4 bytes 00:25:27.243 NVM Subsystem Reset: Not Supported 00:25:27.243 Command Sets Supported 00:25:27.243 NVM Command Set: Supported 00:25:27.243 Boot Partition: Not Supported 00:25:27.243 Memory Page Size Minimum: 4096 bytes 00:25:27.243 Memory Page Size Maximum: 4096 bytes 00:25:27.243 Persistent Memory Region: Not Supported 00:25:27.243 Optional Asynchronous Events Supported 00:25:27.243 Namespace Attribute Notices: Not Supported 00:25:27.243 Firmware Activation Notices: Not Supported 00:25:27.243 ANA Change Notices: Not Supported 00:25:27.243 PLE Aggregate Log Change Notices: Not Supported 00:25:27.243 LBA Status Info Alert Notices: Not Supported 00:25:27.243 EGE Aggregate Log Change Notices: Not Supported 00:25:27.243 Normal NVM Subsystem Shutdown event: Not Supported 00:25:27.243 Zone Descriptor Change Notices: Not Supported 00:25:27.243 Discovery Log Change Notices: Supported 00:25:27.243 Controller Attributes 00:25:27.243 128-bit Host Identifier: Not Supported 00:25:27.243 Non-Operational Permissive Mode: Not Supported 00:25:27.243 NVM Sets: Not Supported 00:25:27.243 Read Recovery Levels: Not Supported 00:25:27.243 Endurance Groups: Not Supported 00:25:27.243 Predictable Latency Mode: Not Supported 00:25:27.243 Traffic Based Keep ALive: Not Supported 00:25:27.243 Namespace Granularity: Not Supported 00:25:27.243 SQ Associations: Not Supported 00:25:27.243 UUID List: Not Supported 00:25:27.243 Multi-Domain Subsystem: Not Supported 00:25:27.243 Fixed Capacity Management: Not Supported 00:25:27.243 Variable Capacity Management: Not Supported 00:25:27.243 Delete Endurance Group: Not Supported 00:25:27.243 Delete NVM Set: Not Supported 00:25:27.243 Extended LBA Formats Supported: Not Supported 00:25:27.243 Flexible Data Placement Supported: Not Supported 00:25:27.243 00:25:27.243 Controller Memory Buffer Support 00:25:27.243 ================================ 00:25:27.243 Supported: No 00:25:27.243 00:25:27.243 Persistent Memory Region Support 00:25:27.243 ================================ 00:25:27.243 Supported: No 00:25:27.243 00:25:27.243 Admin Command Set Attributes 00:25:27.243 ============================ 00:25:27.243 Security Send/Receive: Not Supported 00:25:27.243 Format NVM: Not Supported 00:25:27.243 Firmware Activate/Download: Not Supported 00:25:27.243 Namespace Management: Not Supported 00:25:27.243 Device Self-Test: Not Supported 00:25:27.243 Directives: Not Supported 00:25:27.243 NVMe-MI: Not Supported 00:25:27.243 Virtualization Management: Not Supported 00:25:27.243 Doorbell Buffer Config: Not Supported 00:25:27.243 Get LBA Status Capability: Not Supported 00:25:27.243 Command & Feature Lockdown Capability: Not Supported 00:25:27.243 Abort Command Limit: 1 00:25:27.243 Async Event Request Limit: 4 00:25:27.243 Number of Firmware Slots: N/A 00:25:27.243 Firmware Slot 1 Read-Only: N/A 00:25:27.243 Firmware Activation Without Reset: N/A 00:25:27.243 Multiple Update Detection Support: N/A 00:25:27.243 Firmware Update Granularity: No Information Provided 00:25:27.243 Per-Namespace SMART Log: No 00:25:27.243 Asymmetric Namespace Access Log Page: Not Supported 00:25:27.243 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:25:27.243 Command Effects Log Page: Not Supported 00:25:27.243 Get Log Page Extended Data: Supported 00:25:27.243 Telemetry Log Pages: Not Supported 00:25:27.243 Persistent Event Log Pages: Not Supported 00:25:27.243 Supported Log Pages Log Page: May Support 00:25:27.243 Commands Supported & Effects Log Page: Not Supported 00:25:27.243 Feature Identifiers & Effects Log Page:May Support 00:25:27.243 NVMe-MI Commands & Effects Log Page: May Support 00:25:27.243 Data Area 4 for Telemetry Log: Not Supported 00:25:27.243 Error Log Page Entries Supported: 128 00:25:27.243 Keep Alive: Not Supported 00:25:27.243 00:25:27.243 NVM Command Set Attributes 00:25:27.243 ========================== 00:25:27.243 Submission Queue Entry Size 00:25:27.243 Max: 1 00:25:27.243 Min: 1 00:25:27.243 Completion Queue Entry Size 00:25:27.243 Max: 1 00:25:27.243 Min: 1 00:25:27.243 Number of Namespaces: 0 00:25:27.243 Compare Command: Not Supported 00:25:27.243 Write Uncorrectable Command: Not Supported 00:25:27.243 Dataset Management Command: Not Supported 00:25:27.243 Write Zeroes Command: Not Supported 00:25:27.243 Set Features Save Field: Not Supported 00:25:27.243 Reservations: Not Supported 00:25:27.243 Timestamp: Not Supported 00:25:27.243 Copy: Not Supported 00:25:27.243 Volatile Write Cache: Not Present 00:25:27.243 Atomic Write Unit (Normal): 1 00:25:27.243 Atomic Write Unit (PFail): 1 00:25:27.243 Atomic Compare & Write Unit: 1 00:25:27.243 Fused Compare & Write: Supported 00:25:27.243 Scatter-Gather List 00:25:27.243 SGL Command Set: Supported 00:25:27.243 SGL Keyed: Supported 00:25:27.243 SGL Bit Bucket Descriptor: Not Supported 00:25:27.243 SGL Metadata Pointer: Not Supported 00:25:27.243 Oversized SGL: Not Supported 00:25:27.243 SGL Metadata Address: Not Supported 00:25:27.243 SGL Offset: Supported 00:25:27.243 Transport SGL Data Block: Not Supported 00:25:27.243 Replay Protected Memory Block: Not Supported 00:25:27.243 00:25:27.243 Firmware Slot Information 00:25:27.243 ========================= 00:25:27.243 Active slot: 0 00:25:27.243 00:25:27.243 00:25:27.243 Error Log 00:25:27.243 ========= 00:25:27.243 00:25:27.243 Active Namespaces 00:25:27.243 ================= 00:25:27.243 Discovery Log Page 00:25:27.243 ================== 00:25:27.243 Generation Counter: 2 00:25:27.243 Number of Records: 2 00:25:27.243 Record Format: 0 00:25:27.243 00:25:27.243 Discovery Log Entry 0 00:25:27.243 ---------------------- 00:25:27.243 Transport Type: 1 (RDMA) 00:25:27.243 Address Family: 1 (IPv4) 00:25:27.243 Subsystem Type: 3 (Current Discovery Subsystem) 00:25:27.243 Entry Flags: 00:25:27.243 Duplicate Returned Information: 1 00:25:27.243 Explicit Persistent Connection Support for Discovery: 1 00:25:27.243 Transport Requirements: 00:25:27.243 Secure Channel: Not Required 00:25:27.243 Port ID: 0 (0x0000) 00:25:27.243 Controller ID: 65535 (0xffff) 00:25:27.243 Admin Max SQ Size: 128 00:25:27.243 Transport Service Identifier: 4420 00:25:27.243 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:25:27.244 Transport Address: 192.168.100.8 00:25:27.244 Transport Specific Address Subtype - RDMA 00:25:27.244 RDMA QP Service Type: 1 (Reliable Connected) 00:25:27.244 RDMA Provider Type: 1 (No provider specified) 00:25:27.244 RDMA CM Service: 1 (RDMA_CM) 00:25:27.244 Discovery Log Entry 1 00:25:27.244 ---------------------- 00:25:27.244 Transport Type: 1 (RDMA) 00:25:27.244 Address Family: 1 (IPv4) 00:25:27.244 Subsystem Type: 2 (NVM Subsystem) 00:25:27.244 Entry Flags: 00:25:27.244 Duplicate Returned Information: 0 00:25:27.244 Explicit Persistent Connection Support for Discovery: 0 00:25:27.244 Transport Requirements: 00:25:27.244 Secure Channel: Not Required 00:25:27.244 Port ID: 0 (0x0000) 00:25:27.244 Controller ID: 65535 (0xffff) 00:25:27.244 Admin Max SQ Size: [2024-04-25 03:26:01.605936] nvme_ctrlr.c:4221:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:25:27.244 [2024-04-25 03:26:01.605944] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 3243 doesn't match qid 00:25:27.244 [2024-04-25 03:26:01.605956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32547 cdw0:5 sqhd:e790 p:0 m:0 dnr:0 00:25:27.244 [2024-04-25 03:26:01.605960] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 3243 doesn't match qid 00:25:27.244 [2024-04-25 03:26:01.605966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32547 cdw0:5 sqhd:e790 p:0 m:0 dnr:0 00:25:27.244 [2024-04-25 03:26:01.605970] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 3243 doesn't match qid 00:25:27.244 [2024-04-25 03:26:01.605976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32547 cdw0:5 sqhd:e790 p:0 m:0 dnr:0 00:25:27.244 [2024-04-25 03:26:01.605980] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 3243 doesn't match qid 00:25:27.244 [2024-04-25 03:26:01.605986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32547 cdw0:5 sqhd:e790 p:0 m:0 dnr:0 00:25:27.244 [2024-04-25 03:26:01.605993] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x573e63ec 00:25:27.244 [2024-04-25 03:26:01.606000] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:4 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.244 [2024-04-25 03:26:01.606028] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.244 [2024-04-25 03:26:01.606033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:4 cdw0:460001 sqhd:0010 p:0 m:0 dnr:0 00:25:27.244 [2024-04-25 03:26:01.606041] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.244 [2024-04-25 03:26:01.606047] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.244 [2024-04-25 03:26:01.606051] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x573e63ec 00:25:27.244 [2024-04-25 03:26:01.606077] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.244 [2024-04-25 03:26:01.606081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:0 sqhd:0011 p:0 m:0 dnr:0 00:25:27.244 [2024-04-25 03:26:01.606086] nvme_ctrlr.c:1082:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:25:27.244 [2024-04-25 03:26:01.606090] nvme_ctrlr.c:1085:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:25:27.244 [2024-04-25 03:26:01.606095] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x573e63ec 00:25:27.244 [2024-04-25 03:26:01.606101] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.244 [2024-04-25 03:26:01.606107] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.244 [2024-04-25 03:26:01.606131] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.244 [2024-04-25 03:26:01.606135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:25:27.244 [2024-04-25 03:26:01.606140] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x573e63ec 00:25:27.244 [2024-04-25 03:26:01.606147] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.244 [2024-04-25 03:26:01.606153] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.244 [2024-04-25 03:26:01.606176] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.244 [2024-04-25 03:26:01.606180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:25:27.244 [2024-04-25 03:26:01.606184] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x573e63ec 00:25:27.244 [2024-04-25 03:26:01.606190] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.244 [2024-04-25 03:26:01.606196] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.244 [2024-04-25 03:26:01.606221] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.244 [2024-04-25 03:26:01.606226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:25:27.244 [2024-04-25 03:26:01.606230] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x573e63ec 00:25:27.244 [2024-04-25 03:26:01.606236] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.244 [2024-04-25 03:26:01.606242] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.244 [2024-04-25 03:26:01.606269] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.244 [2024-04-25 03:26:01.606274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:25:27.244 [2024-04-25 03:26:01.606278] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x573e63ec 00:25:27.244 [2024-04-25 03:26:01.606285] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.244 [2024-04-25 03:26:01.606291] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.244 [2024-04-25 03:26:01.606319] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.244 [2024-04-25 03:26:01.606323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:25:27.244 [2024-04-25 03:26:01.606328] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x573e63ec 00:25:27.244 [2024-04-25 03:26:01.606334] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.244 [2024-04-25 03:26:01.606340] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.244 [2024-04-25 03:26:01.606363] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.244 [2024-04-25 03:26:01.606369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:25:27.244 [2024-04-25 03:26:01.606374] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x573e63ec 00:25:27.244 [2024-04-25 03:26:01.606380] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.244 [2024-04-25 03:26:01.606386] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.244 [2024-04-25 03:26:01.606411] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.244 [2024-04-25 03:26:01.606415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:25:27.244 [2024-04-25 03:26:01.606420] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x573e63ec 00:25:27.244 [2024-04-25 03:26:01.606426] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.244 [2024-04-25 03:26:01.606432] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.244 [2024-04-25 03:26:01.606461] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.244 [2024-04-25 03:26:01.606466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:25:27.244 [2024-04-25 03:26:01.606470] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x573e63ec 00:25:27.244 [2024-04-25 03:26:01.606476] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.244 [2024-04-25 03:26:01.606482] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.244 [2024-04-25 03:26:01.606504] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.244 [2024-04-25 03:26:01.606508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:25:27.244 [2024-04-25 03:26:01.606512] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x573e63ec 00:25:27.244 [2024-04-25 03:26:01.606519] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.244 [2024-04-25 03:26:01.606525] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.244 [2024-04-25 03:26:01.606550] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.245 [2024-04-25 03:26:01.606554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:25:27.245 [2024-04-25 03:26:01.606558] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x573e63ec 00:25:27.245 [2024-04-25 03:26:01.606565] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.245 [2024-04-25 03:26:01.606570] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.245 [2024-04-25 03:26:01.606601] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.245 [2024-04-25 03:26:01.606605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:25:27.245 [2024-04-25 03:26:01.606610] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x573e63ec 00:25:27.245 [2024-04-25 03:26:01.606616] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.245 [2024-04-25 03:26:01.606622] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.245 [2024-04-25 03:26:01.606646] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.245 [2024-04-25 03:26:01.606650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:25:27.245 [2024-04-25 03:26:01.606654] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x573e63ec 00:25:27.245 [2024-04-25 03:26:01.606661] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.245 [2024-04-25 03:26:01.606666] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.245 [2024-04-25 03:26:01.606691] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.245 [2024-04-25 03:26:01.606696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:25:27.245 [2024-04-25 03:26:01.606700] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x573e63ec 00:25:27.245 [2024-04-25 03:26:01.606706] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.245 [2024-04-25 03:26:01.606712] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.245 [2024-04-25 03:26:01.606735] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.245 [2024-04-25 03:26:01.606739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:25:27.245 [2024-04-25 03:26:01.606744] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x573e63ec 00:25:27.245 [2024-04-25 03:26:01.606750] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.245 [2024-04-25 03:26:01.606756] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.245 [2024-04-25 03:26:01.606782] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.245 [2024-04-25 03:26:01.606786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:25:27.245 [2024-04-25 03:26:01.606791] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x573e63ec 00:25:27.245 [2024-04-25 03:26:01.606797] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.245 [2024-04-25 03:26:01.606803] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.245 [2024-04-25 03:26:01.606832] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.245 [2024-04-25 03:26:01.606836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:25:27.245 [2024-04-25 03:26:01.606840] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x573e63ec 00:25:27.245 [2024-04-25 03:26:01.606847] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.245 [2024-04-25 03:26:01.606853] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.245 [2024-04-25 03:26:01.606880] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.245 [2024-04-25 03:26:01.606884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:25:27.245 [2024-04-25 03:26:01.606889] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x573e63ec 00:25:27.245 [2024-04-25 03:26:01.606895] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.245 [2024-04-25 03:26:01.606901] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.245 [2024-04-25 03:26:01.606925] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.245 [2024-04-25 03:26:01.606929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:25:27.245 [2024-04-25 03:26:01.606933] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x573e63ec 00:25:27.245 [2024-04-25 03:26:01.606940] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.245 [2024-04-25 03:26:01.606946] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.245 [2024-04-25 03:26:01.606968] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.245 [2024-04-25 03:26:01.606972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:25:27.245 [2024-04-25 03:26:01.606976] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x573e63ec 00:25:27.245 [2024-04-25 03:26:01.606983] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.245 [2024-04-25 03:26:01.606989] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.245 [2024-04-25 03:26:01.607014] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.245 [2024-04-25 03:26:01.607017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:25:27.245 [2024-04-25 03:26:01.607022] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x573e63ec 00:25:27.245 [2024-04-25 03:26:01.607028] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.245 [2024-04-25 03:26:01.607034] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.245 [2024-04-25 03:26:01.607063] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.245 [2024-04-25 03:26:01.607067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:25:27.245 [2024-04-25 03:26:01.607072] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x573e63ec 00:25:27.245 [2024-04-25 03:26:01.607078] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.246 [2024-04-25 03:26:01.607084] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.246 [2024-04-25 03:26:01.607112] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.246 [2024-04-25 03:26:01.607116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:25:27.246 [2024-04-25 03:26:01.607120] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x573e63ec 00:25:27.246 [2024-04-25 03:26:01.607126] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.246 [2024-04-25 03:26:01.607132] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.246 [2024-04-25 03:26:01.607160] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.246 [2024-04-25 03:26:01.607164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:25:27.246 [2024-04-25 03:26:01.607168] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x573e63ec 00:25:27.246 [2024-04-25 03:26:01.607175] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.246 [2024-04-25 03:26:01.607182] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.246 [2024-04-25 03:26:01.607207] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.246 [2024-04-25 03:26:01.607211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0009 p:0 m:0 dnr:0 00:25:27.246 [2024-04-25 03:26:01.607215] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x573e63ec 00:25:27.246 [2024-04-25 03:26:01.607222] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.246 [2024-04-25 03:26:01.607228] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.246 [2024-04-25 03:26:01.607254] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.246 [2024-04-25 03:26:01.607258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000a p:0 m:0 dnr:0 00:25:27.246 [2024-04-25 03:26:01.607262] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x573e63ec 00:25:27.246 [2024-04-25 03:26:01.607269] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.246 [2024-04-25 03:26:01.607275] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.246 [2024-04-25 03:26:01.607304] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.246 [2024-04-25 03:26:01.607308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000b p:0 m:0 dnr:0 00:25:27.246 [2024-04-25 03:26:01.607312] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x573e63ec 00:25:27.246 [2024-04-25 03:26:01.607319] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.246 [2024-04-25 03:26:01.607325] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.246 [2024-04-25 03:26:01.607351] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.246 [2024-04-25 03:26:01.607355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000c p:0 m:0 dnr:0 00:25:27.246 [2024-04-25 03:26:01.607359] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x573e63ec 00:25:27.246 [2024-04-25 03:26:01.607366] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.246 [2024-04-25 03:26:01.607371] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.246 [2024-04-25 03:26:01.607398] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.246 [2024-04-25 03:26:01.607402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000d p:0 m:0 dnr:0 00:25:27.246 [2024-04-25 03:26:01.607406] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x573e63ec 00:25:27.246 [2024-04-25 03:26:01.607412] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.246 [2024-04-25 03:26:01.607418] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.246 [2024-04-25 03:26:01.607446] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.246 [2024-04-25 03:26:01.607450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000e p:0 m:0 dnr:0 00:25:27.246 [2024-04-25 03:26:01.607454] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x573e63ec 00:25:27.246 [2024-04-25 03:26:01.607461] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.246 [2024-04-25 03:26:01.607468] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.246 [2024-04-25 03:26:01.607495] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.246 [2024-04-25 03:26:01.607499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000f p:0 m:0 dnr:0 00:25:27.246 [2024-04-25 03:26:01.607503] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x573e63ec 00:25:27.246 [2024-04-25 03:26:01.607509] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.246 [2024-04-25 03:26:01.607515] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.246 [2024-04-25 03:26:01.607537] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.246 [2024-04-25 03:26:01.607541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0010 p:0 m:0 dnr:0 00:25:27.246 [2024-04-25 03:26:01.607545] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x573e63ec 00:25:27.246 [2024-04-25 03:26:01.607552] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.246 [2024-04-25 03:26:01.607558] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.246 [2024-04-25 03:26:01.607590] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.246 [2024-04-25 03:26:01.607594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0011 p:0 m:0 dnr:0 00:25:27.246 [2024-04-25 03:26:01.607598] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x573e63ec 00:25:27.246 [2024-04-25 03:26:01.607604] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.246 [2024-04-25 03:26:01.607610] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.246 [2024-04-25 03:26:01.607635] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.246 [2024-04-25 03:26:01.607639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:25:27.246 [2024-04-25 03:26:01.607643] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x573e63ec 00:25:27.246 [2024-04-25 03:26:01.607650] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.246 [2024-04-25 03:26:01.607656] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.246 [2024-04-25 03:26:01.607684] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.246 [2024-04-25 03:26:01.607688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:25:27.246 [2024-04-25 03:26:01.607692] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x573e63ec 00:25:27.246 [2024-04-25 03:26:01.607698] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.246 [2024-04-25 03:26:01.607704] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.246 [2024-04-25 03:26:01.607729] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.246 [2024-04-25 03:26:01.607733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:25:27.247 [2024-04-25 03:26:01.607737] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.607745] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.607751] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.247 [2024-04-25 03:26:01.607778] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.247 [2024-04-25 03:26:01.607782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:25:27.247 [2024-04-25 03:26:01.607786] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.607792] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.607798] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.247 [2024-04-25 03:26:01.607821] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.247 [2024-04-25 03:26:01.607825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:25:27.247 [2024-04-25 03:26:01.607830] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.607836] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.607842] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.247 [2024-04-25 03:26:01.607874] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.247 [2024-04-25 03:26:01.607878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:25:27.247 [2024-04-25 03:26:01.607882] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.607889] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.607895] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.247 [2024-04-25 03:26:01.607920] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.247 [2024-04-25 03:26:01.607924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:25:27.247 [2024-04-25 03:26:01.607928] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.607935] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.607941] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.247 [2024-04-25 03:26:01.607964] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.247 [2024-04-25 03:26:01.607968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:25:27.247 [2024-04-25 03:26:01.607972] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.607979] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.607985] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.247 [2024-04-25 03:26:01.608010] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.247 [2024-04-25 03:26:01.608014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:25:27.247 [2024-04-25 03:26:01.608019] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.608026] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.608032] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.247 [2024-04-25 03:26:01.608054] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.247 [2024-04-25 03:26:01.608058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:25:27.247 [2024-04-25 03:26:01.608062] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.608069] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.608074] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.247 [2024-04-25 03:26:01.608097] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.247 [2024-04-25 03:26:01.608100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:25:27.247 [2024-04-25 03:26:01.608105] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.608111] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.608117] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.247 [2024-04-25 03:26:01.608142] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.247 [2024-04-25 03:26:01.608146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:25:27.247 [2024-04-25 03:26:01.608150] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.608157] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.608162] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.247 [2024-04-25 03:26:01.608184] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.247 [2024-04-25 03:26:01.608188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:25:27.247 [2024-04-25 03:26:01.608193] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.608199] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.608205] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.247 [2024-04-25 03:26:01.608231] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.247 [2024-04-25 03:26:01.608235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:25:27.247 [2024-04-25 03:26:01.608240] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.608246] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.608252] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.247 [2024-04-25 03:26:01.608280] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.247 [2024-04-25 03:26:01.608284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:25:27.247 [2024-04-25 03:26:01.608290] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.608296] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.608302] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.247 [2024-04-25 03:26:01.608333] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.247 [2024-04-25 03:26:01.608337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:25:27.247 [2024-04-25 03:26:01.608341] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.608348] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.608353] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.247 [2024-04-25 03:26:01.608380] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.247 [2024-04-25 03:26:01.608384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:25:27.247 [2024-04-25 03:26:01.608388] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.608394] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.608400] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.247 [2024-04-25 03:26:01.608424] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.247 [2024-04-25 03:26:01.608428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:25:27.247 [2024-04-25 03:26:01.608432] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.608439] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.247 [2024-04-25 03:26:01.608444] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.247 [2024-04-25 03:26:01.608472] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.248 [2024-04-25 03:26:01.608476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:25:27.248 [2024-04-25 03:26:01.608481] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x573e63ec 00:25:27.248 [2024-04-25 03:26:01.608487] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.248 [2024-04-25 03:26:01.608493] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.248 [2024-04-25 03:26:01.608524] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.248 [2024-04-25 03:26:01.608528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:25:27.248 [2024-04-25 03:26:01.608532] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x573e63ec 00:25:27.248 [2024-04-25 03:26:01.608538] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.248 [2024-04-25 03:26:01.608544] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.248 [2024-04-25 03:26:01.608574] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.248 [2024-04-25 03:26:01.608579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:25:27.248 [2024-04-25 03:26:01.608583] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x573e63ec 00:25:27.248 [2024-04-25 03:26:01.608590] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.248 [2024-04-25 03:26:01.608596] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.248 [2024-04-25 03:26:01.608618] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.248 [2024-04-25 03:26:01.608621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:25:27.248 [2024-04-25 03:26:01.608626] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x573e63ec 00:25:27.248 [2024-04-25 03:26:01.608632] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.248 [2024-04-25 03:26:01.608638] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.248 [2024-04-25 03:26:01.608661] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.248 [2024-04-25 03:26:01.608665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:25:27.248 [2024-04-25 03:26:01.608670] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x573e63ec 00:25:27.248 [2024-04-25 03:26:01.608676] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.248 [2024-04-25 03:26:01.608683] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.248 [2024-04-25 03:26:01.608710] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.248 [2024-04-25 03:26:01.608715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0009 p:0 m:0 dnr:0 00:25:27.248 [2024-04-25 03:26:01.608719] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x573e63ec 00:25:27.248 [2024-04-25 03:26:01.608726] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.248 [2024-04-25 03:26:01.608732] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.248 [2024-04-25 03:26:01.608764] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.248 [2024-04-25 03:26:01.608768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000a p:0 m:0 dnr:0 00:25:27.248 [2024-04-25 03:26:01.608773] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x573e63ec 00:25:27.248 [2024-04-25 03:26:01.608779] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.248 [2024-04-25 03:26:01.608785] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.248 [2024-04-25 03:26:01.608809] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.248 [2024-04-25 03:26:01.608813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000b p:0 m:0 dnr:0 00:25:27.248 [2024-04-25 03:26:01.608817] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x573e63ec 00:25:27.248 [2024-04-25 03:26:01.608823] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.248 [2024-04-25 03:26:01.608829] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.248 [2024-04-25 03:26:01.612860] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.248 [2024-04-25 03:26:01.612866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000c p:0 m:0 dnr:0 00:25:27.248 [2024-04-25 03:26:01.612871] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x573e63ec 00:25:27.248 [2024-04-25 03:26:01.612877] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x573e63ec 00:25:27.248 [2024-04-25 03:26:01.612884] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.248 [2024-04-25 03:26:01.612907] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.248 [2024-04-25 03:26:01.612911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:9 sqhd:000d p:0 m:0 dnr:0 00:25:27.248 [2024-04-25 03:26:01.612915] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x573e63ec 00:25:27.248 [2024-04-25 03:26:01.612920] nvme_ctrlr.c:1204:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 6 milliseconds 00:25:27.248 128 00:25:27.248 Transport Service Identifier: 4420 00:25:27.248 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:25:27.248 Transport Address: 192.168.100.8 00:25:27.248 Transport Specific Address Subtype - RDMA 00:25:27.248 RDMA QP Service Type: 1 (Reliable Connected) 00:25:27.248 RDMA Provider Type: 1 (No provider specified) 00:25:27.248 RDMA CM Service: 1 (RDMA_CM) 00:25:27.248 03:26:01 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:25:27.248 [2024-04-25 03:26:01.675415] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:25:27.248 [2024-04-25 03:26:01.675461] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid9477 ] 00:25:27.248 EAL: No free 2048 kB hugepages reported on node 1 00:25:27.248 [2024-04-25 03:26:01.706653] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:25:27.248 [2024-04-25 03:26:01.706717] nvme_rdma.c:2261:nvme_rdma_ctrlr_construct: *DEBUG*: successfully initialized the nvmf ctrlr 00:25:27.248 [2024-04-25 03:26:01.706729] nvme_rdma.c:1291:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: adrfam 1 ai_family 2 00:25:27.248 [2024-04-25 03:26:01.706734] nvme_rdma.c:1295:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: trsvcid is 4420 00:25:27.248 [2024-04-25 03:26:01.706755] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:25:27.248 [2024-04-25 03:26:01.723117] nvme_rdma.c: 510:nvme_rdma_qpair_process_cm_event: *DEBUG*: Requested queue depth 32. Target receive queue depth 32. 00:25:27.510 [2024-04-25 03:26:01.738160] nvme_rdma.c:1180:nvme_rdma_connect_established: *DEBUG*: rc =0 00:25:27.510 [2024-04-25 03:26:01.738170] nvme_rdma.c:1185:nvme_rdma_connect_established: *DEBUG*: RDMA requests created 00:25:27.510 [2024-04-25 03:26:01.738175] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x52d8f393 00:25:27.510 [2024-04-25 03:26:01.738180] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x52d8f393 00:25:27.510 [2024-04-25 03:26:01.738184] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x52d8f393 00:25:27.510 [2024-04-25 03:26:01.738189] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x52d8f393 00:25:27.510 [2024-04-25 03:26:01.738195] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x52d8f393 00:25:27.510 [2024-04-25 03:26:01.738200] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x52d8f393 00:25:27.510 [2024-04-25 03:26:01.738204] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x52d8f393 00:25:27.510 [2024-04-25 03:26:01.738208] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x52d8f393 00:25:27.510 [2024-04-25 03:26:01.738212] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x52d8f393 00:25:27.510 [2024-04-25 03:26:01.738216] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x52d8f393 00:25:27.510 [2024-04-25 03:26:01.738220] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x52d8f393 00:25:27.510 [2024-04-25 03:26:01.738225] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.738229] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.738233] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.738237] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.738241] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.738245] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.738250] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.738254] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.738258] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.738262] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.738266] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.738271] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.738275] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.738279] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.738283] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.738287] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.738291] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.738296] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.738300] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.738304] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.738308] nvme_rdma.c:1199:nvme_rdma_connect_established: *DEBUG*: RDMA responses created 00:25:27.511 [2024-04-25 03:26:01.738312] nvme_rdma.c:1202:nvme_rdma_connect_established: *DEBUG*: rc =0 00:25:27.511 [2024-04-25 03:26:01.738315] nvme_rdma.c:1207:nvme_rdma_connect_established: *DEBUG*: RDMA responses submitted 00:25:27.511 [2024-04-25 03:26:01.738328] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.738341] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf200 len:0x400 key:0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.743861] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.511 [2024-04-25 03:26:01.743869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:25:27.511 [2024-04-25 03:26:01.743875] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.743880] nvme_fabric.c: 622:_nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:25:27.511 [2024-04-25 03:26:01.743885] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:25:27.511 [2024-04-25 03:26:01.743890] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:25:27.511 [2024-04-25 03:26:01.743901] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.743908] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.511 [2024-04-25 03:26:01.743939] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.511 [2024-04-25 03:26:01.743943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:10300 sqhd:0002 p:0 m:0 dnr:0 00:25:27.511 [2024-04-25 03:26:01.743950] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:25:27.511 [2024-04-25 03:26:01.743954] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.743959] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:25:27.511 [2024-04-25 03:26:01.743965] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.743971] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.511 [2024-04-25 03:26:01.744002] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.511 [2024-04-25 03:26:01.744006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1e01007f sqhd:0003 p:0 m:0 dnr:0 00:25:27.511 [2024-04-25 03:26:01.744011] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:25:27.511 [2024-04-25 03:26:01.744014] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.744020] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:25:27.511 [2024-04-25 03:26:01.744025] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.744031] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.511 [2024-04-25 03:26:01.744058] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.511 [2024-04-25 03:26:01.744062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0004 p:0 m:0 dnr:0 00:25:27.511 [2024-04-25 03:26:01.744067] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:25:27.511 [2024-04-25 03:26:01.744070] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.744077] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.744083] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.511 [2024-04-25 03:26:01.744110] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.511 [2024-04-25 03:26:01.744114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0005 p:0 m:0 dnr:0 00:25:27.511 [2024-04-25 03:26:01.744118] nvme_ctrlr.c:3749:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:25:27.511 [2024-04-25 03:26:01.744122] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:25:27.511 [2024-04-25 03:26:01.744126] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.744131] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:25:27.511 [2024-04-25 03:26:01.744236] nvme_ctrlr.c:3942:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:25:27.511 [2024-04-25 03:26:01.744239] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:25:27.511 [2024-04-25 03:26:01.744246] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.744251] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.511 [2024-04-25 03:26:01.744282] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.511 [2024-04-25 03:26:01.744287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0006 p:0 m:0 dnr:0 00:25:27.511 [2024-04-25 03:26:01.744291] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:25:27.511 [2024-04-25 03:26:01.744295] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.744301] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.744307] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.511 [2024-04-25 03:26:01.744334] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.511 [2024-04-25 03:26:01.744338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:25:27.511 [2024-04-25 03:26:01.744342] nvme_ctrlr.c:3784:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:25:27.511 [2024-04-25 03:26:01.744346] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:25:27.511 [2024-04-25 03:26:01.744350] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.744355] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:25:27.511 [2024-04-25 03:26:01.744361] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:25:27.511 [2024-04-25 03:26:01.744368] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.744374] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.744421] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.511 [2024-04-25 03:26:01.744425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0008 p:0 m:0 dnr:0 00:25:27.511 [2024-04-25 03:26:01.744433] nvme_ctrlr.c:1984:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:25:27.511 [2024-04-25 03:26:01.744437] nvme_ctrlr.c:1988:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:25:27.511 [2024-04-25 03:26:01.744440] nvme_ctrlr.c:1991:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:25:27.511 [2024-04-25 03:26:01.744446] nvme_ctrlr.c:2015:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 6 00:25:27.511 [2024-04-25 03:26:01.744450] nvme_ctrlr.c:2030:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:25:27.511 [2024-04-25 03:26:01.744454] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:25:27.511 [2024-04-25 03:26:01.744457] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.744463] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:25:27.511 [2024-04-25 03:26:01.744469] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x52d8f393 00:25:27.511 [2024-04-25 03:26:01.744475] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.512 [2024-04-25 03:26:01.744502] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.512 [2024-04-25 03:26:01.744506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0009 p:0 m:0 dnr:0 00:25:27.512 [2024-04-25 03:26:01.744512] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0500 length 0x40 lkey 0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.744517] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:27.512 [2024-04-25 03:26:01.744522] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0640 length 0x40 lkey 0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.744527] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:27.512 [2024-04-25 03:26:01.744533] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.744538] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:27.512 [2024-04-25 03:26:01.744543] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.744548] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:25:27.512 [2024-04-25 03:26:01.744552] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:25:27.512 [2024-04-25 03:26:01.744556] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.744564] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:25:27.512 [2024-04-25 03:26:01.744569] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.744576] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:0 cdw10:0000000f SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.512 [2024-04-25 03:26:01.744605] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.512 [2024-04-25 03:26:01.744610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:2710 sqhd:000a p:0 m:0 dnr:0 00:25:27.512 [2024-04-25 03:26:01.744614] nvme_ctrlr.c:2902:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:25:27.512 [2024-04-25 03:26:01.744620] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:25:27.512 [2024-04-25 03:26:01.744624] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.744629] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:25:27.512 [2024-04-25 03:26:01.744635] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:25:27.512 [2024-04-25 03:26:01.744640] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.744646] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:0 cdw10:00000007 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.512 [2024-04-25 03:26:01.744675] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.512 [2024-04-25 03:26:01.744679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:7e007e sqhd:000b p:0 m:0 dnr:0 00:25:27.512 [2024-04-25 03:26:01.744718] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:25:27.512 [2024-04-25 03:26:01.744722] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.744728] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:25:27.512 [2024-04-25 03:26:01.744735] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.744741] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000002 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cc000 len:0x1000 key:0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.744771] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.512 [2024-04-25 03:26:01.744775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000c p:0 m:0 dnr:0 00:25:27.512 [2024-04-25 03:26:01.744785] nvme_ctrlr.c:4557:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:25:27.512 [2024-04-25 03:26:01.744800] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:25:27.512 [2024-04-25 03:26:01.744804] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.744810] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:25:27.512 [2024-04-25 03:26:01.744817] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.744822] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:1 cdw10:00000000 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.744859] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.512 [2024-04-25 03:26:01.744864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000d p:0 m:0 dnr:0 00:25:27.512 [2024-04-25 03:26:01.744875] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:25:27.512 [2024-04-25 03:26:01.744880] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.744886] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:25:27.512 [2024-04-25 03:26:01.744894] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.744901] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:1 cdw10:00000003 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.744934] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.512 [2024-04-25 03:26:01.744938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000e p:0 m:0 dnr:0 00:25:27.512 [2024-04-25 03:26:01.744945] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:25:27.512 [2024-04-25 03:26:01.744949] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.744954] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:25:27.512 [2024-04-25 03:26:01.744961] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:25:27.512 [2024-04-25 03:26:01.744966] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:25:27.512 [2024-04-25 03:26:01.744971] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:25:27.512 [2024-04-25 03:26:01.744975] nvme_ctrlr.c:2990:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:25:27.512 [2024-04-25 03:26:01.744978] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:25:27.512 [2024-04-25 03:26:01.744983] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:25:27.512 [2024-04-25 03:26:01.744995] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.745001] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:0 cdw10:00000001 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.512 [2024-04-25 03:26:01.745007] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.745012] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:25:27.512 [2024-04-25 03:26:01.745034] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.512 [2024-04-25 03:26:01.745039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000f p:0 m:0 dnr:0 00:25:27.512 [2024-04-25 03:26:01.745043] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.745049] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.745055] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:0 cdw10:00000002 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.512 [2024-04-25 03:26:01.745061] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.512 [2024-04-25 03:26:01.745065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:0010 p:0 m:0 dnr:0 00:25:27.512 [2024-04-25 03:26:01.745069] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.745083] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.512 [2024-04-25 03:26:01.745088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0011 p:0 m:0 dnr:0 00:25:27.512 [2024-04-25 03:26:01.745093] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.745100] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.745106] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:0 cdw10:00000004 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.512 [2024-04-25 03:26:01.745136] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.512 [2024-04-25 03:26:01.745140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0012 p:0 m:0 dnr:0 00:25:27.512 [2024-04-25 03:26:01.745145] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.745151] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.745157] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:0 cdw10:00000007 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.512 [2024-04-25 03:26:01.745181] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.512 [2024-04-25 03:26:01.745185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:7e007e sqhd:0013 p:0 m:0 dnr:0 00:25:27.512 [2024-04-25 03:26:01.745189] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.745197] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x52d8f393 00:25:27.512 [2024-04-25 03:26:01.745203] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:0 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003c9000 len:0x2000 key:0x52d8f393 00:25:27.513 [2024-04-25 03:26:01.745210] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x52d8f393 00:25:27.513 [2024-04-25 03:26:01.745215] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf000 len:0x200 key:0x52d8f393 00:25:27.513 [2024-04-25 03:26:01.745222] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0b40 length 0x40 lkey 0x52d8f393 00:25:27.513 [2024-04-25 03:26:01.745227] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x200 key:0x52d8f393 00:25:27.513 [2024-04-25 03:26:01.745234] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0c80 length 0x40 lkey 0x52d8f393 00:25:27.513 [2024-04-25 03:26:01.745240] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003c7000 len:0x1000 key:0x52d8f393 00:25:27.513 [2024-04-25 03:26:01.745246] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.513 [2024-04-25 03:26:01.745251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0014 p:0 m:0 dnr:0 00:25:27.513 [2024-04-25 03:26:01.745261] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x52d8f393 00:25:27.513 [2024-04-25 03:26:01.745266] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.513 [2024-04-25 03:26:01.745270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:0015 p:0 m:0 dnr:0 00:25:27.513 [2024-04-25 03:26:01.745277] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x52d8f393 00:25:27.513 [2024-04-25 03:26:01.745294] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.513 [2024-04-25 03:26:01.745299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:6 cdw0:0 sqhd:0016 p:0 m:0 dnr:0 00:25:27.513 [2024-04-25 03:26:01.745305] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x52d8f393 00:25:27.513 [2024-04-25 03:26:01.745309] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.513 [2024-04-25 03:26:01.745313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:7 cdw0:0 sqhd:0017 p:0 m:0 dnr:0 00:25:27.513 [2024-04-25 03:26:01.745321] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x52d8f393 00:25:27.513 ===================================================== 00:25:27.513 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:25:27.513 ===================================================== 00:25:27.513 Controller Capabilities/Features 00:25:27.513 ================================ 00:25:27.513 Vendor ID: 8086 00:25:27.513 Subsystem Vendor ID: 8086 00:25:27.513 Serial Number: SPDK00000000000001 00:25:27.513 Model Number: SPDK bdev Controller 00:25:27.513 Firmware Version: 24.05 00:25:27.513 Recommended Arb Burst: 6 00:25:27.513 IEEE OUI Identifier: e4 d2 5c 00:25:27.513 Multi-path I/O 00:25:27.513 May have multiple subsystem ports: Yes 00:25:27.513 May have multiple controllers: Yes 00:25:27.513 Associated with SR-IOV VF: No 00:25:27.513 Max Data Transfer Size: 131072 00:25:27.513 Max Number of Namespaces: 32 00:25:27.513 Max Number of I/O Queues: 127 00:25:27.513 NVMe Specification Version (VS): 1.3 00:25:27.513 NVMe Specification Version (Identify): 1.3 00:25:27.513 Maximum Queue Entries: 128 00:25:27.513 Contiguous Queues Required: Yes 00:25:27.513 Arbitration Mechanisms Supported 00:25:27.513 Weighted Round Robin: Not Supported 00:25:27.513 Vendor Specific: Not Supported 00:25:27.513 Reset Timeout: 15000 ms 00:25:27.513 Doorbell Stride: 4 bytes 00:25:27.513 NVM Subsystem Reset: Not Supported 00:25:27.513 Command Sets Supported 00:25:27.513 NVM Command Set: Supported 00:25:27.513 Boot Partition: Not Supported 00:25:27.513 Memory Page Size Minimum: 4096 bytes 00:25:27.513 Memory Page Size Maximum: 4096 bytes 00:25:27.513 Persistent Memory Region: Not Supported 00:25:27.513 Optional Asynchronous Events Supported 00:25:27.513 Namespace Attribute Notices: Supported 00:25:27.513 Firmware Activation Notices: Not Supported 00:25:27.513 ANA Change Notices: Not Supported 00:25:27.513 PLE Aggregate Log Change Notices: Not Supported 00:25:27.513 LBA Status Info Alert Notices: Not Supported 00:25:27.513 EGE Aggregate Log Change Notices: Not Supported 00:25:27.513 Normal NVM Subsystem Shutdown event: Not Supported 00:25:27.513 Zone Descriptor Change Notices: Not Supported 00:25:27.513 Discovery Log Change Notices: Not Supported 00:25:27.513 Controller Attributes 00:25:27.513 128-bit Host Identifier: Supported 00:25:27.513 Non-Operational Permissive Mode: Not Supported 00:25:27.513 NVM Sets: Not Supported 00:25:27.513 Read Recovery Levels: Not Supported 00:25:27.513 Endurance Groups: Not Supported 00:25:27.513 Predictable Latency Mode: Not Supported 00:25:27.513 Traffic Based Keep ALive: Not Supported 00:25:27.513 Namespace Granularity: Not Supported 00:25:27.513 SQ Associations: Not Supported 00:25:27.513 UUID List: Not Supported 00:25:27.513 Multi-Domain Subsystem: Not Supported 00:25:27.513 Fixed Capacity Management: Not Supported 00:25:27.513 Variable Capacity Management: Not Supported 00:25:27.513 Delete Endurance Group: Not Supported 00:25:27.513 Delete NVM Set: Not Supported 00:25:27.513 Extended LBA Formats Supported: Not Supported 00:25:27.513 Flexible Data Placement Supported: Not Supported 00:25:27.513 00:25:27.513 Controller Memory Buffer Support 00:25:27.513 ================================ 00:25:27.513 Supported: No 00:25:27.513 00:25:27.513 Persistent Memory Region Support 00:25:27.513 ================================ 00:25:27.513 Supported: No 00:25:27.513 00:25:27.513 Admin Command Set Attributes 00:25:27.513 ============================ 00:25:27.513 Security Send/Receive: Not Supported 00:25:27.513 Format NVM: Not Supported 00:25:27.513 Firmware Activate/Download: Not Supported 00:25:27.513 Namespace Management: Not Supported 00:25:27.513 Device Self-Test: Not Supported 00:25:27.513 Directives: Not Supported 00:25:27.513 NVMe-MI: Not Supported 00:25:27.513 Virtualization Management: Not Supported 00:25:27.513 Doorbell Buffer Config: Not Supported 00:25:27.513 Get LBA Status Capability: Not Supported 00:25:27.513 Command & Feature Lockdown Capability: Not Supported 00:25:27.513 Abort Command Limit: 4 00:25:27.513 Async Event Request Limit: 4 00:25:27.513 Number of Firmware Slots: N/A 00:25:27.513 Firmware Slot 1 Read-Only: N/A 00:25:27.513 Firmware Activation Without Reset: N/A 00:25:27.513 Multiple Update Detection Support: N/A 00:25:27.513 Firmware Update Granularity: No Information Provided 00:25:27.513 Per-Namespace SMART Log: No 00:25:27.513 Asymmetric Namespace Access Log Page: Not Supported 00:25:27.513 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:25:27.513 Command Effects Log Page: Supported 00:25:27.513 Get Log Page Extended Data: Supported 00:25:27.513 Telemetry Log Pages: Not Supported 00:25:27.513 Persistent Event Log Pages: Not Supported 00:25:27.513 Supported Log Pages Log Page: May Support 00:25:27.513 Commands Supported & Effects Log Page: Not Supported 00:25:27.513 Feature Identifiers & Effects Log Page:May Support 00:25:27.513 NVMe-MI Commands & Effects Log Page: May Support 00:25:27.513 Data Area 4 for Telemetry Log: Not Supported 00:25:27.513 Error Log Page Entries Supported: 128 00:25:27.513 Keep Alive: Supported 00:25:27.513 Keep Alive Granularity: 10000 ms 00:25:27.513 00:25:27.513 NVM Command Set Attributes 00:25:27.513 ========================== 00:25:27.513 Submission Queue Entry Size 00:25:27.513 Max: 64 00:25:27.513 Min: 64 00:25:27.513 Completion Queue Entry Size 00:25:27.513 Max: 16 00:25:27.513 Min: 16 00:25:27.513 Number of Namespaces: 32 00:25:27.513 Compare Command: Supported 00:25:27.513 Write Uncorrectable Command: Not Supported 00:25:27.513 Dataset Management Command: Supported 00:25:27.513 Write Zeroes Command: Supported 00:25:27.513 Set Features Save Field: Not Supported 00:25:27.513 Reservations: Supported 00:25:27.513 Timestamp: Not Supported 00:25:27.513 Copy: Supported 00:25:27.513 Volatile Write Cache: Present 00:25:27.513 Atomic Write Unit (Normal): 1 00:25:27.513 Atomic Write Unit (PFail): 1 00:25:27.513 Atomic Compare & Write Unit: 1 00:25:27.513 Fused Compare & Write: Supported 00:25:27.513 Scatter-Gather List 00:25:27.513 SGL Command Set: Supported 00:25:27.513 SGL Keyed: Supported 00:25:27.513 SGL Bit Bucket Descriptor: Not Supported 00:25:27.513 SGL Metadata Pointer: Not Supported 00:25:27.513 Oversized SGL: Not Supported 00:25:27.513 SGL Metadata Address: Not Supported 00:25:27.513 SGL Offset: Supported 00:25:27.513 Transport SGL Data Block: Not Supported 00:25:27.513 Replay Protected Memory Block: Not Supported 00:25:27.513 00:25:27.513 Firmware Slot Information 00:25:27.513 ========================= 00:25:27.513 Active slot: 1 00:25:27.513 Slot 1 Firmware Revision: 24.05 00:25:27.513 00:25:27.513 00:25:27.513 Commands Supported and Effects 00:25:27.513 ============================== 00:25:27.513 Admin Commands 00:25:27.513 -------------- 00:25:27.513 Get Log Page (02h): Supported 00:25:27.513 Identify (06h): Supported 00:25:27.513 Abort (08h): Supported 00:25:27.513 Set Features (09h): Supported 00:25:27.513 Get Features (0Ah): Supported 00:25:27.513 Asynchronous Event Request (0Ch): Supported 00:25:27.513 Keep Alive (18h): Supported 00:25:27.513 I/O Commands 00:25:27.513 ------------ 00:25:27.514 Flush (00h): Supported LBA-Change 00:25:27.514 Write (01h): Supported LBA-Change 00:25:27.514 Read (02h): Supported 00:25:27.514 Compare (05h): Supported 00:25:27.514 Write Zeroes (08h): Supported LBA-Change 00:25:27.514 Dataset Management (09h): Supported LBA-Change 00:25:27.514 Copy (19h): Supported LBA-Change 00:25:27.514 Unknown (79h): Supported LBA-Change 00:25:27.514 Unknown (7Ah): Supported 00:25:27.514 00:25:27.514 Error Log 00:25:27.514 ========= 00:25:27.514 00:25:27.514 Arbitration 00:25:27.514 =========== 00:25:27.514 Arbitration Burst: 1 00:25:27.514 00:25:27.514 Power Management 00:25:27.514 ================ 00:25:27.514 Number of Power States: 1 00:25:27.514 Current Power State: Power State #0 00:25:27.514 Power State #0: 00:25:27.514 Max Power: 0.00 W 00:25:27.514 Non-Operational State: Operational 00:25:27.514 Entry Latency: Not Reported 00:25:27.514 Exit Latency: Not Reported 00:25:27.514 Relative Read Throughput: 0 00:25:27.514 Relative Read Latency: 0 00:25:27.514 Relative Write Throughput: 0 00:25:27.514 Relative Write Latency: 0 00:25:27.514 Idle Power: Not Reported 00:25:27.514 Active Power: Not Reported 00:25:27.514 Non-Operational Permissive Mode: Not Supported 00:25:27.514 00:25:27.514 Health Information 00:25:27.514 ================== 00:25:27.514 Critical Warnings: 00:25:27.514 Available Spare Space: OK 00:25:27.514 Temperature: OK 00:25:27.514 Device Reliability: OK 00:25:27.514 Read Only: No 00:25:27.514 Volatile Memory Backup: OK 00:25:27.514 Current Temperature: 0 Kelvin (-273 Celsius) 00:25:27.514 Temperature Threshold: [2024-04-25 03:26:01.745401] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0c80 length 0x40 lkey 0x52d8f393 00:25:27.514 [2024-04-25 03:26:01.745408] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.514 [2024-04-25 03:26:01.745439] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.514 [2024-04-25 03:26:01.745443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:7 cdw0:0 sqhd:0018 p:0 m:0 dnr:0 00:25:27.514 [2024-04-25 03:26:01.745447] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x52d8f393 00:25:27.514 [2024-04-25 03:26:01.745467] nvme_ctrlr.c:4221:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:25:27.514 [2024-04-25 03:26:01.745473] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 39846 doesn't match qid 00:25:27.514 [2024-04-25 03:26:01.745485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32583 cdw0:5 sqhd:9790 p:0 m:0 dnr:0 00:25:27.514 [2024-04-25 03:26:01.745489] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 39846 doesn't match qid 00:25:27.514 [2024-04-25 03:26:01.745495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32583 cdw0:5 sqhd:9790 p:0 m:0 dnr:0 00:25:27.514 [2024-04-25 03:26:01.745500] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 39846 doesn't match qid 00:25:27.514 [2024-04-25 03:26:01.745505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32583 cdw0:5 sqhd:9790 p:0 m:0 dnr:0 00:25:27.514 [2024-04-25 03:26:01.745510] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 39846 doesn't match qid 00:25:27.514 [2024-04-25 03:26:01.745515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32583 cdw0:5 sqhd:9790 p:0 m:0 dnr:0 00:25:27.514 [2024-04-25 03:26:01.745522] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x52d8f393 00:25:27.514 [2024-04-25 03:26:01.745528] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:4 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.514 [2024-04-25 03:26:01.745551] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.514 [2024-04-25 03:26:01.745555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:4 cdw0:460001 sqhd:0019 p:0 m:0 dnr:0 00:25:27.514 [2024-04-25 03:26:01.745561] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.514 [2024-04-25 03:26:01.745567] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.514 [2024-04-25 03:26:01.745571] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x52d8f393 00:25:27.514 [2024-04-25 03:26:01.745600] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.514 [2024-04-25 03:26:01.745604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:0 sqhd:001a p:0 m:0 dnr:0 00:25:27.514 [2024-04-25 03:26:01.745608] nvme_ctrlr.c:1082:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:25:27.514 [2024-04-25 03:26:01.745612] nvme_ctrlr.c:1085:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:25:27.514 [2024-04-25 03:26:01.745616] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x52d8f393 00:25:27.514 [2024-04-25 03:26:01.745624] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.514 [2024-04-25 03:26:01.745630] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.514 [2024-04-25 03:26:01.745654] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.514 [2024-04-25 03:26:01.745659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:25:27.514 [2024-04-25 03:26:01.745663] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x52d8f393 00:25:27.514 [2024-04-25 03:26:01.745670] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.514 [2024-04-25 03:26:01.745676] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.514 [2024-04-25 03:26:01.745699] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.514 [2024-04-25 03:26:01.745703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:25:27.514 [2024-04-25 03:26:01.745707] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x52d8f393 00:25:27.514 [2024-04-25 03:26:01.745714] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.514 [2024-04-25 03:26:01.745720] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.514 [2024-04-25 03:26:01.745752] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.514 [2024-04-25 03:26:01.745756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:25:27.514 [2024-04-25 03:26:01.745760] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x52d8f393 00:25:27.514 [2024-04-25 03:26:01.745767] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.514 [2024-04-25 03:26:01.745773] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.514 [2024-04-25 03:26:01.745804] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.514 [2024-04-25 03:26:01.745808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:25:27.514 [2024-04-25 03:26:01.745813] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x52d8f393 00:25:27.514 [2024-04-25 03:26:01.745819] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.514 [2024-04-25 03:26:01.745825] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.514 [2024-04-25 03:26:01.745846] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.514 [2024-04-25 03:26:01.745850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:25:27.514 [2024-04-25 03:26:01.745859] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x52d8f393 00:25:27.514 [2024-04-25 03:26:01.745866] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.514 [2024-04-25 03:26:01.745872] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.514 [2024-04-25 03:26:01.745904] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.514 [2024-04-25 03:26:01.745908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:25:27.514 [2024-04-25 03:26:01.745913] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x52d8f393 00:25:27.514 [2024-04-25 03:26:01.745920] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.514 [2024-04-25 03:26:01.745926] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.514 [2024-04-25 03:26:01.745950] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.514 [2024-04-25 03:26:01.745954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:25:27.514 [2024-04-25 03:26:01.745959] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x52d8f393 00:25:27.514 [2024-04-25 03:26:01.745965] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.514 [2024-04-25 03:26:01.745971] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.514 [2024-04-25 03:26:01.745996] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.514 [2024-04-25 03:26:01.746000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:25:27.514 [2024-04-25 03:26:01.746005] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x52d8f393 00:25:27.514 [2024-04-25 03:26:01.746011] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.514 [2024-04-25 03:26:01.746017] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.514 [2024-04-25 03:26:01.746042] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.514 [2024-04-25 03:26:01.746046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:25:27.514 [2024-04-25 03:26:01.746051] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x52d8f393 00:25:27.514 [2024-04-25 03:26:01.746057] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.514 [2024-04-25 03:26:01.746063] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.515 [2024-04-25 03:26:01.746090] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.515 [2024-04-25 03:26:01.746094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:25:27.515 [2024-04-25 03:26:01.746098] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x52d8f393 00:25:27.515 [2024-04-25 03:26:01.746105] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.515 [2024-04-25 03:26:01.746111] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.515 [2024-04-25 03:26:01.746137] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.515 [2024-04-25 03:26:01.746141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:25:27.515 [2024-04-25 03:26:01.746146] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x52d8f393 00:25:27.515 [2024-04-25 03:26:01.746152] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.515 [2024-04-25 03:26:01.746158] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.515 [2024-04-25 03:26:01.746183] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.515 [2024-04-25 03:26:01.746188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:25:27.515 [2024-04-25 03:26:01.746193] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x52d8f393 00:25:27.515 [2024-04-25 03:26:01.746200] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.515 [2024-04-25 03:26:01.746206] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.515 [2024-04-25 03:26:01.746236] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.515 [2024-04-25 03:26:01.746240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:25:27.515 [2024-04-25 03:26:01.746244] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x52d8f393 00:25:27.515 [2024-04-25 03:26:01.746250] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.515 [2024-04-25 03:26:01.746256] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.515 [2024-04-25 03:26:01.746282] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.515 [2024-04-25 03:26:01.746286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:25:27.515 [2024-04-25 03:26:01.746290] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x52d8f393 00:25:27.515 [2024-04-25 03:26:01.746297] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.515 [2024-04-25 03:26:01.746302] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.515 [2024-04-25 03:26:01.746332] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.515 [2024-04-25 03:26:01.746336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0009 p:0 m:0 dnr:0 00:25:27.515 [2024-04-25 03:26:01.746340] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x52d8f393 00:25:27.515 [2024-04-25 03:26:01.746347] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.515 [2024-04-25 03:26:01.746353] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.515 [2024-04-25 03:26:01.746378] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.515 [2024-04-25 03:26:01.746382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000a p:0 m:0 dnr:0 00:25:27.515 [2024-04-25 03:26:01.746386] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x52d8f393 00:25:27.515 [2024-04-25 03:26:01.746393] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.515 [2024-04-25 03:26:01.746399] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.515 [2024-04-25 03:26:01.746422] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.515 [2024-04-25 03:26:01.746426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000b p:0 m:0 dnr:0 00:25:27.515 [2024-04-25 03:26:01.746430] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x52d8f393 00:25:27.515 [2024-04-25 03:26:01.746436] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.515 [2024-04-25 03:26:01.746442] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.515 [2024-04-25 03:26:01.746472] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.515 [2024-04-25 03:26:01.746477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000c p:0 m:0 dnr:0 00:25:27.515 [2024-04-25 03:26:01.746482] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x52d8f393 00:25:27.515 [2024-04-25 03:26:01.746488] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.515 [2024-04-25 03:26:01.746494] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.515 [2024-04-25 03:26:01.746521] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.515 [2024-04-25 03:26:01.746525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000d p:0 m:0 dnr:0 00:25:27.515 [2024-04-25 03:26:01.746529] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x52d8f393 00:25:27.515 [2024-04-25 03:26:01.746536] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.515 [2024-04-25 03:26:01.746542] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.515 [2024-04-25 03:26:01.746568] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.515 [2024-04-25 03:26:01.746572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000e p:0 m:0 dnr:0 00:25:27.515 [2024-04-25 03:26:01.746577] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x52d8f393 00:25:27.515 [2024-04-25 03:26:01.746584] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.515 [2024-04-25 03:26:01.746589] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.515 [2024-04-25 03:26:01.746618] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.515 [2024-04-25 03:26:01.746622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000f p:0 m:0 dnr:0 00:25:27.515 [2024-04-25 03:26:01.746626] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x52d8f393 00:25:27.515 [2024-04-25 03:26:01.746632] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.515 [2024-04-25 03:26:01.746638] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.515 [2024-04-25 03:26:01.746664] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.515 [2024-04-25 03:26:01.746668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0010 p:0 m:0 dnr:0 00:25:27.515 [2024-04-25 03:26:01.746672] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x52d8f393 00:25:27.515 [2024-04-25 03:26:01.746679] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.515 [2024-04-25 03:26:01.746684] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.515 [2024-04-25 03:26:01.746712] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.515 [2024-04-25 03:26:01.746716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0011 p:0 m:0 dnr:0 00:25:27.515 [2024-04-25 03:26:01.746721] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x52d8f393 00:25:27.515 [2024-04-25 03:26:01.746727] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.515 [2024-04-25 03:26:01.746733] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.515 [2024-04-25 03:26:01.746761] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.515 [2024-04-25 03:26:01.746765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:25:27.515 [2024-04-25 03:26:01.746769] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.746776] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.746782] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.516 [2024-04-25 03:26:01.746807] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.516 [2024-04-25 03:26:01.746811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:25:27.516 [2024-04-25 03:26:01.746816] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.746822] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.746828] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.516 [2024-04-25 03:26:01.746858] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.516 [2024-04-25 03:26:01.746863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:25:27.516 [2024-04-25 03:26:01.746867] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.746874] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.746880] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.516 [2024-04-25 03:26:01.746906] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.516 [2024-04-25 03:26:01.746910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:25:27.516 [2024-04-25 03:26:01.746915] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.746921] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.746927] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.516 [2024-04-25 03:26:01.746949] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.516 [2024-04-25 03:26:01.746953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:25:27.516 [2024-04-25 03:26:01.746957] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.746964] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.746970] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.516 [2024-04-25 03:26:01.746997] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.516 [2024-04-25 03:26:01.747001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:25:27.516 [2024-04-25 03:26:01.747005] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.747012] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.747018] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.516 [2024-04-25 03:26:01.747047] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.516 [2024-04-25 03:26:01.747051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:25:27.516 [2024-04-25 03:26:01.747056] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.747062] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.747068] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.516 [2024-04-25 03:26:01.747095] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.516 [2024-04-25 03:26:01.747099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:25:27.516 [2024-04-25 03:26:01.747103] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.747110] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.747116] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.516 [2024-04-25 03:26:01.747145] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.516 [2024-04-25 03:26:01.747149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:25:27.516 [2024-04-25 03:26:01.747154] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.747160] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.747166] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.516 [2024-04-25 03:26:01.747193] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.516 [2024-04-25 03:26:01.747197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:25:27.516 [2024-04-25 03:26:01.747201] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.747208] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.747214] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.516 [2024-04-25 03:26:01.747236] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.516 [2024-04-25 03:26:01.747240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:25:27.516 [2024-04-25 03:26:01.747245] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.747251] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.747257] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.516 [2024-04-25 03:26:01.747280] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.516 [2024-04-25 03:26:01.747284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:25:27.516 [2024-04-25 03:26:01.747288] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.747294] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.747302] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.516 [2024-04-25 03:26:01.747322] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.516 [2024-04-25 03:26:01.747326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:25:27.516 [2024-04-25 03:26:01.747331] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.747337] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.747343] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.516 [2024-04-25 03:26:01.747368] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.516 [2024-04-25 03:26:01.747372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:25:27.516 [2024-04-25 03:26:01.747377] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.747383] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.747389] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.516 [2024-04-25 03:26:01.747420] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.516 [2024-04-25 03:26:01.747424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:25:27.516 [2024-04-25 03:26:01.747429] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.747435] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.747441] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.516 [2024-04-25 03:26:01.747465] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.516 [2024-04-25 03:26:01.747469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:25:27.516 [2024-04-25 03:26:01.747473] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.747480] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.747485] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.516 [2024-04-25 03:26:01.747514] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.516 [2024-04-25 03:26:01.747518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:25:27.516 [2024-04-25 03:26:01.747522] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.747529] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.747535] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.516 [2024-04-25 03:26:01.747563] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.516 [2024-04-25 03:26:01.747567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:25:27.516 [2024-04-25 03:26:01.747571] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.747579] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.516 [2024-04-25 03:26:01.747585] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.516 [2024-04-25 03:26:01.747610] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.516 [2024-04-25 03:26:01.747614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:25:27.516 [2024-04-25 03:26:01.747618] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x52d8f393 00:25:27.517 [2024-04-25 03:26:01.747625] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.517 [2024-04-25 03:26:01.747631] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.517 [2024-04-25 03:26:01.747656] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.517 [2024-04-25 03:26:01.747660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:25:27.517 [2024-04-25 03:26:01.747665] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x52d8f393 00:25:27.517 [2024-04-25 03:26:01.747671] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.517 [2024-04-25 03:26:01.747677] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.517 [2024-04-25 03:26:01.747704] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.517 [2024-04-25 03:26:01.747708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:25:27.517 [2024-04-25 03:26:01.747712] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x52d8f393 00:25:27.517 [2024-04-25 03:26:01.747719] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.517 [2024-04-25 03:26:01.747725] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.517 [2024-04-25 03:26:01.747750] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.517 [2024-04-25 03:26:01.747754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:25:27.517 [2024-04-25 03:26:01.747758] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x52d8f393 00:25:27.517 [2024-04-25 03:26:01.747765] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.517 [2024-04-25 03:26:01.747770] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.517 [2024-04-25 03:26:01.747797] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.517 [2024-04-25 03:26:01.747801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:25:27.517 [2024-04-25 03:26:01.747806] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x52d8f393 00:25:27.517 [2024-04-25 03:26:01.747812] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.517 [2024-04-25 03:26:01.747818] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.517 [2024-04-25 03:26:01.747848] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.517 [2024-04-25 03:26:01.747852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0009 p:0 m:0 dnr:0 00:25:27.517 [2024-04-25 03:26:01.751862] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x52d8f393 00:25:27.517 [2024-04-25 03:26:01.751872] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x52d8f393 00:25:27.517 [2024-04-25 03:26:01.751878] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:25:27.517 [2024-04-25 03:26:01.751904] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:25:27.517 [2024-04-25 03:26:01.751908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:9 sqhd:000a p:0 m:0 dnr:0 00:25:27.517 [2024-04-25 03:26:01.751913] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x52d8f393 00:25:27.517 [2024-04-25 03:26:01.751917] nvme_ctrlr.c:1204:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 6 milliseconds 00:25:27.517 0 Kelvin (-273 Celsius) 00:25:27.517 Available Spare: 0% 00:25:27.517 Available Spare Threshold: 0% 00:25:27.517 Life Percentage Used: 0% 00:25:27.517 Data Units Read: 0 00:25:27.517 Data Units Written: 0 00:25:27.517 Host Read Commands: 0 00:25:27.517 Host Write Commands: 0 00:25:27.517 Controller Busy Time: 0 minutes 00:25:27.517 Power Cycles: 0 00:25:27.517 Power On Hours: 0 hours 00:25:27.517 Unsafe Shutdowns: 0 00:25:27.517 Unrecoverable Media Errors: 0 00:25:27.517 Lifetime Error Log Entries: 0 00:25:27.517 Warning Temperature Time: 0 minutes 00:25:27.517 Critical Temperature Time: 0 minutes 00:25:27.517 00:25:27.517 Number of Queues 00:25:27.517 ================ 00:25:27.517 Number of I/O Submission Queues: 127 00:25:27.517 Number of I/O Completion Queues: 127 00:25:27.517 00:25:27.517 Active Namespaces 00:25:27.517 ================= 00:25:27.517 Namespace ID:1 00:25:27.517 Error Recovery Timeout: Unlimited 00:25:27.517 Command Set Identifier: NVM (00h) 00:25:27.517 Deallocate: Supported 00:25:27.517 Deallocated/Unwritten Error: Not Supported 00:25:27.517 Deallocated Read Value: Unknown 00:25:27.517 Deallocate in Write Zeroes: Not Supported 00:25:27.517 Deallocated Guard Field: 0xFFFF 00:25:27.517 Flush: Supported 00:25:27.517 Reservation: Supported 00:25:27.517 Namespace Sharing Capabilities: Multiple Controllers 00:25:27.517 Size (in LBAs): 131072 (0GiB) 00:25:27.517 Capacity (in LBAs): 131072 (0GiB) 00:25:27.517 Utilization (in LBAs): 131072 (0GiB) 00:25:27.517 NGUID: ABCDEF0123456789ABCDEF0123456789 00:25:27.517 EUI64: ABCDEF0123456789 00:25:27.517 UUID: ea9cd07e-059a-4f7b-a9ab-64fa4814b32a 00:25:27.517 Thin Provisioning: Not Supported 00:25:27.517 Per-NS Atomic Units: Yes 00:25:27.517 Atomic Boundary Size (Normal): 0 00:25:27.517 Atomic Boundary Size (PFail): 0 00:25:27.517 Atomic Boundary Offset: 0 00:25:27.517 Maximum Single Source Range Length: 65535 00:25:27.517 Maximum Copy Length: 65535 00:25:27.517 Maximum Source Range Count: 1 00:25:27.517 NGUID/EUI64 Never Reused: No 00:25:27.517 Namespace Write Protected: No 00:25:27.517 Number of LBA Formats: 1 00:25:27.517 Current LBA Format: LBA Format #00 00:25:27.517 LBA Format #00: Data Size: 512 Metadata Size: 0 00:25:27.517 00:25:27.517 03:26:01 -- host/identify.sh@51 -- # sync 00:25:27.517 03:26:01 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:27.517 03:26:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:27.517 03:26:01 -- common/autotest_common.sh@10 -- # set +x 00:25:27.517 03:26:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:27.517 03:26:01 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:25:27.517 03:26:01 -- host/identify.sh@56 -- # nvmftestfini 00:25:27.517 03:26:01 -- nvmf/common.sh@477 -- # nvmfcleanup 00:25:27.517 03:26:01 -- nvmf/common.sh@117 -- # sync 00:25:27.517 03:26:01 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:25:27.517 03:26:01 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:25:27.517 03:26:01 -- nvmf/common.sh@120 -- # set +e 00:25:27.517 03:26:01 -- nvmf/common.sh@121 -- # for i in {1..20} 00:25:27.517 03:26:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:25:27.517 rmmod nvme_rdma 00:25:27.517 rmmod nvme_fabrics 00:25:27.517 03:26:01 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:25:27.517 03:26:01 -- nvmf/common.sh@124 -- # set -e 00:25:27.517 03:26:01 -- nvmf/common.sh@125 -- # return 0 00:25:27.517 03:26:01 -- nvmf/common.sh@478 -- # '[' -n 9350 ']' 00:25:27.517 03:26:01 -- nvmf/common.sh@479 -- # killprocess 9350 00:25:27.517 03:26:01 -- common/autotest_common.sh@936 -- # '[' -z 9350 ']' 00:25:27.517 03:26:01 -- common/autotest_common.sh@940 -- # kill -0 9350 00:25:27.517 03:26:01 -- common/autotest_common.sh@941 -- # uname 00:25:27.517 03:26:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:27.517 03:26:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 9350 00:25:27.517 03:26:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:27.517 03:26:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:27.517 03:26:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 9350' 00:25:27.517 killing process with pid 9350 00:25:27.517 03:26:01 -- common/autotest_common.sh@955 -- # kill 9350 00:25:27.517 [2024-04-25 03:26:01.890481] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:25:27.517 03:26:01 -- common/autotest_common.sh@960 -- # wait 9350 00:25:27.517 [2024-04-25 03:26:01.923773] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:25:27.776 03:26:02 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:25:27.776 03:26:02 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:25:27.776 00:25:27.776 real 0m7.766s 00:25:27.776 user 0m7.527s 00:25:27.776 sys 0m4.897s 00:25:27.776 03:26:02 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:25:27.776 03:26:02 -- common/autotest_common.sh@10 -- # set +x 00:25:27.776 ************************************ 00:25:27.776 END TEST nvmf_identify 00:25:27.776 ************************************ 00:25:27.776 03:26:02 -- nvmf/nvmf.sh@96 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=rdma 00:25:27.776 03:26:02 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:27.776 03:26:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:27.776 03:26:02 -- common/autotest_common.sh@10 -- # set +x 00:25:28.034 ************************************ 00:25:28.034 START TEST nvmf_perf 00:25:28.034 ************************************ 00:25:28.034 03:26:02 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=rdma 00:25:28.034 * Looking for test storage... 00:25:28.034 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host 00:25:28.034 03:26:02 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:25:28.034 03:26:02 -- nvmf/common.sh@7 -- # uname -s 00:25:28.034 03:26:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:28.034 03:26:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:28.034 03:26:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:28.034 03:26:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:28.034 03:26:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:28.034 03:26:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:28.034 03:26:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:28.034 03:26:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:28.034 03:26:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:28.034 03:26:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:28.034 03:26:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:25:28.034 03:26:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:25:28.034 03:26:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:28.034 03:26:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:28.034 03:26:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:28.034 03:26:02 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:25:28.034 03:26:02 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:25:28.034 03:26:02 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:28.034 03:26:02 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:28.034 03:26:02 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:28.034 03:26:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:28.034 03:26:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:28.034 03:26:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:28.034 03:26:02 -- paths/export.sh@5 -- # export PATH 00:25:28.034 03:26:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:28.034 03:26:02 -- nvmf/common.sh@47 -- # : 0 00:25:28.034 03:26:02 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:25:28.034 03:26:02 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:25:28.034 03:26:02 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:25:28.034 03:26:02 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:28.034 03:26:02 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:28.034 03:26:02 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:25:28.034 03:26:02 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:25:28.034 03:26:02 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:25:28.034 03:26:02 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:25:28.034 03:26:02 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:25:28.034 03:26:02 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:25:28.034 03:26:02 -- host/perf.sh@17 -- # nvmftestinit 00:25:28.034 03:26:02 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:25:28.034 03:26:02 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:28.034 03:26:02 -- nvmf/common.sh@437 -- # prepare_net_devs 00:25:28.034 03:26:02 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:25:28.034 03:26:02 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:25:28.034 03:26:02 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:28.034 03:26:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:28.034 03:26:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:28.034 03:26:02 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:25:28.034 03:26:02 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:25:28.034 03:26:02 -- nvmf/common.sh@285 -- # xtrace_disable 00:25:28.034 03:26:02 -- common/autotest_common.sh@10 -- # set +x 00:25:34.594 03:26:08 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:34.594 03:26:08 -- nvmf/common.sh@291 -- # pci_devs=() 00:25:34.594 03:26:08 -- nvmf/common.sh@291 -- # local -a pci_devs 00:25:34.594 03:26:08 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:25:34.595 03:26:08 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:25:34.595 03:26:08 -- nvmf/common.sh@293 -- # pci_drivers=() 00:25:34.595 03:26:08 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:25:34.595 03:26:08 -- nvmf/common.sh@295 -- # net_devs=() 00:25:34.595 03:26:08 -- nvmf/common.sh@295 -- # local -ga net_devs 00:25:34.595 03:26:08 -- nvmf/common.sh@296 -- # e810=() 00:25:34.595 03:26:08 -- nvmf/common.sh@296 -- # local -ga e810 00:25:34.595 03:26:08 -- nvmf/common.sh@297 -- # x722=() 00:25:34.595 03:26:08 -- nvmf/common.sh@297 -- # local -ga x722 00:25:34.595 03:26:08 -- nvmf/common.sh@298 -- # mlx=() 00:25:34.595 03:26:08 -- nvmf/common.sh@298 -- # local -ga mlx 00:25:34.595 03:26:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:34.595 03:26:08 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:34.595 03:26:08 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:34.595 03:26:08 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:34.595 03:26:08 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:34.595 03:26:08 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:34.595 03:26:08 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:34.595 03:26:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:34.595 03:26:08 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:34.595 03:26:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:34.595 03:26:08 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:34.595 03:26:08 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:25:34.595 03:26:08 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:25:34.595 03:26:08 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:25:34.595 03:26:08 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:25:34.595 03:26:08 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:25:34.595 03:26:08 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:25:34.595 03:26:08 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:25:34.595 03:26:08 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:25:34.595 03:26:08 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:25:34.595 03:26:08 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:25:34.595 Found 0000:af:00.0 (0x8086 - 0x159b) 00:25:34.595 03:26:08 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:25:34.595 03:26:08 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:25:34.595 03:26:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:34.595 03:26:08 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:34.595 03:26:08 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:25:34.595 03:26:08 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:25:34.595 03:26:08 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:25:34.595 03:26:08 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:25:34.595 Found 0000:af:00.1 (0x8086 - 0x159b) 00:25:34.595 03:26:08 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:25:34.595 03:26:08 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:25:34.595 03:26:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:34.595 03:26:08 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:34.595 03:26:08 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:25:34.595 03:26:08 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:25:34.595 03:26:08 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:25:34.595 03:26:08 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:25:34.595 03:26:08 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:25:34.595 03:26:08 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:25:34.595 03:26:08 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:25:34.595 03:26:08 -- nvmf/common.sh@377 -- # modinfo irdma 00:25:34.595 03:26:08 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:25:34.595 03:26:08 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:25:34.595 03:26:08 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:34.595 03:26:08 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:25:34.595 03:26:08 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:34.595 03:26:08 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:25:34.595 Found net devices under 0000:af:00.0: cvl_0_0 00:25:34.595 03:26:08 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:25:34.595 03:26:08 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:25:34.595 03:26:08 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:34.595 03:26:08 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:25:34.595 03:26:08 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:34.595 03:26:08 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:25:34.595 Found net devices under 0000:af:00.1: cvl_0_1 00:25:34.595 03:26:08 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:25:34.595 03:26:08 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:25:34.595 03:26:08 -- nvmf/common.sh@403 -- # is_hw=yes 00:25:34.595 03:26:08 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:25:34.595 03:26:08 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:25:34.595 03:26:08 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:25:34.595 03:26:08 -- nvmf/common.sh@409 -- # rdma_device_init 00:25:34.595 03:26:08 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:25:34.595 03:26:08 -- nvmf/common.sh@58 -- # uname 00:25:34.595 03:26:08 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:25:34.595 03:26:08 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:25:34.595 03:26:08 -- nvmf/common.sh@63 -- # modprobe ib_core 00:25:34.595 03:26:08 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:25:34.595 03:26:08 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:25:34.595 03:26:08 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:25:34.595 03:26:08 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:25:34.595 03:26:08 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:25:34.595 03:26:08 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:25:34.595 03:26:08 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:25:34.595 03:26:08 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:25:34.595 03:26:08 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:25:34.595 03:26:08 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:25:34.595 03:26:08 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:25:34.595 03:26:08 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:25:34.595 03:26:08 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:25:34.595 03:26:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:25:34.595 03:26:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:34.595 03:26:08 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:25:34.595 03:26:08 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:25:34.595 03:26:08 -- nvmf/common.sh@105 -- # continue 2 00:25:34.595 03:26:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:25:34.595 03:26:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:34.595 03:26:08 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:25:34.595 03:26:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:34.595 03:26:08 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:25:34.595 03:26:08 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:25:34.595 03:26:08 -- nvmf/common.sh@105 -- # continue 2 00:25:34.595 03:26:08 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:25:34.595 03:26:08 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:25:34.595 03:26:08 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:25:34.595 03:26:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:25:34.595 03:26:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:25:34.595 03:26:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:25:34.595 03:26:08 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:25:34.595 03:26:08 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:25:34.595 03:26:08 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:25:34.595 50: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:25:34.595 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:25:34.595 altname enp175s0f0np0 00:25:34.595 altname ens801f0np0 00:25:34.595 inet 192.168.100.8/24 scope global cvl_0_0 00:25:34.595 valid_lft forever preferred_lft forever 00:25:34.595 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:25:34.595 valid_lft forever preferred_lft forever 00:25:34.595 03:26:08 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:25:34.595 03:26:08 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:25:34.595 03:26:08 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:25:34.595 03:26:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:25:34.595 03:26:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:25:34.595 03:26:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:25:34.595 03:26:08 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:25:34.595 03:26:08 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:25:34.595 03:26:08 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:25:34.595 51: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:25:34.595 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:25:34.595 altname enp175s0f1np1 00:25:34.595 altname ens801f1np1 00:25:34.595 inet 192.168.100.9/24 scope global cvl_0_1 00:25:34.595 valid_lft forever preferred_lft forever 00:25:34.595 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:25:34.595 valid_lft forever preferred_lft forever 00:25:34.595 03:26:08 -- nvmf/common.sh@411 -- # return 0 00:25:34.595 03:26:08 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:25:34.595 03:26:08 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:25:34.595 03:26:08 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:25:34.595 03:26:08 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:25:34.595 03:26:08 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:25:34.595 03:26:08 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:25:34.595 03:26:08 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:25:34.595 03:26:08 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:25:34.595 03:26:08 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:25:34.595 03:26:08 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:25:34.595 03:26:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:25:34.595 03:26:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:34.595 03:26:08 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:25:34.595 03:26:08 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:25:34.595 03:26:08 -- nvmf/common.sh@105 -- # continue 2 00:25:34.595 03:26:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:25:34.595 03:26:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:34.595 03:26:08 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:25:34.595 03:26:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:34.596 03:26:08 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:25:34.596 03:26:08 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:25:34.596 03:26:08 -- nvmf/common.sh@105 -- # continue 2 00:25:34.596 03:26:08 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:25:34.596 03:26:08 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:25:34.596 03:26:08 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:25:34.596 03:26:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:25:34.596 03:26:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:25:34.596 03:26:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:25:34.596 03:26:08 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:25:34.596 03:26:08 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:25:34.596 03:26:08 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:25:34.596 03:26:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:25:34.596 03:26:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:25:34.596 03:26:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:25:34.596 03:26:08 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:25:34.596 192.168.100.9' 00:25:34.596 03:26:08 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:25:34.596 192.168.100.9' 00:25:34.596 03:26:08 -- nvmf/common.sh@446 -- # head -n 1 00:25:34.596 03:26:08 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:25:34.596 03:26:08 -- nvmf/common.sh@447 -- # tail -n +2 00:25:34.596 03:26:08 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:25:34.596 192.168.100.9' 00:25:34.596 03:26:08 -- nvmf/common.sh@447 -- # head -n 1 00:25:34.596 03:26:08 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:25:34.596 03:26:08 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:25:34.596 03:26:08 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:25:34.596 03:26:08 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:25:34.596 03:26:08 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:25:34.596 03:26:08 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:25:34.596 03:26:08 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:25:34.596 03:26:08 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:25:34.596 03:26:08 -- common/autotest_common.sh@710 -- # xtrace_disable 00:25:34.596 03:26:08 -- common/autotest_common.sh@10 -- # set +x 00:25:34.596 03:26:08 -- nvmf/common.sh@470 -- # nvmfpid=12945 00:25:34.596 03:26:08 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:34.596 03:26:08 -- nvmf/common.sh@471 -- # waitforlisten 12945 00:25:34.596 03:26:08 -- common/autotest_common.sh@817 -- # '[' -z 12945 ']' 00:25:34.596 03:26:08 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:34.596 03:26:08 -- common/autotest_common.sh@822 -- # local max_retries=100 00:25:34.596 03:26:08 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:34.596 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:34.596 03:26:08 -- common/autotest_common.sh@826 -- # xtrace_disable 00:25:34.596 03:26:08 -- common/autotest_common.sh@10 -- # set +x 00:25:34.596 [2024-04-25 03:26:08.349926] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:25:34.596 [2024-04-25 03:26:08.349970] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:34.596 EAL: No free 2048 kB hugepages reported on node 1 00:25:34.596 [2024-04-25 03:26:08.409966] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:34.596 [2024-04-25 03:26:08.487523] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:34.596 [2024-04-25 03:26:08.487555] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:34.596 [2024-04-25 03:26:08.487562] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:25:34.596 [2024-04-25 03:26:08.487568] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:25:34.596 [2024-04-25 03:26:08.487573] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:34.596 [2024-04-25 03:26:08.487613] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:34.596 [2024-04-25 03:26:08.487628] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:34.596 [2024-04-25 03:26:08.487720] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:34.596 [2024-04-25 03:26:08.487721] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:34.854 03:26:09 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:25:34.854 03:26:09 -- common/autotest_common.sh@850 -- # return 0 00:25:34.854 03:26:09 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:25:34.854 03:26:09 -- common/autotest_common.sh@716 -- # xtrace_disable 00:25:34.854 03:26:09 -- common/autotest_common.sh@10 -- # set +x 00:25:34.854 03:26:09 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:34.854 03:26:09 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/gen_nvme.sh 00:25:34.854 03:26:09 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:25:38.134 03:26:12 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:25:38.134 03:26:12 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:25:38.134 03:26:12 -- host/perf.sh@30 -- # local_nvme_trid=0000:5e:00.0 00:25:38.134 03:26:12 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:25:38.134 03:26:12 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:25:38.134 03:26:12 -- host/perf.sh@33 -- # '[' -n 0000:5e:00.0 ']' 00:25:38.134 03:26:12 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:25:38.134 03:26:12 -- host/perf.sh@37 -- # '[' rdma == rdma ']' 00:25:38.134 03:26:12 -- host/perf.sh@40 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -c 0 00:25:38.424 [2024-04-25 03:26:12.728929] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:25:38.424 [2024-04-25 03:26:12.743251] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0xc40400/0xc3fa40) succeed. 00:25:38.424 [2024-04-25 03:26:12.753457] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0xc417b0/0xc3ffc0) succeed. 00:25:38.424 [2024-04-25 03:26:12.753477] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:25:38.424 03:26:12 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:38.680 03:26:12 -- host/perf.sh@45 -- # for bdev in $bdevs 00:25:38.680 03:26:12 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:38.680 03:26:13 -- host/perf.sh@45 -- # for bdev in $bdevs 00:25:38.680 03:26:13 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:25:38.937 03:26:13 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:25:39.194 [2024-04-25 03:26:13.496452] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:25:39.194 03:26:13 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:25:39.451 03:26:13 -- host/perf.sh@52 -- # '[' -n 0000:5e:00.0 ']' 00:25:39.451 03:26:13 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:5e:00.0' 00:25:39.451 03:26:13 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:25:39.451 03:26:13 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:5e:00.0' 00:25:40.820 Initializing NVMe Controllers 00:25:40.820 Attached to NVMe Controller at 0000:5e:00.0 [8086:0a54] 00:25:40.820 Associating PCIE (0000:5e:00.0) NSID 1 with lcore 0 00:25:40.820 Initialization complete. Launching workers. 00:25:40.820 ======================================================== 00:25:40.820 Latency(us) 00:25:40.820 Device Information : IOPS MiB/s Average min max 00:25:40.820 PCIE (0000:5e:00.0) NSID 1 from core 0: 101010.71 394.57 317.16 30.30 4234.09 00:25:40.820 ======================================================== 00:25:40.820 Total : 101010.71 394.57 317.16 30.30 4234.09 00:25:40.820 00:25:40.820 03:26:14 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:25:40.820 EAL: No free 2048 kB hugepages reported on node 1 00:25:44.091 Initializing NVMe Controllers 00:25:44.091 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:25:44.091 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:44.091 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:44.091 Initialization complete. Launching workers. 00:25:44.091 ======================================================== 00:25:44.091 Latency(us) 00:25:44.091 Device Information : IOPS MiB/s Average min max 00:25:44.091 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 6200.99 24.22 161.05 55.08 5052.55 00:25:44.091 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 5016.99 19.60 199.12 72.93 5102.05 00:25:44.091 ======================================================== 00:25:44.091 Total : 11217.99 43.82 178.08 55.08 5102.05 00:25:44.091 00:25:44.091 03:26:18 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:25:44.091 EAL: No free 2048 kB hugepages reported on node 1 00:25:47.368 Initializing NVMe Controllers 00:25:47.368 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:25:47.368 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:47.368 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:47.368 Initialization complete. Launching workers. 00:25:47.368 ======================================================== 00:25:47.368 Latency(us) 00:25:47.368 Device Information : IOPS MiB/s Average min max 00:25:47.368 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 18777.98 73.35 1704.89 415.81 5395.62 00:25:47.368 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 4064.00 15.87 7932.01 3900.27 9110.94 00:25:47.368 ======================================================== 00:25:47.368 Total : 22841.98 89.23 2812.81 415.81 9110.94 00:25:47.368 00:25:47.368 03:26:21 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:25:47.368 03:26:21 -- host/perf.sh@59 -- # [[ rdma == \r\d\m\a ]] 00:25:47.368 03:26:21 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -c 0xf -P 4 00:25:47.368 EAL: No free 2048 kB hugepages reported on node 1 00:25:47.368 No valid NVMe controllers or AIO or URING devices found 00:25:47.368 Initializing NVMe Controllers 00:25:47.368 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:25:47.368 Controller IO queue size 128, less than required. 00:25:47.368 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:47.368 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:25:47.368 Controller IO queue size 128, less than required. 00:25:47.368 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:47.368 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:25:47.368 WARNING: Some requested NVMe devices were skipped 00:25:47.368 03:26:21 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' --transport-stat 00:25:47.625 EAL: No free 2048 kB hugepages reported on node 1 00:25:52.881 Initializing NVMe Controllers 00:25:52.881 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:25:52.881 Controller IO queue size 128, less than required. 00:25:52.881 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:52.881 Controller IO queue size 128, less than required. 00:25:52.881 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:52.881 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:52.881 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:52.881 Initialization complete. Launching workers. 00:25:52.881 00:25:52.881 ==================== 00:25:52.881 lcore 0, ns RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:25:52.881 RDMA transport: 00:25:52.881 dev name: rocep175s0f0 00:25:52.881 polls: 362287 00:25:52.881 idle_polls: 356605 00:25:52.881 completions: 41750 00:25:52.881 queued_requests: 1 00:25:52.881 total_send_wrs: 20875 00:25:52.881 send_doorbell_updates: 5143 00:25:52.881 total_recv_wrs: 21002 00:25:52.881 recv_doorbell_updates: 5151 00:25:52.881 --------------------------------- 00:25:52.881 00:25:52.881 ==================== 00:25:52.881 lcore 0, ns RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:25:52.881 RDMA transport: 00:25:52.881 dev name: rocep175s0f0 00:25:52.881 polls: 363735 00:25:52.881 idle_polls: 356497 00:25:52.881 completions: 48374 00:25:52.881 queued_requests: 1 00:25:52.881 total_send_wrs: 24187 00:25:52.881 send_doorbell_updates: 6382 00:25:52.881 total_recv_wrs: 24314 00:25:52.881 recv_doorbell_updates: 6392 00:25:52.881 --------------------------------- 00:25:52.881 ======================================================== 00:25:52.881 Latency(us) 00:25:52.881 Device Information : IOPS MiB/s Average min max 00:25:52.881 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 5218.50 1304.62 24620.86 17023.80 51491.34 00:25:52.881 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 6046.50 1511.62 21075.29 14931.34 50967.09 00:25:52.881 ======================================================== 00:25:52.881 Total : 11264.99 2816.25 22717.77 14931.34 51491.34 00:25:52.881 00:25:52.881 03:26:26 -- host/perf.sh@66 -- # sync 00:25:52.881 03:26:26 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:52.881 03:26:26 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:25:52.881 03:26:26 -- host/perf.sh@71 -- # '[' -n 0000:5e:00.0 ']' 00:25:52.881 03:26:26 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:25:55.407 03:26:29 -- host/perf.sh@72 -- # ls_guid=5ff30e28-923f-40af-ae9f-bf4a958de302 00:25:55.407 03:26:29 -- host/perf.sh@73 -- # get_lvs_free_mb 5ff30e28-923f-40af-ae9f-bf4a958de302 00:25:55.407 03:26:29 -- common/autotest_common.sh@1350 -- # local lvs_uuid=5ff30e28-923f-40af-ae9f-bf4a958de302 00:25:55.407 03:26:29 -- common/autotest_common.sh@1351 -- # local lvs_info 00:25:55.407 03:26:29 -- common/autotest_common.sh@1352 -- # local fc 00:25:55.407 03:26:29 -- common/autotest_common.sh@1353 -- # local cs 00:25:55.407 03:26:29 -- common/autotest_common.sh@1354 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:55.407 03:26:29 -- common/autotest_common.sh@1354 -- # lvs_info='[ 00:25:55.407 { 00:25:55.407 "uuid": "5ff30e28-923f-40af-ae9f-bf4a958de302", 00:25:55.407 "name": "lvs_0", 00:25:55.407 "base_bdev": "Nvme0n1", 00:25:55.407 "total_data_clusters": 238234, 00:25:55.407 "free_clusters": 238234, 00:25:55.407 "block_size": 512, 00:25:55.407 "cluster_size": 4194304 00:25:55.407 } 00:25:55.407 ]' 00:25:55.407 03:26:29 -- common/autotest_common.sh@1355 -- # jq '.[] | select(.uuid=="5ff30e28-923f-40af-ae9f-bf4a958de302") .free_clusters' 00:25:55.407 03:26:29 -- common/autotest_common.sh@1355 -- # fc=238234 00:25:55.407 03:26:29 -- common/autotest_common.sh@1356 -- # jq '.[] | select(.uuid=="5ff30e28-923f-40af-ae9f-bf4a958de302") .cluster_size' 00:25:55.407 03:26:29 -- common/autotest_common.sh@1356 -- # cs=4194304 00:25:55.407 03:26:29 -- common/autotest_common.sh@1359 -- # free_mb=952936 00:25:55.407 03:26:29 -- common/autotest_common.sh@1360 -- # echo 952936 00:25:55.407 952936 00:25:55.407 03:26:29 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:25:55.407 03:26:29 -- host/perf.sh@78 -- # free_mb=20480 00:25:55.407 03:26:29 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 5ff30e28-923f-40af-ae9f-bf4a958de302 lbd_0 20480 00:25:55.973 03:26:30 -- host/perf.sh@80 -- # lb_guid=b79798e5-ced8-40b3-a2dd-a5d38270cbff 00:25:55.973 03:26:30 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore b79798e5-ced8-40b3-a2dd-a5d38270cbff lvs_n_0 00:25:56.908 03:26:31 -- host/perf.sh@83 -- # ls_nested_guid=3e88f784-5ec0-418f-9bac-6847f8e92d54 00:25:56.908 03:26:31 -- host/perf.sh@84 -- # get_lvs_free_mb 3e88f784-5ec0-418f-9bac-6847f8e92d54 00:25:56.908 03:26:31 -- common/autotest_common.sh@1350 -- # local lvs_uuid=3e88f784-5ec0-418f-9bac-6847f8e92d54 00:25:56.908 03:26:31 -- common/autotest_common.sh@1351 -- # local lvs_info 00:25:56.908 03:26:31 -- common/autotest_common.sh@1352 -- # local fc 00:25:56.908 03:26:31 -- common/autotest_common.sh@1353 -- # local cs 00:25:56.908 03:26:31 -- common/autotest_common.sh@1354 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:56.908 03:26:31 -- common/autotest_common.sh@1354 -- # lvs_info='[ 00:25:56.908 { 00:25:56.908 "uuid": "5ff30e28-923f-40af-ae9f-bf4a958de302", 00:25:56.908 "name": "lvs_0", 00:25:56.908 "base_bdev": "Nvme0n1", 00:25:56.908 "total_data_clusters": 238234, 00:25:56.908 "free_clusters": 233114, 00:25:56.908 "block_size": 512, 00:25:56.908 "cluster_size": 4194304 00:25:56.908 }, 00:25:56.908 { 00:25:56.908 "uuid": "3e88f784-5ec0-418f-9bac-6847f8e92d54", 00:25:56.908 "name": "lvs_n_0", 00:25:56.908 "base_bdev": "b79798e5-ced8-40b3-a2dd-a5d38270cbff", 00:25:56.908 "total_data_clusters": 5114, 00:25:56.908 "free_clusters": 5114, 00:25:56.908 "block_size": 512, 00:25:56.908 "cluster_size": 4194304 00:25:56.908 } 00:25:56.908 ]' 00:25:56.908 03:26:31 -- common/autotest_common.sh@1355 -- # jq '.[] | select(.uuid=="3e88f784-5ec0-418f-9bac-6847f8e92d54") .free_clusters' 00:25:56.908 03:26:31 -- common/autotest_common.sh@1355 -- # fc=5114 00:25:56.908 03:26:31 -- common/autotest_common.sh@1356 -- # jq '.[] | select(.uuid=="3e88f784-5ec0-418f-9bac-6847f8e92d54") .cluster_size' 00:25:56.908 03:26:31 -- common/autotest_common.sh@1356 -- # cs=4194304 00:25:56.908 03:26:31 -- common/autotest_common.sh@1359 -- # free_mb=20456 00:25:56.908 03:26:31 -- common/autotest_common.sh@1360 -- # echo 20456 00:25:56.908 20456 00:25:56.908 03:26:31 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:25:56.908 03:26:31 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 3e88f784-5ec0-418f-9bac-6847f8e92d54 lbd_nest_0 20456 00:25:57.166 03:26:31 -- host/perf.sh@88 -- # lb_nested_guid=e8a1d398-6ac6-4551-b58e-2a28805c99cd 00:25:57.166 03:26:31 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:57.424 03:26:31 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:25:57.424 03:26:31 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 e8a1d398-6ac6-4551-b58e-2a28805c99cd 00:25:57.424 03:26:31 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:25:57.682 03:26:32 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:25:57.682 03:26:32 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:25:57.682 03:26:32 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:25:57.682 03:26:32 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:25:57.682 03:26:32 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:25:57.682 EAL: No free 2048 kB hugepages reported on node 1 00:26:09.872 Initializing NVMe Controllers 00:26:09.872 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:26:09.872 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:09.873 Initialization complete. Launching workers. 00:26:09.873 ======================================================== 00:26:09.873 Latency(us) 00:26:09.873 Device Information : IOPS MiB/s Average min max 00:26:09.873 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 5299.00 2.59 188.34 75.30 5671.22 00:26:09.873 ======================================================== 00:26:09.873 Total : 5299.00 2.59 188.34 75.30 5671.22 00:26:09.873 00:26:09.873 03:26:43 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:09.873 03:26:43 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:26:09.873 EAL: No free 2048 kB hugepages reported on node 1 00:26:22.131 Initializing NVMe Controllers 00:26:22.131 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:26:22.131 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:22.131 Initialization complete. Launching workers. 00:26:22.131 ======================================================== 00:26:22.131 Latency(us) 00:26:22.131 Device Information : IOPS MiB/s Average min max 00:26:22.131 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 125.20 15.65 7991.41 4092.98 11973.72 00:26:22.131 ======================================================== 00:26:22.131 Total : 125.20 15.65 7991.41 4092.98 11973.72 00:26:22.131 00:26:22.131 03:26:54 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:22.131 03:26:54 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:22.131 03:26:54 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:26:22.131 EAL: No free 2048 kB hugepages reported on node 1 00:26:32.094 Initializing NVMe Controllers 00:26:32.094 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:26:32.094 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:32.094 Initialization complete. Launching workers. 00:26:32.094 ======================================================== 00:26:32.094 Latency(us) 00:26:32.094 Device Information : IOPS MiB/s Average min max 00:26:32.094 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 11421.60 5.58 2802.63 805.34 9043.23 00:26:32.094 ======================================================== 00:26:32.094 Total : 11421.60 5.58 2802.63 805.34 9043.23 00:26:32.094 00:26:32.094 03:27:06 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:32.094 03:27:06 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:26:32.094 EAL: No free 2048 kB hugepages reported on node 1 00:26:44.289 Initializing NVMe Controllers 00:26:44.289 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:26:44.290 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:44.290 Initialization complete. Launching workers. 00:26:44.290 ======================================================== 00:26:44.290 Latency(us) 00:26:44.290 Device Information : IOPS MiB/s Average min max 00:26:44.290 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8982.60 1122.83 3562.70 561.32 9220.28 00:26:44.290 ======================================================== 00:26:44.290 Total : 8982.60 1122.83 3562.70 561.32 9220.28 00:26:44.290 00:26:44.290 03:27:17 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:44.290 03:27:17 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:44.290 03:27:17 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:26:44.290 EAL: No free 2048 kB hugepages reported on node 1 00:26:54.252 Initializing NVMe Controllers 00:26:54.252 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:26:54.252 Controller IO queue size 128, less than required. 00:26:54.252 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:54.252 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:54.252 Initialization complete. Launching workers. 00:26:54.252 ======================================================== 00:26:54.252 Latency(us) 00:26:54.252 Device Information : IOPS MiB/s Average min max 00:26:54.252 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 19133.30 9.34 6692.58 1958.76 15941.72 00:26:54.252 ======================================================== 00:26:54.252 Total : 19133.30 9.34 6692.58 1958.76 15941.72 00:26:54.252 00:26:54.252 03:27:28 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:54.252 03:27:28 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:26:54.252 EAL: No free 2048 kB hugepages reported on node 1 00:27:06.446 Initializing NVMe Controllers 00:27:06.446 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:27:06.446 Controller IO queue size 128, less than required. 00:27:06.446 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:06.446 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:06.446 Initialization complete. Launching workers. 00:27:06.446 ======================================================== 00:27:06.446 Latency(us) 00:27:06.446 Device Information : IOPS MiB/s Average min max 00:27:06.446 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 6254.77 781.85 20479.32 8065.40 34950.24 00:27:06.446 ======================================================== 00:27:06.446 Total : 6254.77 781.85 20479.32 8065.40 34950.24 00:27:06.446 00:27:06.446 03:27:40 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:06.446 03:27:40 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete e8a1d398-6ac6-4551-b58e-2a28805c99cd 00:27:06.446 03:27:40 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:27:06.703 03:27:41 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete b79798e5-ced8-40b3-a2dd-a5d38270cbff 00:27:06.961 03:27:41 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:27:07.220 03:27:41 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:27:07.220 03:27:41 -- host/perf.sh@114 -- # nvmftestfini 00:27:07.220 03:27:41 -- nvmf/common.sh@477 -- # nvmfcleanup 00:27:07.220 03:27:41 -- nvmf/common.sh@117 -- # sync 00:27:07.220 03:27:41 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:27:07.220 03:27:41 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:27:07.220 03:27:41 -- nvmf/common.sh@120 -- # set +e 00:27:07.220 03:27:41 -- nvmf/common.sh@121 -- # for i in {1..20} 00:27:07.220 03:27:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:27:07.220 rmmod nvme_rdma 00:27:07.220 rmmod nvme_fabrics 00:27:07.220 03:27:41 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:27:07.220 03:27:41 -- nvmf/common.sh@124 -- # set -e 00:27:07.220 03:27:41 -- nvmf/common.sh@125 -- # return 0 00:27:07.220 03:27:41 -- nvmf/common.sh@478 -- # '[' -n 12945 ']' 00:27:07.220 03:27:41 -- nvmf/common.sh@479 -- # killprocess 12945 00:27:07.220 03:27:41 -- common/autotest_common.sh@936 -- # '[' -z 12945 ']' 00:27:07.220 03:27:41 -- common/autotest_common.sh@940 -- # kill -0 12945 00:27:07.220 03:27:41 -- common/autotest_common.sh@941 -- # uname 00:27:07.220 03:27:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:07.220 03:27:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 12945 00:27:07.220 03:27:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:07.220 03:27:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:07.220 03:27:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 12945' 00:27:07.220 killing process with pid 12945 00:27:07.220 03:27:41 -- common/autotest_common.sh@955 -- # kill 12945 00:27:07.220 03:27:41 -- common/autotest_common.sh@960 -- # wait 12945 00:27:07.220 [2024-04-25 03:27:41.610356] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:27:09.137 03:27:43 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:27:09.137 03:27:43 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:27:09.137 00:27:09.137 real 1m40.817s 00:27:09.137 user 6m21.906s 00:27:09.137 sys 0m6.100s 00:27:09.137 03:27:43 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:27:09.137 03:27:43 -- common/autotest_common.sh@10 -- # set +x 00:27:09.137 ************************************ 00:27:09.137 END TEST nvmf_perf 00:27:09.137 ************************************ 00:27:09.137 03:27:43 -- nvmf/nvmf.sh@97 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=rdma 00:27:09.137 03:27:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:09.137 03:27:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:09.137 03:27:43 -- common/autotest_common.sh@10 -- # set +x 00:27:09.137 ************************************ 00:27:09.137 START TEST nvmf_fio_host 00:27:09.137 ************************************ 00:27:09.137 03:27:43 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=rdma 00:27:09.137 * Looking for test storage... 00:27:09.137 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host 00:27:09.137 03:27:43 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:27:09.137 03:27:43 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:09.137 03:27:43 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:09.137 03:27:43 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:09.137 03:27:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:09.137 03:27:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:09.138 03:27:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:09.138 03:27:43 -- paths/export.sh@5 -- # export PATH 00:27:09.138 03:27:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:09.138 03:27:43 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:27:09.138 03:27:43 -- nvmf/common.sh@7 -- # uname -s 00:27:09.138 03:27:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:09.138 03:27:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:09.138 03:27:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:09.138 03:27:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:09.138 03:27:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:09.138 03:27:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:09.138 03:27:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:09.138 03:27:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:09.138 03:27:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:09.138 03:27:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:09.138 03:27:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:27:09.138 03:27:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:27:09.138 03:27:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:09.138 03:27:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:09.138 03:27:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:09.138 03:27:43 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:27:09.138 03:27:43 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:27:09.138 03:27:43 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:09.138 03:27:43 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:09.138 03:27:43 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:09.138 03:27:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:09.138 03:27:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:09.138 03:27:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:09.138 03:27:43 -- paths/export.sh@5 -- # export PATH 00:27:09.138 03:27:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:09.138 03:27:43 -- nvmf/common.sh@47 -- # : 0 00:27:09.138 03:27:43 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:27:09.138 03:27:43 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:27:09.138 03:27:43 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:27:09.138 03:27:43 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:09.138 03:27:43 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:09.138 03:27:43 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:27:09.138 03:27:43 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:27:09.138 03:27:43 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:27:09.138 03:27:43 -- host/fio.sh@12 -- # nvmftestinit 00:27:09.138 03:27:43 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:27:09.138 03:27:43 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:09.138 03:27:43 -- nvmf/common.sh@437 -- # prepare_net_devs 00:27:09.138 03:27:43 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:27:09.138 03:27:43 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:27:09.138 03:27:43 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:09.138 03:27:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:09.138 03:27:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:09.138 03:27:43 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:27:09.138 03:27:43 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:27:09.138 03:27:43 -- nvmf/common.sh@285 -- # xtrace_disable 00:27:09.138 03:27:43 -- common/autotest_common.sh@10 -- # set +x 00:27:15.709 03:27:49 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:15.709 03:27:49 -- nvmf/common.sh@291 -- # pci_devs=() 00:27:15.709 03:27:49 -- nvmf/common.sh@291 -- # local -a pci_devs 00:27:15.709 03:27:49 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:27:15.709 03:27:49 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:27:15.709 03:27:49 -- nvmf/common.sh@293 -- # pci_drivers=() 00:27:15.709 03:27:49 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:27:15.709 03:27:49 -- nvmf/common.sh@295 -- # net_devs=() 00:27:15.709 03:27:49 -- nvmf/common.sh@295 -- # local -ga net_devs 00:27:15.709 03:27:49 -- nvmf/common.sh@296 -- # e810=() 00:27:15.709 03:27:49 -- nvmf/common.sh@296 -- # local -ga e810 00:27:15.709 03:27:49 -- nvmf/common.sh@297 -- # x722=() 00:27:15.709 03:27:49 -- nvmf/common.sh@297 -- # local -ga x722 00:27:15.709 03:27:49 -- nvmf/common.sh@298 -- # mlx=() 00:27:15.709 03:27:49 -- nvmf/common.sh@298 -- # local -ga mlx 00:27:15.709 03:27:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:15.709 03:27:49 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:15.709 03:27:49 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:15.709 03:27:49 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:15.709 03:27:49 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:15.709 03:27:49 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:15.709 03:27:49 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:15.709 03:27:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:15.709 03:27:49 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:15.709 03:27:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:15.709 03:27:49 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:15.709 03:27:49 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:27:15.709 03:27:49 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:27:15.709 03:27:49 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:27:15.709 03:27:49 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:27:15.709 03:27:49 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:27:15.709 03:27:49 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:27:15.709 03:27:49 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:27:15.709 03:27:49 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:27:15.709 03:27:49 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:15.709 03:27:49 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:27:15.709 Found 0000:af:00.0 (0x8086 - 0x159b) 00:27:15.709 03:27:49 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:27:15.709 03:27:49 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:27:15.709 03:27:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:15.709 03:27:49 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:15.709 03:27:49 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:27:15.709 03:27:49 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:27:15.709 03:27:49 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:15.709 03:27:49 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:27:15.709 Found 0000:af:00.1 (0x8086 - 0x159b) 00:27:15.709 03:27:49 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:27:15.709 03:27:49 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:27:15.709 03:27:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:15.709 03:27:49 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:15.709 03:27:49 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:27:15.709 03:27:49 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:27:15.709 03:27:49 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:27:15.709 03:27:49 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:27:15.709 03:27:49 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:27:15.709 03:27:49 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:27:15.709 03:27:49 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:27:15.709 03:27:49 -- nvmf/common.sh@377 -- # modinfo irdma 00:27:15.709 03:27:49 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:27:15.709 03:27:49 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:15.709 03:27:49 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:15.709 03:27:49 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:15.709 03:27:49 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:15.709 03:27:49 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:27:15.709 Found net devices under 0000:af:00.0: cvl_0_0 00:27:15.709 03:27:49 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:15.709 03:27:49 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:15.709 03:27:49 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:15.709 03:27:49 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:15.709 03:27:49 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:15.709 03:27:49 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:27:15.709 Found net devices under 0000:af:00.1: cvl_0_1 00:27:15.709 03:27:49 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:15.709 03:27:49 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:27:15.709 03:27:49 -- nvmf/common.sh@403 -- # is_hw=yes 00:27:15.709 03:27:49 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:27:15.709 03:27:49 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:27:15.709 03:27:49 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:27:15.709 03:27:49 -- nvmf/common.sh@409 -- # rdma_device_init 00:27:15.709 03:27:49 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:27:15.709 03:27:49 -- nvmf/common.sh@58 -- # uname 00:27:15.709 03:27:49 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:27:15.709 03:27:49 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:27:15.709 03:27:49 -- nvmf/common.sh@63 -- # modprobe ib_core 00:27:15.709 03:27:49 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:27:15.709 03:27:49 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:27:15.709 03:27:49 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:27:15.710 03:27:49 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:27:15.710 03:27:49 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:27:15.710 03:27:49 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:27:15.710 03:27:49 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:27:15.710 03:27:49 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:27:15.710 03:27:49 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:27:15.710 03:27:49 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:27:15.710 03:27:49 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:27:15.710 03:27:49 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:27:15.710 03:27:49 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:27:15.710 03:27:49 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:15.710 03:27:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:15.710 03:27:49 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:27:15.710 03:27:49 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:27:15.710 03:27:49 -- nvmf/common.sh@105 -- # continue 2 00:27:15.710 03:27:49 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:15.710 03:27:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:15.710 03:27:49 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:27:15.710 03:27:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:15.710 03:27:49 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:27:15.710 03:27:49 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:27:15.710 03:27:49 -- nvmf/common.sh@105 -- # continue 2 00:27:15.710 03:27:49 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:27:15.710 03:27:49 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:27:15.710 03:27:49 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:27:15.710 03:27:49 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:27:15.710 03:27:49 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:15.710 03:27:49 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:15.710 03:27:49 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:27:15.710 03:27:49 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:27:15.710 03:27:49 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:27:15.710 50: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:27:15.710 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:27:15.710 altname enp175s0f0np0 00:27:15.710 altname ens801f0np0 00:27:15.710 inet 192.168.100.8/24 scope global cvl_0_0 00:27:15.710 valid_lft forever preferred_lft forever 00:27:15.710 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:27:15.710 valid_lft forever preferred_lft forever 00:27:15.710 03:27:49 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:27:15.710 03:27:49 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:27:15.710 03:27:49 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:27:15.710 03:27:49 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:27:15.710 03:27:49 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:15.710 03:27:49 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:15.710 03:27:49 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:27:15.710 03:27:49 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:27:15.710 03:27:49 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:27:15.710 51: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:27:15.710 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:27:15.710 altname enp175s0f1np1 00:27:15.710 altname ens801f1np1 00:27:15.710 inet 192.168.100.9/24 scope global cvl_0_1 00:27:15.710 valid_lft forever preferred_lft forever 00:27:15.710 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:27:15.710 valid_lft forever preferred_lft forever 00:27:15.710 03:27:49 -- nvmf/common.sh@411 -- # return 0 00:27:15.710 03:27:49 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:27:15.710 03:27:49 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:27:15.710 03:27:49 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:27:15.710 03:27:49 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:27:15.710 03:27:49 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:27:15.710 03:27:49 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:27:15.710 03:27:49 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:27:15.710 03:27:49 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:27:15.710 03:27:49 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:27:15.710 03:27:49 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:27:15.710 03:27:49 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:15.710 03:27:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:15.710 03:27:49 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:27:15.710 03:27:49 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:27:15.710 03:27:49 -- nvmf/common.sh@105 -- # continue 2 00:27:15.710 03:27:49 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:15.710 03:27:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:15.710 03:27:49 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:27:15.710 03:27:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:15.710 03:27:49 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:27:15.710 03:27:49 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:27:15.710 03:27:49 -- nvmf/common.sh@105 -- # continue 2 00:27:15.710 03:27:49 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:27:15.710 03:27:49 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:27:15.710 03:27:49 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:27:15.710 03:27:49 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:27:15.710 03:27:49 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:15.710 03:27:49 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:15.710 03:27:49 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:27:15.710 03:27:49 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:27:15.710 03:27:49 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:27:15.710 03:27:49 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:27:15.710 03:27:49 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:15.710 03:27:49 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:15.710 03:27:49 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:27:15.710 192.168.100.9' 00:27:15.710 03:27:49 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:27:15.710 192.168.100.9' 00:27:15.710 03:27:49 -- nvmf/common.sh@446 -- # head -n 1 00:27:15.710 03:27:49 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:27:15.710 03:27:49 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:27:15.710 192.168.100.9' 00:27:15.710 03:27:49 -- nvmf/common.sh@447 -- # tail -n +2 00:27:15.710 03:27:49 -- nvmf/common.sh@447 -- # head -n 1 00:27:15.710 03:27:49 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:27:15.710 03:27:49 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:27:15.710 03:27:49 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:27:15.710 03:27:49 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:27:15.710 03:27:49 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:27:15.710 03:27:49 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:27:15.710 03:27:49 -- host/fio.sh@14 -- # [[ y != y ]] 00:27:15.710 03:27:49 -- host/fio.sh@19 -- # timing_enter start_nvmf_tgt 00:27:15.710 03:27:49 -- common/autotest_common.sh@710 -- # xtrace_disable 00:27:15.710 03:27:49 -- common/autotest_common.sh@10 -- # set +x 00:27:15.710 03:27:49 -- host/fio.sh@22 -- # nvmfpid=31962 00:27:15.710 03:27:49 -- host/fio.sh@24 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:15.710 03:27:49 -- host/fio.sh@21 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:27:15.710 03:27:49 -- host/fio.sh@26 -- # waitforlisten 31962 00:27:15.710 03:27:49 -- common/autotest_common.sh@817 -- # '[' -z 31962 ']' 00:27:15.710 03:27:49 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:15.710 03:27:49 -- common/autotest_common.sh@822 -- # local max_retries=100 00:27:15.710 03:27:49 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:15.710 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:15.710 03:27:49 -- common/autotest_common.sh@826 -- # xtrace_disable 00:27:15.710 03:27:49 -- common/autotest_common.sh@10 -- # set +x 00:27:15.710 [2024-04-25 03:27:49.376528] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:27:15.710 [2024-04-25 03:27:49.376582] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:15.710 EAL: No free 2048 kB hugepages reported on node 1 00:27:15.710 [2024-04-25 03:27:49.436956] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:15.710 [2024-04-25 03:27:49.510769] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:15.710 [2024-04-25 03:27:49.510808] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:15.710 [2024-04-25 03:27:49.510815] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:27:15.711 [2024-04-25 03:27:49.510820] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:27:15.711 [2024-04-25 03:27:49.510825] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:15.711 [2024-04-25 03:27:49.510895] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:15.711 [2024-04-25 03:27:49.510991] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:15.711 [2024-04-25 03:27:49.511076] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:15.711 [2024-04-25 03:27:49.511077] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:15.711 03:27:50 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:27:15.711 03:27:50 -- common/autotest_common.sh@850 -- # return 0 00:27:15.711 03:27:50 -- host/fio.sh@27 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:27:15.711 03:27:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:15.711 03:27:50 -- common/autotest_common.sh@10 -- # set +x 00:27:15.970 [2024-04-25 03:27:50.208184] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x13b0ea0/0x13b04e0) succeed. 00:27:15.970 [2024-04-25 03:27:50.218440] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x13b2210/0x13b0a60) succeed. 00:27:15.970 [2024-04-25 03:27:50.218472] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:27:15.970 03:27:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:15.970 03:27:50 -- host/fio.sh@28 -- # timing_exit start_nvmf_tgt 00:27:15.970 03:27:50 -- common/autotest_common.sh@716 -- # xtrace_disable 00:27:15.970 03:27:50 -- common/autotest_common.sh@10 -- # set +x 00:27:15.970 03:27:50 -- host/fio.sh@30 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:27:15.970 03:27:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:15.970 03:27:50 -- common/autotest_common.sh@10 -- # set +x 00:27:15.970 Malloc1 00:27:15.970 03:27:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:15.970 03:27:50 -- host/fio.sh@31 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:15.970 03:27:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:15.970 03:27:50 -- common/autotest_common.sh@10 -- # set +x 00:27:15.970 03:27:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:15.970 03:27:50 -- host/fio.sh@32 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:27:15.970 03:27:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:15.970 03:27:50 -- common/autotest_common.sh@10 -- # set +x 00:27:15.970 03:27:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:15.970 03:27:50 -- host/fio.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:27:15.970 03:27:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:15.970 03:27:50 -- common/autotest_common.sh@10 -- # set +x 00:27:15.970 [2024-04-25 03:27:50.309263] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:27:15.970 03:27:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:15.970 03:27:50 -- host/fio.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:27:15.970 03:27:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:15.970 03:27:50 -- common/autotest_common.sh@10 -- # set +x 00:27:15.970 03:27:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:15.970 03:27:50 -- host/fio.sh@36 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/app/fio/nvme 00:27:15.970 03:27:50 -- host/fio.sh@39 -- # fio_nvme /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:27:15.970 03:27:50 -- common/autotest_common.sh@1346 -- # fio_plugin /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:27:15.970 03:27:50 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:27:15.970 03:27:50 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:15.970 03:27:50 -- common/autotest_common.sh@1325 -- # local sanitizers 00:27:15.970 03:27:50 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme 00:27:15.970 03:27:50 -- common/autotest_common.sh@1327 -- # shift 00:27:15.970 03:27:50 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:27:15.970 03:27:50 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:27:15.970 03:27:50 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme 00:27:15.970 03:27:50 -- common/autotest_common.sh@1331 -- # grep libasan 00:27:15.970 03:27:50 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:27:15.970 03:27:50 -- common/autotest_common.sh@1331 -- # asan_lib= 00:27:15.970 03:27:50 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:27:15.970 03:27:50 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:27:15.970 03:27:50 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme 00:27:15.970 03:27:50 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:27:15.970 03:27:50 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:27:15.970 03:27:50 -- common/autotest_common.sh@1331 -- # asan_lib= 00:27:15.970 03:27:50 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:27:15.970 03:27:50 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:15.970 03:27:50 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:27:16.230 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:16.230 fio-3.35 00:27:16.230 Starting 1 thread 00:27:16.230 EAL: No free 2048 kB hugepages reported on node 1 00:27:18.764 00:27:18.764 test: (groupid=0, jobs=1): err= 0: pid=32341: Thu Apr 25 03:27:52 2024 00:27:18.764 read: IOPS=17.7k, BW=69.2MiB/s (72.6MB/s)(139MiB/2004msec) 00:27:18.764 slat (nsec): min=1395, max=25830, avg=1557.19, stdev=495.61 00:27:18.764 clat (usec): min=1950, max=6525, avg=3587.29, stdev=91.05 00:27:18.764 lat (usec): min=1970, max=6526, avg=3588.84, stdev=90.98 00:27:18.764 clat percentiles (usec): 00:27:18.764 | 1.00th=[ 3523], 5.00th=[ 3556], 10.00th=[ 3556], 20.00th=[ 3589], 00:27:18.764 | 30.00th=[ 3589], 40.00th=[ 3589], 50.00th=[ 3589], 60.00th=[ 3589], 00:27:18.764 | 70.00th=[ 3589], 80.00th=[ 3589], 90.00th=[ 3621], 95.00th=[ 3621], 00:27:18.764 | 99.00th=[ 3687], 99.50th=[ 3916], 99.90th=[ 4752], 99.95th=[ 5604], 00:27:18.764 | 99.99th=[ 6521] 00:27:18.764 bw ( KiB/s): min=69456, max=71536, per=100.00%, avg=70880.00, stdev=957.95, samples=4 00:27:18.764 iops : min=17364, max=17884, avg=17720.00, stdev=239.49, samples=4 00:27:18.764 write: IOPS=17.7k, BW=69.2MiB/s (72.6MB/s)(139MiB/2004msec); 0 zone resets 00:27:18.764 slat (nsec): min=1442, max=17742, avg=1644.98, stdev=523.93 00:27:18.764 clat (usec): min=1981, max=6531, avg=3585.64, stdev=85.11 00:27:18.764 lat (usec): min=1990, max=6532, avg=3587.29, stdev=85.03 00:27:18.764 clat percentiles (usec): 00:27:18.764 | 1.00th=[ 3523], 5.00th=[ 3556], 10.00th=[ 3556], 20.00th=[ 3556], 00:27:18.764 | 30.00th=[ 3589], 40.00th=[ 3589], 50.00th=[ 3589], 60.00th=[ 3589], 00:27:18.764 | 70.00th=[ 3589], 80.00th=[ 3589], 90.00th=[ 3621], 95.00th=[ 3621], 00:27:18.764 | 99.00th=[ 3720], 99.50th=[ 3916], 99.90th=[ 4293], 99.95th=[ 5604], 00:27:18.764 | 99.99th=[ 6456] 00:27:18.764 bw ( KiB/s): min=69392, max=71456, per=100.00%, avg=70874.00, stdev=990.01, samples=4 00:27:18.764 iops : min=17348, max=17864, avg=17718.50, stdev=247.50, samples=4 00:27:18.764 lat (msec) : 2=0.01%, 4=99.86%, 10=0.13% 00:27:18.764 cpu : usr=99.50%, sys=0.15%, ctx=9, majf=0, minf=3 00:27:18.764 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.9% 00:27:18.764 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:18.764 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:18.764 issued rwts: total=35506,35498,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:18.764 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:18.764 00:27:18.764 Run status group 0 (all jobs): 00:27:18.764 READ: bw=69.2MiB/s (72.6MB/s), 69.2MiB/s-69.2MiB/s (72.6MB/s-72.6MB/s), io=139MiB (145MB), run=2004-2004msec 00:27:18.764 WRITE: bw=69.2MiB/s (72.6MB/s), 69.2MiB/s-69.2MiB/s (72.6MB/s-72.6MB/s), io=139MiB (145MB), run=2004-2004msec 00:27:18.764 03:27:52 -- host/fio.sh@43 -- # fio_nvme /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' 00:27:18.764 03:27:52 -- common/autotest_common.sh@1346 -- # fio_plugin /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' 00:27:18.764 03:27:52 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:27:18.764 03:27:52 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:18.764 03:27:52 -- common/autotest_common.sh@1325 -- # local sanitizers 00:27:18.764 03:27:52 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme 00:27:18.764 03:27:52 -- common/autotest_common.sh@1327 -- # shift 00:27:18.764 03:27:52 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:27:18.764 03:27:52 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:27:18.764 03:27:52 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme 00:27:18.764 03:27:52 -- common/autotest_common.sh@1331 -- # grep libasan 00:27:18.764 03:27:52 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:27:18.764 03:27:52 -- common/autotest_common.sh@1331 -- # asan_lib= 00:27:18.764 03:27:52 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:27:18.764 03:27:52 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:27:18.764 03:27:52 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:27:18.764 03:27:52 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme 00:27:18.764 03:27:52 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:27:18.764 03:27:53 -- common/autotest_common.sh@1331 -- # asan_lib= 00:27:18.764 03:27:53 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:27:18.764 03:27:53 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:18.764 03:27:53 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' 00:27:18.764 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:27:18.764 fio-3.35 00:27:18.764 Starting 1 thread 00:27:19.022 EAL: No free 2048 kB hugepages reported on node 1 00:27:21.553 00:27:21.553 test: (groupid=0, jobs=1): err= 0: pid=32881: Thu Apr 25 03:27:55 2024 00:27:21.553 read: IOPS=13.4k, BW=209MiB/s (219MB/s)(412MiB/1976msec) 00:27:21.553 slat (nsec): min=2309, max=38227, avg=2695.95, stdev=975.75 00:27:21.553 clat (usec): min=357, max=8704, avg=2175.36, stdev=1068.92 00:27:21.553 lat (usec): min=360, max=8721, avg=2178.06, stdev=1069.30 00:27:21.553 clat percentiles (usec): 00:27:21.553 | 1.00th=[ 898], 5.00th=[ 1205], 10.00th=[ 1319], 20.00th=[ 1483], 00:27:21.553 | 30.00th=[ 1598], 40.00th=[ 1713], 50.00th=[ 1860], 60.00th=[ 2024], 00:27:21.553 | 70.00th=[ 2245], 80.00th=[ 2573], 90.00th=[ 3392], 95.00th=[ 4948], 00:27:21.553 | 99.00th=[ 6063], 99.50th=[ 6652], 99.90th=[ 7308], 99.95th=[ 7898], 00:27:21.553 | 99.99th=[ 8717] 00:27:21.553 bw ( KiB/s): min=102610, max=106656, per=48.83%, avg=104372.50, stdev=1727.09, samples=4 00:27:21.553 iops : min= 6413, max= 6666, avg=6523.25, stdev=107.99, samples=4 00:27:21.553 write: IOPS=7379, BW=115MiB/s (121MB/s)(212MiB/1835msec); 0 zone resets 00:27:21.553 slat (usec): min=27, max=105, avg=30.17, stdev= 5.70 00:27:21.553 clat (usec): min=3994, max=18258, avg=12881.91, stdev=1436.16 00:27:21.553 lat (usec): min=4021, max=18289, avg=12912.08, stdev=1435.90 00:27:21.553 clat percentiles (usec): 00:27:21.553 | 1.00th=[ 7504], 5.00th=[11076], 10.00th=[11469], 20.00th=[11994], 00:27:21.553 | 30.00th=[12387], 40.00th=[12649], 50.00th=[12911], 60.00th=[13173], 00:27:21.553 | 70.00th=[13435], 80.00th=[13829], 90.00th=[14484], 95.00th=[15139], 00:27:21.553 | 99.00th=[16581], 99.50th=[17171], 99.90th=[17957], 99.95th=[18220], 00:27:21.553 | 99.99th=[18220] 00:27:21.553 bw ( KiB/s): min=103888, max=109312, per=91.03%, avg=107476.00, stdev=2527.44, samples=4 00:27:21.553 iops : min= 6493, max= 6832, avg=6717.25, stdev=157.96, samples=4 00:27:21.553 lat (usec) : 500=0.02%, 750=0.19%, 1000=0.90% 00:27:21.553 lat (msec) : 2=37.78%, 4=22.13%, 10=5.67%, 20=33.30% 00:27:21.553 cpu : usr=96.91%, sys=2.59%, ctx=90, majf=0, minf=2 00:27:21.553 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:27:21.553 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:21.553 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:21.553 issued rwts: total=26397,13541,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:21.553 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:21.553 00:27:21.553 Run status group 0 (all jobs): 00:27:21.553 READ: bw=209MiB/s (219MB/s), 209MiB/s-209MiB/s (219MB/s-219MB/s), io=412MiB (432MB), run=1976-1976msec 00:27:21.553 WRITE: bw=115MiB/s (121MB/s), 115MiB/s-115MiB/s (121MB/s-121MB/s), io=212MiB (222MB), run=1835-1835msec 00:27:21.553 03:27:55 -- host/fio.sh@45 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:21.553 03:27:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:21.553 03:27:55 -- common/autotest_common.sh@10 -- # set +x 00:27:21.553 03:27:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:21.553 03:27:55 -- host/fio.sh@47 -- # '[' 1 -eq 1 ']' 00:27:21.553 03:27:55 -- host/fio.sh@49 -- # bdfs=($(get_nvme_bdfs)) 00:27:21.553 03:27:55 -- host/fio.sh@49 -- # get_nvme_bdfs 00:27:21.553 03:27:55 -- common/autotest_common.sh@1499 -- # bdfs=() 00:27:21.553 03:27:55 -- common/autotest_common.sh@1499 -- # local bdfs 00:27:21.553 03:27:55 -- common/autotest_common.sh@1500 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:27:21.553 03:27:55 -- common/autotest_common.sh@1500 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/gen_nvme.sh 00:27:21.553 03:27:55 -- common/autotest_common.sh@1500 -- # jq -r '.config[].params.traddr' 00:27:21.553 03:27:55 -- common/autotest_common.sh@1501 -- # (( 1 == 0 )) 00:27:21.553 03:27:55 -- common/autotest_common.sh@1505 -- # printf '%s\n' 0000:5e:00.0 00:27:21.553 03:27:55 -- host/fio.sh@50 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:5e:00.0 -i 192.168.100.8 00:27:21.553 03:27:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:21.553 03:27:55 -- common/autotest_common.sh@10 -- # set +x 00:27:24.088 Nvme0n1 00:27:24.088 03:27:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:24.088 03:27:58 -- host/fio.sh@51 -- # rpc_cmd bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:27:24.088 03:27:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:24.088 03:27:58 -- common/autotest_common.sh@10 -- # set +x 00:27:27.373 03:28:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:27.373 03:28:01 -- host/fio.sh@51 -- # ls_guid=67f3032c-6512-46f7-b58e-dc51c762bf35 00:27:27.373 03:28:01 -- host/fio.sh@52 -- # get_lvs_free_mb 67f3032c-6512-46f7-b58e-dc51c762bf35 00:27:27.373 03:28:01 -- common/autotest_common.sh@1350 -- # local lvs_uuid=67f3032c-6512-46f7-b58e-dc51c762bf35 00:27:27.373 03:28:01 -- common/autotest_common.sh@1351 -- # local lvs_info 00:27:27.373 03:28:01 -- common/autotest_common.sh@1352 -- # local fc 00:27:27.373 03:28:01 -- common/autotest_common.sh@1353 -- # local cs 00:27:27.373 03:28:01 -- common/autotest_common.sh@1354 -- # rpc_cmd bdev_lvol_get_lvstores 00:27:27.373 03:28:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:27.373 03:28:01 -- common/autotest_common.sh@10 -- # set +x 00:27:27.373 03:28:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:27.373 03:28:01 -- common/autotest_common.sh@1354 -- # lvs_info='[ 00:27:27.373 { 00:27:27.373 "uuid": "67f3032c-6512-46f7-b58e-dc51c762bf35", 00:27:27.373 "name": "lvs_0", 00:27:27.373 "base_bdev": "Nvme0n1", 00:27:27.373 "total_data_clusters": 930, 00:27:27.373 "free_clusters": 930, 00:27:27.373 "block_size": 512, 00:27:27.373 "cluster_size": 1073741824 00:27:27.373 } 00:27:27.373 ]' 00:27:27.373 03:28:01 -- common/autotest_common.sh@1355 -- # jq '.[] | select(.uuid=="67f3032c-6512-46f7-b58e-dc51c762bf35") .free_clusters' 00:27:27.373 03:28:01 -- common/autotest_common.sh@1355 -- # fc=930 00:27:27.373 03:28:01 -- common/autotest_common.sh@1356 -- # jq '.[] | select(.uuid=="67f3032c-6512-46f7-b58e-dc51c762bf35") .cluster_size' 00:27:27.373 03:28:01 -- common/autotest_common.sh@1356 -- # cs=1073741824 00:27:27.373 03:28:01 -- common/autotest_common.sh@1359 -- # free_mb=952320 00:27:27.373 03:28:01 -- common/autotest_common.sh@1360 -- # echo 952320 00:27:27.373 952320 00:27:27.373 03:28:01 -- host/fio.sh@53 -- # rpc_cmd bdev_lvol_create -l lvs_0 lbd_0 952320 00:27:27.373 03:28:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:27.373 03:28:01 -- common/autotest_common.sh@10 -- # set +x 00:27:27.373 87e10fce-54d2-4c81-bd5a-e2223de589be 00:27:27.373 03:28:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:27.373 03:28:01 -- host/fio.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:27:27.373 03:28:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:27.373 03:28:01 -- common/autotest_common.sh@10 -- # set +x 00:27:27.373 03:28:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:27.373 03:28:01 -- host/fio.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:27:27.373 03:28:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:27.373 03:28:01 -- common/autotest_common.sh@10 -- # set +x 00:27:27.373 03:28:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:27.373 03:28:01 -- host/fio.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:27:27.373 03:28:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:27.373 03:28:01 -- common/autotest_common.sh@10 -- # set +x 00:27:27.373 03:28:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:27.373 03:28:01 -- host/fio.sh@57 -- # fio_nvme /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:27:27.373 03:28:01 -- common/autotest_common.sh@1346 -- # fio_plugin /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:27:27.373 03:28:01 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:27:27.373 03:28:01 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:27.373 03:28:01 -- common/autotest_common.sh@1325 -- # local sanitizers 00:27:27.373 03:28:01 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme 00:27:27.373 03:28:01 -- common/autotest_common.sh@1327 -- # shift 00:27:27.373 03:28:01 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:27:27.373 03:28:01 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:27:27.373 03:28:01 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme 00:27:27.373 03:28:01 -- common/autotest_common.sh@1331 -- # grep libasan 00:27:27.373 03:28:01 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:27:27.373 03:28:01 -- common/autotest_common.sh@1331 -- # asan_lib= 00:27:27.373 03:28:01 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:27:27.373 03:28:01 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:27:27.373 03:28:01 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme 00:27:27.373 03:28:01 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:27:27.373 03:28:01 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:27:27.373 03:28:01 -- common/autotest_common.sh@1331 -- # asan_lib= 00:27:27.373 03:28:01 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:27:27.373 03:28:01 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:27.373 03:28:01 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:27:27.373 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:27.373 fio-3.35 00:27:27.373 Starting 1 thread 00:27:27.373 EAL: No free 2048 kB hugepages reported on node 1 00:27:29.905 00:27:29.905 test: (groupid=0, jobs=1): err= 0: pid=34377: Thu Apr 25 03:28:04 2024 00:27:29.905 read: IOPS=10.8k, BW=42.0MiB/s (44.0MB/s)(84.2MiB/2005msec) 00:27:29.905 slat (nsec): min=1387, max=23643, avg=1536.71, stdev=388.71 00:27:29.905 clat (usec): min=273, max=169469, avg=5924.73, stdev=9034.75 00:27:29.905 lat (usec): min=275, max=169493, avg=5926.27, stdev=9034.90 00:27:29.905 clat percentiles (msec): 00:27:29.905 | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 6], 00:27:29.905 | 30.00th=[ 6], 40.00th=[ 6], 50.00th=[ 6], 60.00th=[ 6], 00:27:29.905 | 70.00th=[ 6], 80.00th=[ 6], 90.00th=[ 6], 95.00th=[ 6], 00:27:29.905 | 99.00th=[ 6], 99.50th=[ 7], 99.90th=[ 169], 99.95th=[ 169], 00:27:29.905 | 99.99th=[ 169] 00:27:29.905 bw ( KiB/s): min=29856, max=47776, per=99.95%, avg=42978.00, stdev=8753.36, samples=4 00:27:29.905 iops : min= 7464, max=11944, avg=10744.50, stdev=2188.34, samples=4 00:27:29.905 write: IOPS=10.7k, BW=41.9MiB/s (43.9MB/s)(84.0MiB/2005msec); 0 zone resets 00:27:29.905 slat (nsec): min=1438, max=17576, avg=1641.56, stdev=429.38 00:27:29.905 clat (usec): min=170, max=169495, avg=5871.88, stdev=8435.25 00:27:29.905 lat (usec): min=173, max=169501, avg=5873.52, stdev=8435.41 00:27:29.905 clat percentiles (msec): 00:27:29.905 | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 6], 00:27:29.905 | 30.00th=[ 6], 40.00th=[ 6], 50.00th=[ 6], 60.00th=[ 6], 00:27:29.905 | 70.00th=[ 6], 80.00th=[ 6], 90.00th=[ 6], 95.00th=[ 6], 00:27:29.905 | 99.00th=[ 6], 99.50th=[ 7], 99.90th=[ 169], 99.95th=[ 169], 00:27:29.905 | 99.99th=[ 169] 00:27:29.905 bw ( KiB/s): min=30912, max=47120, per=99.96%, avg=42904.00, stdev=7998.41, samples=4 00:27:29.905 iops : min= 7728, max=11780, avg=10726.00, stdev=1999.60, samples=4 00:27:29.905 lat (usec) : 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01% 00:27:29.905 lat (msec) : 2=0.04%, 4=0.19%, 10=99.45%, 250=0.30% 00:27:29.905 cpu : usr=99.50%, sys=0.20%, ctx=9, majf=0, minf=3 00:27:29.905 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.9% 00:27:29.905 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:29.905 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:29.905 issued rwts: total=21554,21514,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:29.905 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:29.905 00:27:29.905 Run status group 0 (all jobs): 00:27:29.905 READ: bw=42.0MiB/s (44.0MB/s), 42.0MiB/s-42.0MiB/s (44.0MB/s-44.0MB/s), io=84.2MiB (88.3MB), run=2005-2005msec 00:27:29.905 WRITE: bw=41.9MiB/s (43.9MB/s), 41.9MiB/s-41.9MiB/s (43.9MB/s-43.9MB/s), io=84.0MiB (88.1MB), run=2005-2005msec 00:27:29.905 03:28:04 -- host/fio.sh@59 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:27:29.905 03:28:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:29.905 03:28:04 -- common/autotest_common.sh@10 -- # set +x 00:27:29.905 03:28:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:29.905 03:28:04 -- host/fio.sh@62 -- # rpc_cmd bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:27:29.906 03:28:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:29.906 03:28:04 -- common/autotest_common.sh@10 -- # set +x 00:27:30.841 03:28:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:30.841 03:28:05 -- host/fio.sh@62 -- # ls_nested_guid=6bef76ef-c898-43fb-8b3a-8a28a222e076 00:27:30.841 03:28:05 -- host/fio.sh@63 -- # get_lvs_free_mb 6bef76ef-c898-43fb-8b3a-8a28a222e076 00:27:30.841 03:28:05 -- common/autotest_common.sh@1350 -- # local lvs_uuid=6bef76ef-c898-43fb-8b3a-8a28a222e076 00:27:30.841 03:28:05 -- common/autotest_common.sh@1351 -- # local lvs_info 00:27:30.841 03:28:05 -- common/autotest_common.sh@1352 -- # local fc 00:27:30.841 03:28:05 -- common/autotest_common.sh@1353 -- # local cs 00:27:30.841 03:28:05 -- common/autotest_common.sh@1354 -- # rpc_cmd bdev_lvol_get_lvstores 00:27:30.841 03:28:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:30.841 03:28:05 -- common/autotest_common.sh@10 -- # set +x 00:27:30.841 03:28:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:30.841 03:28:05 -- common/autotest_common.sh@1354 -- # lvs_info='[ 00:27:30.841 { 00:27:30.841 "uuid": "67f3032c-6512-46f7-b58e-dc51c762bf35", 00:27:30.841 "name": "lvs_0", 00:27:30.841 "base_bdev": "Nvme0n1", 00:27:30.841 "total_data_clusters": 930, 00:27:30.841 "free_clusters": 0, 00:27:30.841 "block_size": 512, 00:27:30.841 "cluster_size": 1073741824 00:27:30.841 }, 00:27:30.841 { 00:27:30.841 "uuid": "6bef76ef-c898-43fb-8b3a-8a28a222e076", 00:27:30.841 "name": "lvs_n_0", 00:27:30.841 "base_bdev": "87e10fce-54d2-4c81-bd5a-e2223de589be", 00:27:30.841 "total_data_clusters": 237847, 00:27:30.841 "free_clusters": 237847, 00:27:30.841 "block_size": 512, 00:27:30.841 "cluster_size": 4194304 00:27:30.841 } 00:27:30.841 ]' 00:27:30.841 03:28:05 -- common/autotest_common.sh@1355 -- # jq '.[] | select(.uuid=="6bef76ef-c898-43fb-8b3a-8a28a222e076") .free_clusters' 00:27:30.841 03:28:05 -- common/autotest_common.sh@1355 -- # fc=237847 00:27:30.841 03:28:05 -- common/autotest_common.sh@1356 -- # jq '.[] | select(.uuid=="6bef76ef-c898-43fb-8b3a-8a28a222e076") .cluster_size' 00:27:30.841 03:28:05 -- common/autotest_common.sh@1356 -- # cs=4194304 00:27:30.841 03:28:05 -- common/autotest_common.sh@1359 -- # free_mb=951388 00:27:30.841 03:28:05 -- common/autotest_common.sh@1360 -- # echo 951388 00:27:30.841 951388 00:27:30.841 03:28:05 -- host/fio.sh@64 -- # rpc_cmd bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:27:30.841 03:28:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:30.842 03:28:05 -- common/autotest_common.sh@10 -- # set +x 00:27:31.100 5ffb065c-53f9-4bf4-8b64-2f415f9a719b 00:27:31.100 03:28:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:31.100 03:28:05 -- host/fio.sh@65 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:27:31.100 03:28:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:31.100 03:28:05 -- common/autotest_common.sh@10 -- # set +x 00:27:31.100 03:28:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:31.100 03:28:05 -- host/fio.sh@66 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:27:31.100 03:28:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:31.100 03:28:05 -- common/autotest_common.sh@10 -- # set +x 00:27:31.100 03:28:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:31.100 03:28:05 -- host/fio.sh@67 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t rdma -a 192.168.100.8 -s 4420 00:27:31.100 03:28:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:31.100 03:28:05 -- common/autotest_common.sh@10 -- # set +x 00:27:31.100 03:28:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:31.101 03:28:05 -- host/fio.sh@68 -- # fio_nvme /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:27:31.101 03:28:05 -- common/autotest_common.sh@1346 -- # fio_plugin /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:27:31.101 03:28:05 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:27:31.101 03:28:05 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:31.101 03:28:05 -- common/autotest_common.sh@1325 -- # local sanitizers 00:27:31.101 03:28:05 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme 00:27:31.101 03:28:05 -- common/autotest_common.sh@1327 -- # shift 00:27:31.101 03:28:05 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:27:31.101 03:28:05 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:27:31.101 03:28:05 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme 00:27:31.101 03:28:05 -- common/autotest_common.sh@1331 -- # grep libasan 00:27:31.101 03:28:05 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:27:31.101 03:28:05 -- common/autotest_common.sh@1331 -- # asan_lib= 00:27:31.101 03:28:05 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:27:31.101 03:28:05 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:27:31.101 03:28:05 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme 00:27:31.101 03:28:05 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:27:31.101 03:28:05 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:27:31.101 03:28:05 -- common/autotest_common.sh@1331 -- # asan_lib= 00:27:31.101 03:28:05 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:27:31.101 03:28:05 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:31.101 03:28:05 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:27:31.359 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:31.359 fio-3.35 00:27:31.359 Starting 1 thread 00:27:31.618 EAL: No free 2048 kB hugepages reported on node 1 00:27:34.155 00:27:34.155 test: (groupid=0, jobs=1): err= 0: pid=35171: Thu Apr 25 03:28:08 2024 00:27:34.155 read: IOPS=9908, BW=38.7MiB/s (40.6MB/s)(77.6MiB/2006msec) 00:27:34.155 slat (nsec): min=1391, max=16885, avg=1546.66, stdev=255.30 00:27:34.155 clat (usec): min=2993, max=11052, avg=6381.98, stdev=177.14 00:27:34.155 lat (usec): min=2996, max=11054, avg=6383.52, stdev=177.11 00:27:34.155 clat percentiles (usec): 00:27:34.155 | 1.00th=[ 6259], 5.00th=[ 6325], 10.00th=[ 6325], 20.00th=[ 6325], 00:27:34.155 | 30.00th=[ 6390], 40.00th=[ 6390], 50.00th=[ 6390], 60.00th=[ 6390], 00:27:34.155 | 70.00th=[ 6390], 80.00th=[ 6390], 90.00th=[ 6456], 95.00th=[ 6456], 00:27:34.155 | 99.00th=[ 6587], 99.50th=[ 7046], 99.90th=[ 8586], 99.95th=[ 9503], 00:27:34.155 | 99.99th=[11076] 00:27:34.155 bw ( KiB/s): min=38344, max=40368, per=100.00%, avg=39648.00, stdev=934.62, samples=4 00:27:34.155 iops : min= 9586, max=10092, avg=9912.00, stdev=233.66, samples=4 00:27:34.155 write: IOPS=9934, BW=38.8MiB/s (40.7MB/s)(77.8MiB/2006msec); 0 zone resets 00:27:34.155 slat (nsec): min=1440, max=17131, avg=1664.42, stdev=273.24 00:27:34.155 clat (usec): min=2993, max=11066, avg=6404.55, stdev=205.48 00:27:34.155 lat (usec): min=2996, max=11068, avg=6406.22, stdev=205.45 00:27:34.155 clat percentiles (usec): 00:27:34.155 | 1.00th=[ 6325], 5.00th=[ 6325], 10.00th=[ 6325], 20.00th=[ 6390], 00:27:34.155 | 30.00th=[ 6390], 40.00th=[ 6390], 50.00th=[ 6390], 60.00th=[ 6390], 00:27:34.155 | 70.00th=[ 6390], 80.00th=[ 6456], 90.00th=[ 6456], 95.00th=[ 6456], 00:27:34.155 | 99.00th=[ 6718], 99.50th=[ 7046], 99.90th=[10159], 99.95th=[10290], 00:27:34.155 | 99.99th=[11076] 00:27:34.155 bw ( KiB/s): min=38824, max=40304, per=99.93%, avg=39708.00, stdev=631.97, samples=4 00:27:34.155 iops : min= 9706, max=10076, avg=9927.00, stdev=157.99, samples=4 00:27:34.155 lat (msec) : 4=0.03%, 10=99.89%, 20=0.08% 00:27:34.155 cpu : usr=99.45%, sys=0.25%, ctx=9, majf=0, minf=3 00:27:34.155 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:27:34.155 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:34.155 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:34.155 issued rwts: total=19877,19928,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:34.155 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:34.155 00:27:34.155 Run status group 0 (all jobs): 00:27:34.155 READ: bw=38.7MiB/s (40.6MB/s), 38.7MiB/s-38.7MiB/s (40.6MB/s-40.6MB/s), io=77.6MiB (81.4MB), run=2006-2006msec 00:27:34.155 WRITE: bw=38.8MiB/s (40.7MB/s), 38.8MiB/s-38.8MiB/s (40.7MB/s-40.7MB/s), io=77.8MiB (81.6MB), run=2006-2006msec 00:27:34.155 03:28:08 -- host/fio.sh@70 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:27:34.155 03:28:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:34.155 03:28:08 -- common/autotest_common.sh@10 -- # set +x 00:27:34.155 03:28:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:34.155 03:28:08 -- host/fio.sh@72 -- # sync 00:27:34.155 03:28:08 -- host/fio.sh@74 -- # rpc_cmd bdev_lvol_delete lvs_n_0/lbd_nest_0 00:27:34.155 03:28:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:34.155 03:28:08 -- common/autotest_common.sh@10 -- # set +x 00:27:37.474 03:28:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:37.474 03:28:11 -- host/fio.sh@75 -- # rpc_cmd bdev_lvol_delete_lvstore -l lvs_n_0 00:27:37.474 03:28:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:37.474 03:28:11 -- common/autotest_common.sh@10 -- # set +x 00:27:37.474 03:28:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:37.474 03:28:11 -- host/fio.sh@76 -- # rpc_cmd bdev_lvol_delete lvs_0/lbd_0 00:27:37.474 03:28:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:37.474 03:28:11 -- common/autotest_common.sh@10 -- # set +x 00:27:40.004 03:28:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:40.004 03:28:14 -- host/fio.sh@77 -- # rpc_cmd bdev_lvol_delete_lvstore -l lvs_0 00:27:40.004 03:28:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:40.004 03:28:14 -- common/autotest_common.sh@10 -- # set +x 00:27:40.004 03:28:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:40.004 03:28:14 -- host/fio.sh@78 -- # rpc_cmd bdev_nvme_detach_controller Nvme0 00:27:40.004 03:28:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:40.004 03:28:14 -- common/autotest_common.sh@10 -- # set +x 00:27:41.909 03:28:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:41.909 03:28:16 -- host/fio.sh@81 -- # trap - SIGINT SIGTERM EXIT 00:27:41.909 03:28:16 -- host/fio.sh@83 -- # rm -f ./local-test-0-verify.state 00:27:41.909 03:28:16 -- host/fio.sh@84 -- # nvmftestfini 00:27:41.909 03:28:16 -- nvmf/common.sh@477 -- # nvmfcleanup 00:27:41.909 03:28:16 -- nvmf/common.sh@117 -- # sync 00:27:41.909 03:28:16 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:27:41.909 03:28:16 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:27:41.909 03:28:16 -- nvmf/common.sh@120 -- # set +e 00:27:41.909 03:28:16 -- nvmf/common.sh@121 -- # for i in {1..20} 00:27:41.909 03:28:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:27:41.909 rmmod nvme_rdma 00:27:41.909 rmmod nvme_fabrics 00:27:41.909 03:28:16 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:27:41.909 03:28:16 -- nvmf/common.sh@124 -- # set -e 00:27:41.909 03:28:16 -- nvmf/common.sh@125 -- # return 0 00:27:41.909 03:28:16 -- nvmf/common.sh@478 -- # '[' -n 31962 ']' 00:27:41.909 03:28:16 -- nvmf/common.sh@479 -- # killprocess 31962 00:27:41.909 03:28:16 -- common/autotest_common.sh@936 -- # '[' -z 31962 ']' 00:27:41.909 03:28:16 -- common/autotest_common.sh@940 -- # kill -0 31962 00:27:41.909 03:28:16 -- common/autotest_common.sh@941 -- # uname 00:27:41.909 03:28:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:41.909 03:28:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 31962 00:27:41.909 03:28:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:41.909 03:28:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:41.909 03:28:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 31962' 00:27:41.909 killing process with pid 31962 00:27:41.909 03:28:16 -- common/autotest_common.sh@955 -- # kill 31962 00:27:41.909 03:28:16 -- common/autotest_common.sh@960 -- # wait 31962 00:27:41.909 [2024-04-25 03:28:16.156487] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:27:41.909 03:28:16 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:27:41.909 03:28:16 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:27:41.909 00:27:41.909 real 0m33.101s 00:27:41.909 user 2m19.132s 00:27:41.909 sys 0m5.744s 00:27:41.909 03:28:16 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:27:41.909 03:28:16 -- common/autotest_common.sh@10 -- # set +x 00:27:41.909 ************************************ 00:27:41.909 END TEST nvmf_fio_host 00:27:41.909 ************************************ 00:27:42.168 03:28:16 -- nvmf/nvmf.sh@98 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=rdma 00:27:42.168 03:28:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:42.168 03:28:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:42.168 03:28:16 -- common/autotest_common.sh@10 -- # set +x 00:27:42.168 ************************************ 00:27:42.168 START TEST nvmf_failover 00:27:42.168 ************************************ 00:27:42.168 03:28:16 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=rdma 00:27:42.168 * Looking for test storage... 00:27:42.168 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host 00:27:42.168 03:28:16 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:27:42.168 03:28:16 -- nvmf/common.sh@7 -- # uname -s 00:27:42.168 03:28:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:42.168 03:28:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:42.168 03:28:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:42.168 03:28:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:42.168 03:28:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:42.168 03:28:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:42.168 03:28:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:42.168 03:28:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:42.168 03:28:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:42.168 03:28:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:42.168 03:28:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:27:42.168 03:28:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:27:42.168 03:28:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:42.168 03:28:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:42.168 03:28:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:42.168 03:28:16 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:27:42.168 03:28:16 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:27:42.168 03:28:16 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:42.168 03:28:16 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:42.168 03:28:16 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:42.428 03:28:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:42.428 03:28:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:42.428 03:28:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:42.428 03:28:16 -- paths/export.sh@5 -- # export PATH 00:27:42.428 03:28:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:42.428 03:28:16 -- nvmf/common.sh@47 -- # : 0 00:27:42.428 03:28:16 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:27:42.428 03:28:16 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:27:42.428 03:28:16 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:27:42.428 03:28:16 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:42.428 03:28:16 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:42.428 03:28:16 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:27:42.428 03:28:16 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:27:42.428 03:28:16 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:27:42.428 03:28:16 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:42.428 03:28:16 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:42.428 03:28:16 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:27:42.428 03:28:16 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:27:42.428 03:28:16 -- host/failover.sh@18 -- # nvmftestinit 00:27:42.428 03:28:16 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:27:42.428 03:28:16 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:42.428 03:28:16 -- nvmf/common.sh@437 -- # prepare_net_devs 00:27:42.428 03:28:16 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:27:42.428 03:28:16 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:27:42.428 03:28:16 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:42.428 03:28:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:42.428 03:28:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:42.428 03:28:16 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:27:42.428 03:28:16 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:27:42.428 03:28:16 -- nvmf/common.sh@285 -- # xtrace_disable 00:27:42.428 03:28:16 -- common/autotest_common.sh@10 -- # set +x 00:27:47.697 03:28:22 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:47.697 03:28:22 -- nvmf/common.sh@291 -- # pci_devs=() 00:27:47.697 03:28:22 -- nvmf/common.sh@291 -- # local -a pci_devs 00:27:47.697 03:28:22 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:27:47.697 03:28:22 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:27:47.697 03:28:22 -- nvmf/common.sh@293 -- # pci_drivers=() 00:27:47.697 03:28:22 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:27:47.697 03:28:22 -- nvmf/common.sh@295 -- # net_devs=() 00:27:47.697 03:28:22 -- nvmf/common.sh@295 -- # local -ga net_devs 00:27:47.697 03:28:22 -- nvmf/common.sh@296 -- # e810=() 00:27:47.697 03:28:22 -- nvmf/common.sh@296 -- # local -ga e810 00:27:47.697 03:28:22 -- nvmf/common.sh@297 -- # x722=() 00:27:47.697 03:28:22 -- nvmf/common.sh@297 -- # local -ga x722 00:27:47.697 03:28:22 -- nvmf/common.sh@298 -- # mlx=() 00:27:47.697 03:28:22 -- nvmf/common.sh@298 -- # local -ga mlx 00:27:47.697 03:28:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:47.697 03:28:22 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:47.697 03:28:22 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:47.697 03:28:22 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:47.697 03:28:22 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:47.697 03:28:22 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:47.697 03:28:22 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:47.697 03:28:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:47.697 03:28:22 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:47.697 03:28:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:47.697 03:28:22 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:47.697 03:28:22 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:27:47.697 03:28:22 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:27:47.697 03:28:22 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:27:47.697 03:28:22 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:27:47.697 03:28:22 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:27:47.698 03:28:22 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:27:47.698 03:28:22 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:27:47.698 03:28:22 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:27:47.698 03:28:22 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:47.698 03:28:22 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:27:47.698 Found 0000:af:00.0 (0x8086 - 0x159b) 00:27:47.698 03:28:22 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:27:47.698 03:28:22 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:27:47.698 03:28:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:47.698 03:28:22 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:47.698 03:28:22 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:27:47.698 03:28:22 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:27:47.698 03:28:22 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:47.698 03:28:22 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:27:47.698 Found 0000:af:00.1 (0x8086 - 0x159b) 00:27:47.698 03:28:22 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:27:47.698 03:28:22 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:27:47.698 03:28:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:47.698 03:28:22 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:47.698 03:28:22 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:27:47.698 03:28:22 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:27:47.698 03:28:22 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:27:47.698 03:28:22 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:27:47.698 03:28:22 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:27:47.698 03:28:22 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:27:47.698 03:28:22 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:27:47.698 03:28:22 -- nvmf/common.sh@377 -- # modinfo irdma 00:27:47.698 03:28:22 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:27:47.698 03:28:22 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:47.698 03:28:22 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:47.698 03:28:22 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:47.698 03:28:22 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:47.698 03:28:22 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:27:47.698 Found net devices under 0000:af:00.0: cvl_0_0 00:27:47.698 03:28:22 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:47.698 03:28:22 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:47.698 03:28:22 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:47.698 03:28:22 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:47.698 03:28:22 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:47.698 03:28:22 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:27:47.698 Found net devices under 0000:af:00.1: cvl_0_1 00:27:47.698 03:28:22 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:47.698 03:28:22 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:27:47.698 03:28:22 -- nvmf/common.sh@403 -- # is_hw=yes 00:27:47.698 03:28:22 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:27:47.698 03:28:22 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:27:47.698 03:28:22 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:27:47.698 03:28:22 -- nvmf/common.sh@409 -- # rdma_device_init 00:27:47.698 03:28:22 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:27:47.698 03:28:22 -- nvmf/common.sh@58 -- # uname 00:27:47.698 03:28:22 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:27:47.698 03:28:22 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:27:47.698 03:28:22 -- nvmf/common.sh@63 -- # modprobe ib_core 00:27:47.698 03:28:22 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:27:47.698 03:28:22 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:27:47.698 03:28:22 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:27:47.698 03:28:22 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:27:47.698 03:28:22 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:27:47.698 03:28:22 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:27:47.698 03:28:22 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:27:47.698 03:28:22 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:27:47.698 03:28:22 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:27:47.698 03:28:22 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:27:47.698 03:28:22 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:27:47.698 03:28:22 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:27:47.698 03:28:22 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:27:47.698 03:28:22 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:47.698 03:28:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:47.698 03:28:22 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:27:47.698 03:28:22 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:27:47.698 03:28:22 -- nvmf/common.sh@105 -- # continue 2 00:27:47.698 03:28:22 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:47.698 03:28:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:47.698 03:28:22 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:27:47.698 03:28:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:47.698 03:28:22 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:27:47.698 03:28:22 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:27:47.698 03:28:22 -- nvmf/common.sh@105 -- # continue 2 00:27:47.698 03:28:22 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:27:47.698 03:28:22 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:27:47.698 03:28:22 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:27:47.698 03:28:22 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:27:47.698 03:28:22 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:47.698 03:28:22 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:47.698 03:28:22 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:27:47.698 03:28:22 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:27:47.698 03:28:22 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:27:47.956 50: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:27:47.956 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:27:47.956 altname enp175s0f0np0 00:27:47.956 altname ens801f0np0 00:27:47.956 inet 192.168.100.8/24 scope global cvl_0_0 00:27:47.956 valid_lft forever preferred_lft forever 00:27:47.956 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:27:47.956 valid_lft forever preferred_lft forever 00:27:47.956 03:28:22 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:27:47.956 03:28:22 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:27:47.956 03:28:22 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:27:47.956 03:28:22 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:27:47.956 03:28:22 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:47.956 03:28:22 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:47.956 03:28:22 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:27:47.956 03:28:22 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:27:47.956 03:28:22 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:27:47.956 51: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:27:47.956 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:27:47.956 altname enp175s0f1np1 00:27:47.956 altname ens801f1np1 00:27:47.956 inet 192.168.100.9/24 scope global cvl_0_1 00:27:47.956 valid_lft forever preferred_lft forever 00:27:47.956 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:27:47.956 valid_lft forever preferred_lft forever 00:27:47.956 03:28:22 -- nvmf/common.sh@411 -- # return 0 00:27:47.956 03:28:22 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:27:47.956 03:28:22 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:27:47.956 03:28:22 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:27:47.956 03:28:22 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:27:47.956 03:28:22 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:27:47.956 03:28:22 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:27:47.956 03:28:22 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:27:47.957 03:28:22 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:27:47.957 03:28:22 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:27:47.957 03:28:22 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:27:47.957 03:28:22 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:47.957 03:28:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:47.957 03:28:22 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:27:47.957 03:28:22 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:27:47.957 03:28:22 -- nvmf/common.sh@105 -- # continue 2 00:27:47.957 03:28:22 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:47.957 03:28:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:47.957 03:28:22 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:27:47.957 03:28:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:47.957 03:28:22 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:27:47.957 03:28:22 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:27:47.957 03:28:22 -- nvmf/common.sh@105 -- # continue 2 00:27:47.957 03:28:22 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:27:47.957 03:28:22 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:27:47.957 03:28:22 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:27:47.957 03:28:22 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:27:47.957 03:28:22 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:47.957 03:28:22 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:47.957 03:28:22 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:27:47.957 03:28:22 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:27:47.957 03:28:22 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:27:47.957 03:28:22 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:27:47.957 03:28:22 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:47.957 03:28:22 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:47.957 03:28:22 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:27:47.957 192.168.100.9' 00:27:47.957 03:28:22 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:27:47.957 192.168.100.9' 00:27:47.957 03:28:22 -- nvmf/common.sh@446 -- # head -n 1 00:27:47.957 03:28:22 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:27:47.957 03:28:22 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:27:47.957 192.168.100.9' 00:27:47.957 03:28:22 -- nvmf/common.sh@447 -- # tail -n +2 00:27:47.957 03:28:22 -- nvmf/common.sh@447 -- # head -n 1 00:27:47.957 03:28:22 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:27:47.957 03:28:22 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:27:47.957 03:28:22 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:27:47.957 03:28:22 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:27:47.957 03:28:22 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:27:47.957 03:28:22 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:27:47.957 03:28:22 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:27:47.957 03:28:22 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:27:47.957 03:28:22 -- common/autotest_common.sh@710 -- # xtrace_disable 00:27:47.957 03:28:22 -- common/autotest_common.sh@10 -- # set +x 00:27:47.957 03:28:22 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:47.957 03:28:22 -- nvmf/common.sh@470 -- # nvmfpid=40289 00:27:47.957 03:28:22 -- nvmf/common.sh@471 -- # waitforlisten 40289 00:27:47.957 03:28:22 -- common/autotest_common.sh@817 -- # '[' -z 40289 ']' 00:27:47.957 03:28:22 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:47.957 03:28:22 -- common/autotest_common.sh@822 -- # local max_retries=100 00:27:47.957 03:28:22 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:47.957 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:47.957 03:28:22 -- common/autotest_common.sh@826 -- # xtrace_disable 00:27:47.957 03:28:22 -- common/autotest_common.sh@10 -- # set +x 00:27:47.957 [2024-04-25 03:28:22.335922] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:27:47.957 [2024-04-25 03:28:22.335964] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:47.957 EAL: No free 2048 kB hugepages reported on node 1 00:27:47.957 [2024-04-25 03:28:22.394611] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:48.215 [2024-04-25 03:28:22.470863] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:48.215 [2024-04-25 03:28:22.470896] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:48.215 [2024-04-25 03:28:22.470903] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:27:48.215 [2024-04-25 03:28:22.470909] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:27:48.215 [2024-04-25 03:28:22.470914] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:48.215 [2024-04-25 03:28:22.471009] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:48.215 [2024-04-25 03:28:22.471117] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:48.215 [2024-04-25 03:28:22.471118] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:48.778 03:28:23 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:27:48.778 03:28:23 -- common/autotest_common.sh@850 -- # return 0 00:27:48.778 03:28:23 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:27:48.778 03:28:23 -- common/autotest_common.sh@716 -- # xtrace_disable 00:27:48.778 03:28:23 -- common/autotest_common.sh@10 -- # set +x 00:27:48.778 03:28:23 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:48.779 03:28:23 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:27:49.036 [2024-04-25 03:28:23.360902] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x23535c0/0x2352c00) succeed. 00:27:49.036 [2024-04-25 03:28:23.370620] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x23548f0/0x2353180) succeed. 00:27:49.036 [2024-04-25 03:28:23.370642] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:27:49.036 03:28:23 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:27:49.293 Malloc0 00:27:49.293 03:28:23 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:49.551 03:28:23 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:49.551 03:28:23 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:27:49.808 [2024-04-25 03:28:24.117362] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:27:49.808 03:28:24 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:27:49.808 [2024-04-25 03:28:24.281939] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:27:50.066 03:28:24 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4422 00:27:50.066 [2024-04-25 03:28:24.446483] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4422 *** 00:27:50.066 03:28:24 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:27:50.066 03:28:24 -- host/failover.sh@31 -- # bdevperf_pid=40550 00:27:50.066 03:28:24 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:50.066 03:28:24 -- host/failover.sh@34 -- # waitforlisten 40550 /var/tmp/bdevperf.sock 00:27:50.066 03:28:24 -- common/autotest_common.sh@817 -- # '[' -z 40550 ']' 00:27:50.066 03:28:24 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:27:50.066 03:28:24 -- common/autotest_common.sh@822 -- # local max_retries=100 00:27:50.066 03:28:24 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:27:50.066 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:27:50.066 03:28:24 -- common/autotest_common.sh@826 -- # xtrace_disable 00:27:50.066 03:28:24 -- common/autotest_common.sh@10 -- # set +x 00:27:50.999 03:28:25 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:27:50.999 03:28:25 -- common/autotest_common.sh@850 -- # return 0 00:27:50.999 03:28:25 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:51.257 NVMe0n1 00:27:51.257 03:28:25 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:51.515 00:27:51.515 03:28:25 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:27:51.515 03:28:25 -- host/failover.sh@39 -- # run_test_pid=40777 00:27:51.515 03:28:25 -- host/failover.sh@41 -- # sleep 1 00:27:52.449 03:28:26 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:27:52.707 03:28:26 -- host/failover.sh@45 -- # sleep 3 00:27:55.988 03:28:29 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:55.988 00:27:55.988 03:28:30 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:27:55.988 03:28:30 -- host/failover.sh@50 -- # sleep 3 00:27:59.266 03:28:33 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:27:59.266 [2024-04-25 03:28:33.585002] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:27:59.266 03:28:33 -- host/failover.sh@55 -- # sleep 1 00:28:00.199 03:28:34 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4422 00:28:00.474 03:28:34 -- host/failover.sh@59 -- # wait 40777 00:28:07.078 0 00:28:07.078 03:28:40 -- host/failover.sh@61 -- # killprocess 40550 00:28:07.078 03:28:40 -- common/autotest_common.sh@936 -- # '[' -z 40550 ']' 00:28:07.078 03:28:40 -- common/autotest_common.sh@940 -- # kill -0 40550 00:28:07.078 03:28:40 -- common/autotest_common.sh@941 -- # uname 00:28:07.078 03:28:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:07.078 03:28:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 40550 00:28:07.078 03:28:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:07.078 03:28:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:07.078 03:28:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 40550' 00:28:07.078 killing process with pid 40550 00:28:07.078 03:28:40 -- common/autotest_common.sh@955 -- # kill 40550 00:28:07.078 03:28:40 -- common/autotest_common.sh@960 -- # wait 40550 00:28:07.078 03:28:41 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:07.078 [2024-04-25 03:28:24.503713] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:28:07.078 [2024-04-25 03:28:24.503761] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid40550 ] 00:28:07.078 EAL: No free 2048 kB hugepages reported on node 1 00:28:07.078 [2024-04-25 03:28:24.562661] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:07.078 [2024-04-25 03:28:24.634602] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:07.078 Running I/O for 15 seconds... 00:28:07.078 [2024-04-25 03:28:27.486876] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:28:07.078 [2024-04-25 03:28:27.486919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:27392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.078 [2024-04-25 03:28:27.486929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.078 [2024-04-25 03:28:27.486943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:27400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.078 [2024-04-25 03:28:27.486951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.078 [2024-04-25 03:28:27.486959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:27408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.078 [2024-04-25 03:28:27.486966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.078 [2024-04-25 03:28:27.486975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:27416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.078 [2024-04-25 03:28:27.486981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.078 [2024-04-25 03:28:27.486989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.078 [2024-04-25 03:28:27.486996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.078 [2024-04-25 03:28:27.487004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:27432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.078 [2024-04-25 03:28:27.487010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.078 [2024-04-25 03:28:27.487018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:27440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.078 [2024-04-25 03:28:27.487024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.078 [2024-04-25 03:28:27.487034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:27448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.078 [2024-04-25 03:28:27.487041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.078 [2024-04-25 03:28:27.487048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:27456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.078 [2024-04-25 03:28:27.487055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.078 [2024-04-25 03:28:27.487063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:27464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.078 [2024-04-25 03:28:27.487069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.078 [2024-04-25 03:28:27.487082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:27472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.078 [2024-04-25 03:28:27.487089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.078 [2024-04-25 03:28:27.487097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:27480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.078 [2024-04-25 03:28:27.487103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.078 [2024-04-25 03:28:27.487111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:27488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.078 [2024-04-25 03:28:27.487118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.078 [2024-04-25 03:28:27.487125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:27496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.078 [2024-04-25 03:28:27.487131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.078 [2024-04-25 03:28:27.487139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:27504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.078 [2024-04-25 03:28:27.487145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.078 [2024-04-25 03:28:27.487154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:27512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.078 [2024-04-25 03:28:27.487160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.078 [2024-04-25 03:28:27.487168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:27520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.078 [2024-04-25 03:28:27.487175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.078 [2024-04-25 03:28:27.487183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:27528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.078 [2024-04-25 03:28:27.487189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.078 [2024-04-25 03:28:27.487197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:27536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.078 [2024-04-25 03:28:27.487203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.078 [2024-04-25 03:28:27.487211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:27544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.078 [2024-04-25 03:28:27.487218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.078 [2024-04-25 03:28:27.487226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:27552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.078 [2024-04-25 03:28:27.487232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.078 [2024-04-25 03:28:27.487240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:27560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.078 [2024-04-25 03:28:27.487247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.078 [2024-04-25 03:28:27.487254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:27568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.078 [2024-04-25 03:28:27.487262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.078 [2024-04-25 03:28:27.487270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.078 [2024-04-25 03:28:27.487276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.078 [2024-04-25 03:28:27.487284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:27584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.078 [2024-04-25 03:28:27.487290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.078 [2024-04-25 03:28:27.487297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:27592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.078 [2024-04-25 03:28:27.487303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.078 [2024-04-25 03:28:27.487311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:27600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.078 [2024-04-25 03:28:27.487317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.078 [2024-04-25 03:28:27.487325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:27608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.078 [2024-04-25 03:28:27.487331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.078 [2024-04-25 03:28:27.487339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:27616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.079 [2024-04-25 03:28:27.487345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:27624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.079 [2024-04-25 03:28:27.487359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:27632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.079 [2024-04-25 03:28:27.487373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:27640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.079 [2024-04-25 03:28:27.487387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:26624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007500000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:26632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007502000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:26640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007504000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007506000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:26656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007508000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:26664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750a000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:26672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750c000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:26680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750e000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:26688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007510000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:26696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007512000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:26704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007514000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:26712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007516000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:26720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007518000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:26728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751a000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:26736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751c000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:26744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751e000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:26752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007520000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:26760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007522000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:26768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007524000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:26776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007526000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:26784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007528000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:26792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752a000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:26800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752c000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:26808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752e000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:26816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007530000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:26824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007532000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:26832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007534000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:26840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007536000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:26848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007538000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:26856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753a000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:26864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753c000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:26872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753e000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007540000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:26888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007542000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:26896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007544000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:26904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007546000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:26912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007548000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:26920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754a000 len:0x1000 key:0xc77b45b4 00:28:07.079 [2024-04-25 03:28:27.487948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.079 [2024-04-25 03:28:27.487956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:26928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754c000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.487962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.487971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:26936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754e000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.487977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.487985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007550000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.487992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:26952 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007552000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:26960 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007554000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:26968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007556000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:26976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007558000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:26984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755a000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:26992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755c000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:27000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755e000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:27008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007560000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:27016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007562000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:27024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007564000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:27032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007566000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:27040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007568000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:27048 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756a000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:27056 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756c000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:27064 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756e000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:27072 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007570000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:27080 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007572000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:27088 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007574000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:27096 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007576000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:27104 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007578000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:27112 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757a000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:27120 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757c000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:27128 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757e000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:27136 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007580000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:27144 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007582000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27152 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007584000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:27160 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007586000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:27168 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007588000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:27176 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758a000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758c000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:27192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758e000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:27200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007590000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:27208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007592000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:27216 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007594000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:27224 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007596000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:27232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007598000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759a000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:27248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759c000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:27256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759e000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a0000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:27272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a2000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:27280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a4000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.080 [2024-04-25 03:28:27.488634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:27288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a6000 len:0x1000 key:0xc77b45b4 00:28:07.080 [2024-04-25 03:28:27.488640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:27.488648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:27296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a8000 len:0x1000 key:0xc77b45b4 00:28:07.081 [2024-04-25 03:28:27.488654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:27.488662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:27304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075aa000 len:0x1000 key:0xc77b45b4 00:28:07.081 [2024-04-25 03:28:27.488668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:27.488676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:27312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ac000 len:0x1000 key:0xc77b45b4 00:28:07.081 [2024-04-25 03:28:27.488682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:27.488690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:27320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ae000 len:0x1000 key:0xc77b45b4 00:28:07.081 [2024-04-25 03:28:27.488697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:27.488705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:27328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b0000 len:0x1000 key:0xc77b45b4 00:28:07.081 [2024-04-25 03:28:27.488711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:27.497951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:27336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b2000 len:0x1000 key:0xc77b45b4 00:28:07.081 [2024-04-25 03:28:27.497961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:27.497970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:27344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b4000 len:0x1000 key:0xc77b45b4 00:28:07.081 [2024-04-25 03:28:27.497978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:27.497986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:27352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b6000 len:0x1000 key:0xc77b45b4 00:28:07.081 [2024-04-25 03:28:27.497992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:27.498002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:27360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b8000 len:0x1000 key:0xc77b45b4 00:28:07.081 [2024-04-25 03:28:27.498009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:27.498017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:27368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ba000 len:0x1000 key:0xc77b45b4 00:28:07.081 [2024-04-25 03:28:27.498023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:27.498031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:27376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075bc000 len:0x1000 key:0xc77b45b4 00:28:07.081 [2024-04-25 03:28:27.498037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4a00 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:27.498361] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:07.081 [2024-04-25 03:28:27.498371] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:07.081 [2024-04-25 03:28:27.498377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:27384 len:8 PRP1 0x0 PRP2 0x0 00:28:07.081 [2024-04-25 03:28:27.498384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:27.498421] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4a00 was disconnected and freed. reset controller. 00:28:07.081 [2024-04-25 03:28:27.498431] bdev_nvme.c:1856:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4420 to 192.168.100.8:4421 00:28:07.081 [2024-04-25 03:28:27.498438] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:07.081 [2024-04-25 03:28:27.498471] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:28:07.081 [2024-04-25 03:28:27.498483] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:07.081 [2024-04-25 03:28:27.498489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2198610 sqhd:d080 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:27.498497] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:07.081 [2024-04-25 03:28:27.498504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2198610 sqhd:d080 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:27.498511] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:07.081 [2024-04-25 03:28:27.498517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2198610 sqhd:d080 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:27.498524] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:28:07.081 [2024-04-25 03:28:27.498530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2198610 sqhd:d080 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:27.514467] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:28:07.081 [2024-04-25 03:28:27.514486] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:28:07.081 [2024-04-25 03:28:27.514493] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:28:07.081 [2024-04-25 03:28:27.517262] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:07.081 [2024-04-25 03:28:27.566377] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:07.081 [2024-04-25 03:28:30.943874] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:28:07.081 [2024-04-25 03:28:30.943917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:59128 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a0000 len:0x1000 key:0x53b59af9 00:28:07.081 [2024-04-25 03:28:30.943927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:30.943940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:59136 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757c000 len:0x1000 key:0x53b59af9 00:28:07.081 [2024-04-25 03:28:30.943948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:30.943956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:59144 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757a000 len:0x1000 key:0x53b59af9 00:28:07.081 [2024-04-25 03:28:30.943962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:30.943971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:59152 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007578000 len:0x1000 key:0x53b59af9 00:28:07.081 [2024-04-25 03:28:30.943977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:30.943985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:59160 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007576000 len:0x1000 key:0x53b59af9 00:28:07.081 [2024-04-25 03:28:30.943992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:30.944000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:59168 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007574000 len:0x1000 key:0x53b59af9 00:28:07.081 [2024-04-25 03:28:30.944006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:30.944014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:59176 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007572000 len:0x1000 key:0x53b59af9 00:28:07.081 [2024-04-25 03:28:30.944020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:30.944028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:59184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007570000 len:0x1000 key:0x53b59af9 00:28:07.081 [2024-04-25 03:28:30.944034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:30.944042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:59192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b0000 len:0x1000 key:0x53b59af9 00:28:07.081 [2024-04-25 03:28:30.944048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:30.944056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:59200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758c000 len:0x1000 key:0x53b59af9 00:28:07.081 [2024-04-25 03:28:30.944062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:30.944070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:59208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758a000 len:0x1000 key:0x53b59af9 00:28:07.081 [2024-04-25 03:28:30.944080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:30.944087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:59216 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007588000 len:0x1000 key:0x53b59af9 00:28:07.081 [2024-04-25 03:28:30.944094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:30.944101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:59224 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007586000 len:0x1000 key:0x53b59af9 00:28:07.081 [2024-04-25 03:28:30.944107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:30.944116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:59232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007584000 len:0x1000 key:0x53b59af9 00:28:07.081 [2024-04-25 03:28:30.944123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:30.944130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:59240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007582000 len:0x1000 key:0x53b59af9 00:28:07.081 [2024-04-25 03:28:30.944137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:30.944145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:59248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754e000 len:0x1000 key:0x53b59af9 00:28:07.081 [2024-04-25 03:28:30.944151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:30.944159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:59704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.081 [2024-04-25 03:28:30.944166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.081 [2024-04-25 03:28:30.944173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:59712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:59720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:59728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:59736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:59744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:59752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:59760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:59256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007540000 len:0x1000 key:0x53b59af9 00:28:07.082 [2024-04-25 03:28:30.944279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:59264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007542000 len:0x1000 key:0x53b59af9 00:28:07.082 [2024-04-25 03:28:30.944294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:59272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007544000 len:0x1000 key:0x53b59af9 00:28:07.082 [2024-04-25 03:28:30.944308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:59280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007546000 len:0x1000 key:0x53b59af9 00:28:07.082 [2024-04-25 03:28:30.944322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:59288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007548000 len:0x1000 key:0x53b59af9 00:28:07.082 [2024-04-25 03:28:30.944336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:59296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754a000 len:0x1000 key:0x53b59af9 00:28:07.082 [2024-04-25 03:28:30.944350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:59304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754c000 len:0x1000 key:0x53b59af9 00:28:07.082 [2024-04-25 03:28:30.944364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:59312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759e000 len:0x1000 key:0x53b59af9 00:28:07.082 [2024-04-25 03:28:30.944378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:59768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:59776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:59784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:59792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:59800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:59808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:59816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:59824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:59832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:59840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:59848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:59856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:59864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:59872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:59880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:59888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:59896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:59904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:59912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:59920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:59928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:59936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:59944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.082 [2024-04-25 03:28:30.944703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:59320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b2000 len:0x1000 key:0x53b59af9 00:28:07.082 [2024-04-25 03:28:30.944717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:59328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b4000 len:0x1000 key:0x53b59af9 00:28:07.082 [2024-04-25 03:28:30.944731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:59336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b6000 len:0x1000 key:0x53b59af9 00:28:07.082 [2024-04-25 03:28:30.944745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.082 [2024-04-25 03:28:30.944754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:59344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b8000 len:0x1000 key:0x53b59af9 00:28:07.083 [2024-04-25 03:28:30.944760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.944768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:59352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ba000 len:0x1000 key:0x53b59af9 00:28:07.083 [2024-04-25 03:28:30.944775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.944783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:59360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075bc000 len:0x1000 key:0x53b59af9 00:28:07.083 [2024-04-25 03:28:30.944789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.944797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:59368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075be000 len:0x1000 key:0x53b59af9 00:28:07.083 [2024-04-25 03:28:30.944804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.944811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:59376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757e000 len:0x1000 key:0x53b59af9 00:28:07.083 [2024-04-25 03:28:30.944817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.944825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:59952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.083 [2024-04-25 03:28:30.944831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.944839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:59960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.083 [2024-04-25 03:28:30.944846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.944853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:59968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.083 [2024-04-25 03:28:30.944865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.944872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:59976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.083 [2024-04-25 03:28:30.944879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.944886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:59984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.083 [2024-04-25 03:28:30.944893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.944900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:59992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.083 [2024-04-25 03:28:30.944907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.944915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:60000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.083 [2024-04-25 03:28:30.944922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.944931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:60008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.083 [2024-04-25 03:28:30.944937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.944945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:59384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007522000 len:0x1000 key:0x53b59af9 00:28:07.083 [2024-04-25 03:28:30.944952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.944959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:59392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007524000 len:0x1000 key:0x53b59af9 00:28:07.083 [2024-04-25 03:28:30.944965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.944973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:59400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007526000 len:0x1000 key:0x53b59af9 00:28:07.083 [2024-04-25 03:28:30.944979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.944987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:59408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007528000 len:0x1000 key:0x53b59af9 00:28:07.083 [2024-04-25 03:28:30.944993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.945001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:59416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752a000 len:0x1000 key:0x53b59af9 00:28:07.083 [2024-04-25 03:28:30.945010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.945018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:59424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752c000 len:0x1000 key:0x53b59af9 00:28:07.083 [2024-04-25 03:28:30.945024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.945032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:59432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752e000 len:0x1000 key:0x53b59af9 00:28:07.083 [2024-04-25 03:28:30.945038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.945046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:59440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007530000 len:0x1000 key:0x53b59af9 00:28:07.083 [2024-04-25 03:28:30.945052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.945060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:60016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.083 [2024-04-25 03:28:30.945066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.945074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:60024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.083 [2024-04-25 03:28:30.945082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.945090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:60032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.083 [2024-04-25 03:28:30.945098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.945106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:60040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.083 [2024-04-25 03:28:30.945112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.945119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:60048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.083 [2024-04-25 03:28:30.945125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.945133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:60056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.083 [2024-04-25 03:28:30.945140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.945149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:60064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.083 [2024-04-25 03:28:30.945155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.945163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:60072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.083 [2024-04-25 03:28:30.945169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.945177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:60080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.083 [2024-04-25 03:28:30.945183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.945191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:60088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.083 [2024-04-25 03:28:30.945197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.945205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:60096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.083 [2024-04-25 03:28:30.945211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.945218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:60104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.083 [2024-04-25 03:28:30.945224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.945232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:60112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.083 [2024-04-25 03:28:30.945238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.945246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:60120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.083 [2024-04-25 03:28:30.945252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.945260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:60128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.083 [2024-04-25 03:28:30.945267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.945275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:60136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.083 [2024-04-25 03:28:30.945281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.945288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:60144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.083 [2024-04-25 03:28:30.945295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.945304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:59448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007550000 len:0x1000 key:0x53b59af9 00:28:07.083 [2024-04-25 03:28:30.945310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.945318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:59456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007552000 len:0x1000 key:0x53b59af9 00:28:07.083 [2024-04-25 03:28:30.945324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.945332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:59464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007554000 len:0x1000 key:0x53b59af9 00:28:07.083 [2024-04-25 03:28:30.945338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.945346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:59472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007556000 len:0x1000 key:0x53b59af9 00:28:07.083 [2024-04-25 03:28:30.945352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.083 [2024-04-25 03:28:30.945360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:59480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007558000 len:0x1000 key:0x53b59af9 00:28:07.083 [2024-04-25 03:28:30.945366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:30.945374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:59488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755a000 len:0x1000 key:0x53b59af9 00:28:07.084 [2024-04-25 03:28:30.945380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:30.945388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:59496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755c000 len:0x1000 key:0x53b59af9 00:28:07.084 [2024-04-25 03:28:30.945394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:30.945402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:59504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755e000 len:0x1000 key:0x53b59af9 00:28:07.084 [2024-04-25 03:28:30.945409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:30.945416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:59512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007560000 len:0x1000 key:0x53b59af9 00:28:07.084 [2024-04-25 03:28:30.945422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:30.945433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:59520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759c000 len:0x1000 key:0x53b59af9 00:28:07.084 [2024-04-25 03:28:30.945440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:30.945447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:59528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759a000 len:0x1000 key:0x53b59af9 00:28:07.084 [2024-04-25 03:28:30.945454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:30.945462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:59536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007598000 len:0x1000 key:0x53b59af9 00:28:07.084 [2024-04-25 03:28:30.945468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:30.945475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:59544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007596000 len:0x1000 key:0x53b59af9 00:28:07.084 [2024-04-25 03:28:30.945482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:30.945489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:59552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007594000 len:0x1000 key:0x53b59af9 00:28:07.084 [2024-04-25 03:28:30.945496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:30.945503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:59560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007592000 len:0x1000 key:0x53b59af9 00:28:07.084 [2024-04-25 03:28:30.945510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:30.945518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:59568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007590000 len:0x1000 key:0x53b59af9 00:28:07.084 [2024-04-25 03:28:30.945524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:30.945532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:59576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007580000 len:0x1000 key:0x53b59af9 00:28:07.084 [2024-04-25 03:28:30.945538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:30.945545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:59584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007532000 len:0x1000 key:0x53b59af9 00:28:07.084 [2024-04-25 03:28:30.945552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:30.945559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:59592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007534000 len:0x1000 key:0x53b59af9 00:28:07.084 [2024-04-25 03:28:30.945566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:30.945573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:59600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007536000 len:0x1000 key:0x53b59af9 00:28:07.084 [2024-04-25 03:28:30.945579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:30.945587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:59608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007538000 len:0x1000 key:0x53b59af9 00:28:07.084 [2024-04-25 03:28:30.945595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:30.945603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:59616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753a000 len:0x1000 key:0x53b59af9 00:28:07.084 [2024-04-25 03:28:30.945609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:30.945617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:59624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753c000 len:0x1000 key:0x53b59af9 00:28:07.084 [2024-04-25 03:28:30.945623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:30.945631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:59632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753e000 len:0x1000 key:0x53b59af9 00:28:07.084 [2024-04-25 03:28:30.945637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:30.945645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:59640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ae000 len:0x1000 key:0x53b59af9 00:28:07.084 [2024-04-25 03:28:30.945651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:30.945659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:59648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ac000 len:0x1000 key:0x53b59af9 00:28:07.084 [2024-04-25 03:28:30.945665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:30.945673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:59656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075aa000 len:0x1000 key:0x53b59af9 00:28:07.084 [2024-04-25 03:28:30.945679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:30.945687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:59664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a8000 len:0x1000 key:0x53b59af9 00:28:07.084 [2024-04-25 03:28:30.945693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:30.945700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:59672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a6000 len:0x1000 key:0x53b59af9 00:28:07.084 [2024-04-25 03:28:30.945707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:30.945715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:59680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a4000 len:0x1000 key:0x53b59af9 00:28:07.084 [2024-04-25 03:28:30.945722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:30.945731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:59688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a2000 len:0x1000 key:0x53b59af9 00:28:07.084 [2024-04-25 03:28:30.945737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:215e6f0 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:30.945988] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:07.084 [2024-04-25 03:28:30.946002] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:07.084 [2024-04-25 03:28:30.946008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:59696 len:8 PRP1 0x0 PRP2 0x0 00:28:07.084 [2024-04-25 03:28:30.946015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:30.946050] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4940 was disconnected and freed. reset controller. 00:28:07.084 [2024-04-25 03:28:30.946058] bdev_nvme.c:1856:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4421 to 192.168.100.8:4422 00:28:07.084 [2024-04-25 03:28:30.946066] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:07.084 [2024-04-25 03:28:30.948835] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:07.084 [2024-04-25 03:28:30.948874] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:28:07.084 [2024-04-25 03:28:30.962097] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:28:07.084 [2024-04-25 03:28:31.003981] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:07.084 [2024-04-25 03:28:35.358878] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:28:07.084 [2024-04-25 03:28:35.358917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:106696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.084 [2024-04-25 03:28:35.358927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:35.358941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:106704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.084 [2024-04-25 03:28:35.358948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:35.358956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:106712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.084 [2024-04-25 03:28:35.358962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:35.358970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:106720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.084 [2024-04-25 03:28:35.358976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:35.358984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:106728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.084 [2024-04-25 03:28:35.358991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:35.358999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:106736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.084 [2024-04-25 03:28:35.359005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:35.359013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:106744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.084 [2024-04-25 03:28:35.359019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:35.359027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:106752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.084 [2024-04-25 03:28:35.359038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:35.359045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:106760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.084 [2024-04-25 03:28:35.359052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:35.359060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:106768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.084 [2024-04-25 03:28:35.359066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:35.359074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:106776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.084 [2024-04-25 03:28:35.359080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:35.359088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:106784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.084 [2024-04-25 03:28:35.359093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:35.359101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:106792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.084 [2024-04-25 03:28:35.359108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:35.359116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:106800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.084 [2024-04-25 03:28:35.359123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:35.359131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:106808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.084 [2024-04-25 03:28:35.359137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:35.359145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:106816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.084 [2024-04-25 03:28:35.359152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.084 [2024-04-25 03:28:35.359160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:106824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.084 [2024-04-25 03:28:35.359167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:106832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.085 [2024-04-25 03:28:35.359182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:106840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.085 [2024-04-25 03:28:35.359196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:106848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.085 [2024-04-25 03:28:35.359210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:106856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.085 [2024-04-25 03:28:35.359226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:106864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.085 [2024-04-25 03:28:35.359240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:106872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.085 [2024-04-25 03:28:35.359254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:106232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751e000 len:0x1000 key:0x792a531 00:28:07.085 [2024-04-25 03:28:35.359270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:106240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007560000 len:0x1000 key:0x792a531 00:28:07.085 [2024-04-25 03:28:35.359284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:106248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b4000 len:0x1000 key:0x792a531 00:28:07.085 [2024-04-25 03:28:35.359299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:106256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759a000 len:0x1000 key:0x792a531 00:28:07.085 [2024-04-25 03:28:35.359313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:106264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007598000 len:0x1000 key:0x792a531 00:28:07.085 [2024-04-25 03:28:35.359327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:106272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007596000 len:0x1000 key:0x792a531 00:28:07.085 [2024-04-25 03:28:35.359342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:106280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007594000 len:0x1000 key:0x792a531 00:28:07.085 [2024-04-25 03:28:35.359356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:106880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.085 [2024-04-25 03:28:35.359370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:106888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.085 [2024-04-25 03:28:35.359385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:106896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.085 [2024-04-25 03:28:35.359399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:106904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.085 [2024-04-25 03:28:35.359414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:106912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.085 [2024-04-25 03:28:35.359427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:106920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.085 [2024-04-25 03:28:35.359441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:106288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758e000 len:0x1000 key:0x792a531 00:28:07.085 [2024-04-25 03:28:35.359455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:106296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007562000 len:0x1000 key:0x792a531 00:28:07.085 [2024-04-25 03:28:35.359469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:106304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a4000 len:0x1000 key:0x792a531 00:28:07.085 [2024-04-25 03:28:35.359483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:106312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a6000 len:0x1000 key:0x792a531 00:28:07.085 [2024-04-25 03:28:35.359497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:106320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a8000 len:0x1000 key:0x792a531 00:28:07.085 [2024-04-25 03:28:35.359511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:106328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075aa000 len:0x1000 key:0x792a531 00:28:07.085 [2024-04-25 03:28:35.359525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:106336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756c000 len:0x1000 key:0x792a531 00:28:07.085 [2024-04-25 03:28:35.359539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:106344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756e000 len:0x1000 key:0x792a531 00:28:07.085 [2024-04-25 03:28:35.359555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:106352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a0000 len:0x1000 key:0x792a531 00:28:07.085 [2024-04-25 03:28:35.359569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:106360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757c000 len:0x1000 key:0x792a531 00:28:07.085 [2024-04-25 03:28:35.359584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:106368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757a000 len:0x1000 key:0x792a531 00:28:07.085 [2024-04-25 03:28:35.359598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:106376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007578000 len:0x1000 key:0x792a531 00:28:07.085 [2024-04-25 03:28:35.359611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:106384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007576000 len:0x1000 key:0x792a531 00:28:07.085 [2024-04-25 03:28:35.359625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:106392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007574000 len:0x1000 key:0x792a531 00:28:07.085 [2024-04-25 03:28:35.359639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:106400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007572000 len:0x1000 key:0x792a531 00:28:07.085 [2024-04-25 03:28:35.359654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:106408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007570000 len:0x1000 key:0x792a531 00:28:07.085 [2024-04-25 03:28:35.359668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:106928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.085 [2024-04-25 03:28:35.359682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:106936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.085 [2024-04-25 03:28:35.359695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:106944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.085 [2024-04-25 03:28:35.359711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:106952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.085 [2024-04-25 03:28:35.359725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:106960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.085 [2024-04-25 03:28:35.359738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.085 [2024-04-25 03:28:35.359746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:106968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.085 [2024-04-25 03:28:35.359752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.359760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:106976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.359766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.359773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:106984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.359779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.359787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:106992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.359793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.359801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:107000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.359807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.359815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:107008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.359821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.359829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:107016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.359834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.359842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:107024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.359848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.359860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:107032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.359867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.359874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:107040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.359882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.359890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:107048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.359896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.359904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:107056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.359910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.359917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:107064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.359924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.359931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:107072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.359937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.359945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:107080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.359951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.359959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:107088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.359965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.359972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:107096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.359978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.359986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:107104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.359992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.360000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:107112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.360006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.360014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:106416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007510000 len:0x1000 key:0x792a531 00:28:07.086 [2024-04-25 03:28:35.360020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.360028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:106424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007512000 len:0x1000 key:0x792a531 00:28:07.086 [2024-04-25 03:28:35.360034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.360043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:107120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.360050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.360059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:107128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.360065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.360073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:107136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.360079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.360086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:107144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.360092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.360101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:107152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.360108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.360116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:107160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.360122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.360129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:107168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.360136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.360143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:107176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.360149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.360157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:107184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.360163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.360171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:107192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.360177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.360185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:107200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.360191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.360198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:107208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.360205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.360213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:107216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.360219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.360228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:107224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.360234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.360242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:107232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.360248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.360258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:107240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.086 [2024-04-25 03:28:35.360264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.360272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:106432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ca000 len:0x1000 key:0x792a531 00:28:07.086 [2024-04-25 03:28:35.360279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.360286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:106440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c8000 len:0x1000 key:0x792a531 00:28:07.086 [2024-04-25 03:28:35.360293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.360301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:106448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c6000 len:0x1000 key:0x792a531 00:28:07.086 [2024-04-25 03:28:35.360307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.360315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:106456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c4000 len:0x1000 key:0x792a531 00:28:07.086 [2024-04-25 03:28:35.360322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.360331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:106464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c2000 len:0x1000 key:0x792a531 00:28:07.086 [2024-04-25 03:28:35.360337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.360345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:106472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c0000 len:0x1000 key:0x792a531 00:28:07.086 [2024-04-25 03:28:35.360352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.360359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:106480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007500000 len:0x1000 key:0x792a531 00:28:07.086 [2024-04-25 03:28:35.360366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.360374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:106488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007502000 len:0x1000 key:0x792a531 00:28:07.086 [2024-04-25 03:28:35.360381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.086 [2024-04-25 03:28:35.360389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:106496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007504000 len:0x1000 key:0x792a531 00:28:07.086 [2024-04-25 03:28:35.360397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.087 [2024-04-25 03:28:35.360405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:106504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007506000 len:0x1000 key:0x792a531 00:28:07.087 [2024-04-25 03:28:35.360411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.087 [2024-04-25 03:28:35.360419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:106512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007508000 len:0x1000 key:0x792a531 00:28:07.087 [2024-04-25 03:28:35.360426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.087 [2024-04-25 03:28:35.360434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:106520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750a000 len:0x1000 key:0x792a531 00:28:07.087 [2024-04-25 03:28:35.360440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.087 [2024-04-25 03:28:35.360448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:106528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750c000 len:0x1000 key:0x792a531 00:28:07.087 [2024-04-25 03:28:35.360454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.087 [2024-04-25 03:28:35.360462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:106536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750e000 len:0x1000 key:0x792a531 00:28:07.087 [2024-04-25 03:28:35.360469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.087 [2024-04-25 03:28:35.360477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:106544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007550000 len:0x1000 key:0x792a531 00:28:07.087 [2024-04-25 03:28:35.360484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.087 [2024-04-25 03:28:35.360492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:106552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007552000 len:0x1000 key:0x792a531 00:28:07.087 [2024-04-25 03:28:35.360498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.087 [2024-04-25 03:28:35.360506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:106560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007514000 len:0x1000 key:0x792a531 00:28:07.087 [2024-04-25 03:28:35.360513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.087 [2024-04-25 03:28:35.360521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:106568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007516000 len:0x1000 key:0x792a531 00:28:07.087 [2024-04-25 03:28:35.360528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.087 [2024-04-25 03:28:35.360537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:106576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007518000 len:0x1000 key:0x792a531 00:28:07.087 [2024-04-25 03:28:35.360543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.087 [2024-04-25 03:28:35.360551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:106584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751a000 len:0x1000 key:0x792a531 00:28:07.087 [2024-04-25 03:28:35.360558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.087 [2024-04-25 03:28:35.360566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:106592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751c000 len:0x1000 key:0x792a531 00:28:07.087 [2024-04-25 03:28:35.360573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.087 [2024-04-25 03:28:35.360581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:106600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b2000 len:0x1000 key:0x792a531 00:28:07.087 [2024-04-25 03:28:35.360587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.087 [2024-04-25 03:28:35.360595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:106608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007520000 len:0x1000 key:0x792a531 00:28:07.087 [2024-04-25 03:28:35.360602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.087 [2024-04-25 03:28:35.360610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:106616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754c000 len:0x1000 key:0x792a531 00:28:07.087 [2024-04-25 03:28:35.360616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.087 [2024-04-25 03:28:35.360623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:107248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:07.087 [2024-04-25 03:28:35.360630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.087 [2024-04-25 03:28:35.360638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:106624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759c000 len:0x1000 key:0x792a531 00:28:07.087 [2024-04-25 03:28:35.360644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.087 [2024-04-25 03:28:35.360652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:106632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007564000 len:0x1000 key:0x792a531 00:28:07.087 [2024-04-25 03:28:35.360658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.087 [2024-04-25 03:28:35.360666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:106640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007566000 len:0x1000 key:0x792a531 00:28:07.087 [2024-04-25 03:28:35.360672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.087 [2024-04-25 03:28:35.360680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:106648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007568000 len:0x1000 key:0x792a531 00:28:07.087 [2024-04-25 03:28:35.360687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.087 [2024-04-25 03:28:35.360696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:106656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756a000 len:0x1000 key:0x792a531 00:28:07.087 [2024-04-25 03:28:35.360702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.087 [2024-04-25 03:28:35.360710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:106664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007542000 len:0x1000 key:0x792a531 00:28:07.087 [2024-04-25 03:28:35.360716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.087 [2024-04-25 03:28:35.360726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:106672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007540000 len:0x1000 key:0x792a531 00:28:07.087 [2024-04-25 03:28:35.360732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.087 [2024-04-25 03:28:35.360741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:106680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754e000 len:0x1000 key:0x792a531 00:28:07.087 [2024-04-25 03:28:35.360747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2198610 sqhd:4940 p:0 m:0 dnr:0 00:28:07.087 [2024-04-25 03:28:35.361018] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:07.087 [2024-04-25 03:28:35.361029] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:07.087 [2024-04-25 03:28:35.361035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:106688 len:8 PRP1 0x0 PRP2 0x0 00:28:07.087 [2024-04-25 03:28:35.361042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:07.087 [2024-04-25 03:28:35.361079] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4940 was disconnected and freed. reset controller. 00:28:07.087 [2024-04-25 03:28:35.361088] bdev_nvme.c:1856:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4422 to 192.168.100.8:4420 00:28:07.087 [2024-04-25 03:28:35.361095] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:07.087 [2024-04-25 03:28:35.363845] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:07.087 [2024-04-25 03:28:35.363886] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:28:07.087 [2024-04-25 03:28:35.376822] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:28:07.087 [2024-04-25 03:28:35.426133] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:07.087 00:28:07.087 Latency(us) 00:28:07.087 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:07.087 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:07.087 Verification LBA range: start 0x0 length 0x4000 00:28:07.087 NVMe0n1 : 15.01 16187.12 63.23 317.54 0.00 7733.89 343.28 583207.98 00:28:07.087 =================================================================================================================== 00:28:07.087 Total : 16187.12 63.23 317.54 0.00 7733.89 343.28 583207.98 00:28:07.087 Received shutdown signal, test time was about 15.000000 seconds 00:28:07.087 00:28:07.087 Latency(us) 00:28:07.087 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:07.087 =================================================================================================================== 00:28:07.087 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:28:07.087 03:28:41 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:28:07.087 03:28:41 -- host/failover.sh@65 -- # count=3 00:28:07.087 03:28:41 -- host/failover.sh@67 -- # (( count != 3 )) 00:28:07.087 03:28:41 -- host/failover.sh@73 -- # bdevperf_pid=43267 00:28:07.087 03:28:41 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:28:07.087 03:28:41 -- host/failover.sh@75 -- # waitforlisten 43267 /var/tmp/bdevperf.sock 00:28:07.087 03:28:41 -- common/autotest_common.sh@817 -- # '[' -z 43267 ']' 00:28:07.087 03:28:41 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:07.087 03:28:41 -- common/autotest_common.sh@822 -- # local max_retries=100 00:28:07.087 03:28:41 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:07.087 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:07.087 03:28:41 -- common/autotest_common.sh@826 -- # xtrace_disable 00:28:07.087 03:28:41 -- common/autotest_common.sh@10 -- # set +x 00:28:07.651 03:28:42 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:28:07.651 03:28:42 -- common/autotest_common.sh@850 -- # return 0 00:28:07.651 03:28:42 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:28:07.908 [2024-04-25 03:28:42.198531] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:28:07.908 03:28:42 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4422 00:28:07.908 [2024-04-25 03:28:42.379171] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4422 *** 00:28:07.908 03:28:42 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:08.166 NVMe0n1 00:28:08.166 03:28:42 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:08.423 00:28:08.423 03:28:42 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:08.680 00:28:08.680 03:28:43 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:08.680 03:28:43 -- host/failover.sh@82 -- # grep -q NVMe0 00:28:08.937 03:28:43 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:09.194 03:28:43 -- host/failover.sh@87 -- # sleep 3 00:28:12.469 03:28:46 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:12.469 03:28:46 -- host/failover.sh@88 -- # grep -q NVMe0 00:28:12.469 03:28:46 -- host/failover.sh@90 -- # run_test_pid=44176 00:28:12.469 03:28:46 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:12.469 03:28:46 -- host/failover.sh@92 -- # wait 44176 00:28:13.402 0 00:28:13.402 03:28:47 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:13.402 [2024-04-25 03:28:41.237823] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:28:13.402 [2024-04-25 03:28:41.237880] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid43267 ] 00:28:13.402 EAL: No free 2048 kB hugepages reported on node 1 00:28:13.402 [2024-04-25 03:28:41.299418] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:13.402 [2024-04-25 03:28:41.364776] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:13.402 [2024-04-25 03:28:43.463340] bdev_nvme.c:1856:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4420 to 192.168.100.8:4421 00:28:13.402 [2024-04-25 03:28:43.464615] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:13.402 [2024-04-25 03:28:43.464646] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:13.402 [2024-04-25 03:28:43.485413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:28:13.402 [2024-04-25 03:28:43.502913] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:13.402 Running I/O for 1 seconds... 00:28:13.402 00:28:13.402 Latency(us) 00:28:13.402 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:13.402 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:13.402 Verification LBA range: start 0x0 length 0x4000 00:28:13.402 NVMe0n1 : 1.01 18388.98 71.83 0.00 0.00 6916.42 1380.94 11734.06 00:28:13.402 =================================================================================================================== 00:28:13.402 Total : 18388.98 71.83 0.00 0.00 6916.42 1380.94 11734.06 00:28:13.402 03:28:47 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:13.402 03:28:47 -- host/failover.sh@95 -- # grep -q NVMe0 00:28:13.660 03:28:47 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t rdma -a 192.168.100.8 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:13.660 03:28:48 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:13.660 03:28:48 -- host/failover.sh@99 -- # grep -q NVMe0 00:28:13.918 03:28:48 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t rdma -a 192.168.100.8 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:14.176 03:28:48 -- host/failover.sh@101 -- # sleep 3 00:28:17.461 03:28:51 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:17.462 03:28:51 -- host/failover.sh@103 -- # grep -q NVMe0 00:28:17.462 03:28:51 -- host/failover.sh@108 -- # killprocess 43267 00:28:17.462 03:28:51 -- common/autotest_common.sh@936 -- # '[' -z 43267 ']' 00:28:17.462 03:28:51 -- common/autotest_common.sh@940 -- # kill -0 43267 00:28:17.462 03:28:51 -- common/autotest_common.sh@941 -- # uname 00:28:17.462 03:28:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:17.462 03:28:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 43267 00:28:17.462 03:28:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:17.462 03:28:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:17.462 03:28:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 43267' 00:28:17.462 killing process with pid 43267 00:28:17.462 03:28:51 -- common/autotest_common.sh@955 -- # kill 43267 00:28:17.462 03:28:51 -- common/autotest_common.sh@960 -- # wait 43267 00:28:17.462 03:28:51 -- host/failover.sh@110 -- # sync 00:28:17.462 03:28:51 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:17.721 03:28:52 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:28:17.721 03:28:52 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:17.721 03:28:52 -- host/failover.sh@116 -- # nvmftestfini 00:28:17.721 03:28:52 -- nvmf/common.sh@477 -- # nvmfcleanup 00:28:17.721 03:28:52 -- nvmf/common.sh@117 -- # sync 00:28:17.721 03:28:52 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:28:17.721 03:28:52 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:28:17.721 03:28:52 -- nvmf/common.sh@120 -- # set +e 00:28:17.721 03:28:52 -- nvmf/common.sh@121 -- # for i in {1..20} 00:28:17.721 03:28:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:28:17.721 rmmod nvme_rdma 00:28:17.721 rmmod nvme_fabrics 00:28:17.721 03:28:52 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:28:17.721 03:28:52 -- nvmf/common.sh@124 -- # set -e 00:28:17.721 03:28:52 -- nvmf/common.sh@125 -- # return 0 00:28:17.721 03:28:52 -- nvmf/common.sh@478 -- # '[' -n 40289 ']' 00:28:17.721 03:28:52 -- nvmf/common.sh@479 -- # killprocess 40289 00:28:17.721 03:28:52 -- common/autotest_common.sh@936 -- # '[' -z 40289 ']' 00:28:17.721 03:28:52 -- common/autotest_common.sh@940 -- # kill -0 40289 00:28:17.721 03:28:52 -- common/autotest_common.sh@941 -- # uname 00:28:17.721 03:28:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:17.721 03:28:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 40289 00:28:17.721 03:28:52 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:28:17.721 03:28:52 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:28:17.721 03:28:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 40289' 00:28:17.721 killing process with pid 40289 00:28:17.721 03:28:52 -- common/autotest_common.sh@955 -- # kill 40289 00:28:17.721 03:28:52 -- common/autotest_common.sh@960 -- # wait 40289 00:28:17.980 [2024-04-25 03:28:52.235004] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:28:17.980 03:28:52 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:28:17.980 03:28:52 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:28:17.980 00:28:17.980 real 0m35.899s 00:28:17.980 user 2m2.911s 00:28:17.980 sys 0m6.051s 00:28:17.980 03:28:52 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:28:17.980 03:28:52 -- common/autotest_common.sh@10 -- # set +x 00:28:17.980 ************************************ 00:28:17.980 END TEST nvmf_failover 00:28:17.980 ************************************ 00:28:18.240 03:28:52 -- nvmf/nvmf.sh@99 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=rdma 00:28:18.240 03:28:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:18.240 03:28:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:18.240 03:28:52 -- common/autotest_common.sh@10 -- # set +x 00:28:18.240 ************************************ 00:28:18.240 START TEST nvmf_discovery 00:28:18.240 ************************************ 00:28:18.240 03:28:52 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=rdma 00:28:18.240 * Looking for test storage... 00:28:18.240 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host 00:28:18.240 03:28:52 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:28:18.240 03:28:52 -- nvmf/common.sh@7 -- # uname -s 00:28:18.240 03:28:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:18.240 03:28:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:18.240 03:28:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:18.240 03:28:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:18.240 03:28:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:18.240 03:28:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:18.240 03:28:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:18.240 03:28:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:18.240 03:28:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:18.240 03:28:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:18.240 03:28:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:28:18.240 03:28:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:28:18.240 03:28:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:18.240 03:28:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:18.240 03:28:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:18.240 03:28:52 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:28:18.240 03:28:52 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:28:18.240 03:28:52 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:18.240 03:28:52 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:18.240 03:28:52 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:18.240 03:28:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:18.240 03:28:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:18.240 03:28:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:18.240 03:28:52 -- paths/export.sh@5 -- # export PATH 00:28:18.240 03:28:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:18.240 03:28:52 -- nvmf/common.sh@47 -- # : 0 00:28:18.240 03:28:52 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:28:18.240 03:28:52 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:28:18.240 03:28:52 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:28:18.240 03:28:52 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:18.240 03:28:52 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:18.240 03:28:52 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:28:18.240 03:28:52 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:28:18.240 03:28:52 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:28:18.240 03:28:52 -- host/discovery.sh@11 -- # '[' rdma == rdma ']' 00:28:18.240 03:28:52 -- host/discovery.sh@12 -- # echo 'Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target.' 00:28:18.240 Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target. 00:28:18.240 03:28:52 -- host/discovery.sh@13 -- # exit 0 00:28:18.240 00:28:18.240 real 0m0.114s 00:28:18.240 user 0m0.051s 00:28:18.240 sys 0m0.068s 00:28:18.240 03:28:52 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:28:18.240 03:28:52 -- common/autotest_common.sh@10 -- # set +x 00:28:18.240 ************************************ 00:28:18.240 END TEST nvmf_discovery 00:28:18.240 ************************************ 00:28:18.500 03:28:52 -- nvmf/nvmf.sh@100 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=rdma 00:28:18.500 03:28:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:18.500 03:28:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:18.500 03:28:52 -- common/autotest_common.sh@10 -- # set +x 00:28:18.500 ************************************ 00:28:18.500 START TEST nvmf_discovery_remove_ifc 00:28:18.500 ************************************ 00:28:18.500 03:28:52 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=rdma 00:28:18.500 * Looking for test storage... 00:28:18.500 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host 00:28:18.500 03:28:52 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:28:18.500 03:28:52 -- nvmf/common.sh@7 -- # uname -s 00:28:18.500 03:28:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:18.500 03:28:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:18.500 03:28:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:18.500 03:28:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:18.500 03:28:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:18.500 03:28:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:18.500 03:28:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:18.500 03:28:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:18.500 03:28:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:18.500 03:28:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:18.500 03:28:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:28:18.500 03:28:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:28:18.500 03:28:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:18.500 03:28:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:18.500 03:28:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:18.758 03:28:52 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:28:18.758 03:28:52 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:28:18.758 03:28:53 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:18.758 03:28:53 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:18.758 03:28:53 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:18.758 03:28:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:18.758 03:28:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:18.758 03:28:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:18.758 03:28:53 -- paths/export.sh@5 -- # export PATH 00:28:18.758 03:28:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:18.758 03:28:53 -- nvmf/common.sh@47 -- # : 0 00:28:18.758 03:28:53 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:28:18.759 03:28:53 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:28:18.759 03:28:53 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:28:18.759 03:28:53 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:18.759 03:28:53 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:18.759 03:28:53 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:28:18.759 03:28:53 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:28:18.759 03:28:53 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:28:18.759 03:28:53 -- host/discovery_remove_ifc.sh@14 -- # '[' rdma == rdma ']' 00:28:18.759 03:28:53 -- host/discovery_remove_ifc.sh@15 -- # echo 'Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target.' 00:28:18.759 Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target. 00:28:18.759 03:28:53 -- host/discovery_remove_ifc.sh@16 -- # exit 0 00:28:18.759 00:28:18.759 real 0m0.120s 00:28:18.759 user 0m0.060s 00:28:18.759 sys 0m0.068s 00:28:18.759 03:28:53 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:28:18.759 03:28:53 -- common/autotest_common.sh@10 -- # set +x 00:28:18.759 ************************************ 00:28:18.759 END TEST nvmf_discovery_remove_ifc 00:28:18.759 ************************************ 00:28:18.759 03:28:53 -- nvmf/nvmf.sh@101 -- # run_test nvmf_identify_kernel_target /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/identify_kernel_nvmf.sh --transport=rdma 00:28:18.759 03:28:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:18.759 03:28:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:18.759 03:28:53 -- common/autotest_common.sh@10 -- # set +x 00:28:18.759 ************************************ 00:28:18.759 START TEST nvmf_identify_kernel_target 00:28:18.759 ************************************ 00:28:18.759 03:28:53 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/identify_kernel_nvmf.sh --transport=rdma 00:28:18.759 * Looking for test storage... 00:28:18.759 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host 00:28:18.759 03:28:53 -- host/identify_kernel_nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:28:19.018 03:28:53 -- nvmf/common.sh@7 -- # uname -s 00:28:19.018 03:28:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:19.018 03:28:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:19.018 03:28:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:19.018 03:28:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:19.018 03:28:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:19.018 03:28:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:19.018 03:28:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:19.018 03:28:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:19.018 03:28:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:19.018 03:28:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:19.018 03:28:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:28:19.018 03:28:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:28:19.018 03:28:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:19.018 03:28:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:19.018 03:28:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:19.018 03:28:53 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:28:19.018 03:28:53 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:28:19.018 03:28:53 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:19.018 03:28:53 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:19.018 03:28:53 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:19.018 03:28:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:19.018 03:28:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:19.018 03:28:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:19.018 03:28:53 -- paths/export.sh@5 -- # export PATH 00:28:19.018 03:28:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:19.018 03:28:53 -- nvmf/common.sh@47 -- # : 0 00:28:19.018 03:28:53 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:28:19.018 03:28:53 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:28:19.018 03:28:53 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:28:19.018 03:28:53 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:19.018 03:28:53 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:19.018 03:28:53 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:28:19.018 03:28:53 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:28:19.018 03:28:53 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:28:19.018 03:28:53 -- host/identify_kernel_nvmf.sh@11 -- # nvmftestinit 00:28:19.018 03:28:53 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:28:19.018 03:28:53 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:19.018 03:28:53 -- nvmf/common.sh@437 -- # prepare_net_devs 00:28:19.018 03:28:53 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:28:19.018 03:28:53 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:28:19.018 03:28:53 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:19.018 03:28:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:19.018 03:28:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:19.018 03:28:53 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:28:19.018 03:28:53 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:28:19.018 03:28:53 -- nvmf/common.sh@285 -- # xtrace_disable 00:28:19.018 03:28:53 -- common/autotest_common.sh@10 -- # set +x 00:28:25.582 03:28:59 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:25.582 03:28:59 -- nvmf/common.sh@291 -- # pci_devs=() 00:28:25.582 03:28:59 -- nvmf/common.sh@291 -- # local -a pci_devs 00:28:25.582 03:28:59 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:28:25.582 03:28:59 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:28:25.582 03:28:59 -- nvmf/common.sh@293 -- # pci_drivers=() 00:28:25.582 03:28:59 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:28:25.582 03:28:59 -- nvmf/common.sh@295 -- # net_devs=() 00:28:25.582 03:28:59 -- nvmf/common.sh@295 -- # local -ga net_devs 00:28:25.582 03:28:59 -- nvmf/common.sh@296 -- # e810=() 00:28:25.582 03:28:59 -- nvmf/common.sh@296 -- # local -ga e810 00:28:25.582 03:28:59 -- nvmf/common.sh@297 -- # x722=() 00:28:25.582 03:28:59 -- nvmf/common.sh@297 -- # local -ga x722 00:28:25.582 03:28:59 -- nvmf/common.sh@298 -- # mlx=() 00:28:25.582 03:28:59 -- nvmf/common.sh@298 -- # local -ga mlx 00:28:25.582 03:28:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:25.582 03:28:59 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:25.582 03:28:59 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:25.582 03:28:59 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:25.582 03:28:59 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:25.582 03:28:59 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:25.582 03:28:59 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:25.582 03:28:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:25.582 03:28:59 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:25.582 03:28:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:25.582 03:28:59 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:25.582 03:28:59 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:28:25.582 03:28:59 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:28:25.582 03:28:59 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:28:25.582 03:28:59 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:28:25.582 03:28:59 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:28:25.582 03:28:59 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:28:25.582 03:28:59 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:28:25.582 03:28:59 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:28:25.582 03:28:59 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:28:25.582 03:28:59 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:28:25.582 Found 0000:af:00.0 (0x8086 - 0x159b) 00:28:25.582 03:28:59 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:28:25.582 03:28:59 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:28:25.582 03:28:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:25.582 03:28:59 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:25.582 03:28:59 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:28:25.582 03:28:59 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:28:25.582 03:28:59 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:28:25.582 03:28:59 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:28:25.582 Found 0000:af:00.1 (0x8086 - 0x159b) 00:28:25.582 03:28:59 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:28:25.582 03:28:59 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:28:25.582 03:28:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:25.582 03:28:59 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:25.582 03:28:59 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:28:25.582 03:28:59 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:28:25.582 03:28:59 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:28:25.582 03:28:59 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:28:25.582 03:28:59 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:28:25.582 03:28:59 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:28:25.582 03:28:59 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:28:25.582 03:28:59 -- nvmf/common.sh@377 -- # modinfo irdma 00:28:25.582 03:28:59 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:28:25.582 03:28:59 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:28:25.582 03:28:59 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:25.582 03:28:59 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:28:25.582 03:28:59 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:25.582 03:28:59 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:28:25.582 Found net devices under 0000:af:00.0: cvl_0_0 00:28:25.582 03:28:59 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:28:25.582 03:28:59 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:28:25.582 03:28:59 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:25.582 03:28:59 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:28:25.582 03:28:59 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:25.582 03:28:59 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:28:25.582 Found net devices under 0000:af:00.1: cvl_0_1 00:28:25.582 03:28:59 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:28:25.582 03:28:59 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:28:25.582 03:28:59 -- nvmf/common.sh@403 -- # is_hw=yes 00:28:25.582 03:28:59 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:28:25.582 03:28:59 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:28:25.582 03:28:59 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:28:25.582 03:28:59 -- nvmf/common.sh@409 -- # rdma_device_init 00:28:25.582 03:28:59 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:28:25.582 03:28:59 -- nvmf/common.sh@58 -- # uname 00:28:25.582 03:28:59 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:28:25.582 03:28:59 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:28:25.582 03:28:59 -- nvmf/common.sh@63 -- # modprobe ib_core 00:28:25.582 03:28:59 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:28:25.582 03:28:59 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:28:25.582 03:28:59 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:28:25.582 03:28:59 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:28:25.582 03:28:59 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:28:25.582 03:28:59 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:28:25.582 03:28:59 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:28:25.582 03:28:59 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:28:25.582 03:28:59 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:28:25.582 03:28:59 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:28:25.582 03:28:59 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:28:25.582 03:28:59 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:28:25.582 03:28:59 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:28:25.582 03:28:59 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:28:25.582 03:28:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:25.582 03:28:59 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:28:25.582 03:28:59 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:28:25.582 03:28:59 -- nvmf/common.sh@105 -- # continue 2 00:28:25.582 03:28:59 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:28:25.582 03:28:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:25.582 03:28:59 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:28:25.582 03:28:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:25.582 03:28:59 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:28:25.582 03:28:59 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:28:25.582 03:28:59 -- nvmf/common.sh@105 -- # continue 2 00:28:25.582 03:28:59 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:28:25.582 03:28:59 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:28:25.582 03:28:59 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:28:25.582 03:28:59 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:28:25.582 03:28:59 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:28:25.582 03:28:59 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:28:25.582 03:28:59 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:28:25.582 03:28:59 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:28:25.582 03:28:59 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:28:25.582 50: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:28:25.582 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:28:25.582 altname enp175s0f0np0 00:28:25.582 altname ens801f0np0 00:28:25.582 inet 192.168.100.8/24 scope global cvl_0_0 00:28:25.582 valid_lft forever preferred_lft forever 00:28:25.582 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:28:25.582 valid_lft forever preferred_lft forever 00:28:25.582 03:28:59 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:28:25.582 03:28:59 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:28:25.582 03:28:59 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:28:25.582 03:28:59 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:28:25.582 03:28:59 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:28:25.582 03:28:59 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:28:25.582 03:28:59 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:28:25.582 03:28:59 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:28:25.582 03:28:59 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:28:25.582 51: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:28:25.582 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:28:25.582 altname enp175s0f1np1 00:28:25.582 altname ens801f1np1 00:28:25.582 inet 192.168.100.9/24 scope global cvl_0_1 00:28:25.582 valid_lft forever preferred_lft forever 00:28:25.582 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:28:25.582 valid_lft forever preferred_lft forever 00:28:25.582 03:28:59 -- nvmf/common.sh@411 -- # return 0 00:28:25.582 03:28:59 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:28:25.582 03:28:59 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:28:25.582 03:28:59 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:28:25.582 03:28:59 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:28:25.582 03:28:59 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:28:25.582 03:28:59 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:28:25.582 03:28:59 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:28:25.582 03:28:59 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:28:25.582 03:28:59 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:28:25.582 03:28:59 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:28:25.583 03:28:59 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:28:25.583 03:28:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:25.583 03:28:59 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:28:25.583 03:28:59 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:28:25.583 03:28:59 -- nvmf/common.sh@105 -- # continue 2 00:28:25.583 03:28:59 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:28:25.583 03:28:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:25.583 03:28:59 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:28:25.583 03:28:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:25.583 03:28:59 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:28:25.583 03:28:59 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:28:25.583 03:28:59 -- nvmf/common.sh@105 -- # continue 2 00:28:25.583 03:28:59 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:28:25.583 03:28:59 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:28:25.583 03:28:59 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:28:25.583 03:28:59 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:28:25.583 03:28:59 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:28:25.583 03:28:59 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:28:25.583 03:28:59 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:28:25.583 03:28:59 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:28:25.583 03:28:59 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:28:25.583 03:28:59 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:28:25.583 03:28:59 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:28:25.583 03:28:59 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:28:25.583 03:28:59 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:28:25.583 192.168.100.9' 00:28:25.583 03:28:59 -- nvmf/common.sh@446 -- # head -n 1 00:28:25.583 03:28:59 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:28:25.583 192.168.100.9' 00:28:25.583 03:28:59 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:28:25.583 03:28:59 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:28:25.583 192.168.100.9' 00:28:25.583 03:28:59 -- nvmf/common.sh@447 -- # tail -n +2 00:28:25.583 03:28:59 -- nvmf/common.sh@447 -- # head -n 1 00:28:25.583 03:28:59 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:28:25.583 03:28:59 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:28:25.583 03:28:59 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:28:25.583 03:28:59 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:28:25.583 03:28:59 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:28:25.583 03:28:59 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:28:25.583 03:28:59 -- host/identify_kernel_nvmf.sh@13 -- # trap 'nvmftestfini || :; clean_kernel_target' EXIT 00:28:25.583 03:28:59 -- host/identify_kernel_nvmf.sh@15 -- # get_main_ns_ip 00:28:25.583 03:28:59 -- nvmf/common.sh@717 -- # local ip 00:28:25.583 03:28:59 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:25.583 03:28:59 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:25.583 03:28:59 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:25.583 03:28:59 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:25.583 03:28:59 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:28:25.583 03:28:59 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:28:25.583 03:28:59 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:28:25.583 03:28:59 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:28:25.583 03:28:59 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:28:25.583 03:28:59 -- host/identify_kernel_nvmf.sh@15 -- # target_ip=192.168.100.8 00:28:25.583 03:28:59 -- host/identify_kernel_nvmf.sh@16 -- # configure_kernel_target nqn.2016-06.io.spdk:testnqn 192.168.100.8 00:28:25.583 03:28:59 -- nvmf/common.sh@621 -- # local kernel_name=nqn.2016-06.io.spdk:testnqn kernel_target_ip=192.168.100.8 00:28:25.583 03:28:59 -- nvmf/common.sh@623 -- # nvmet=/sys/kernel/config/nvmet 00:28:25.583 03:28:59 -- nvmf/common.sh@624 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:28:25.583 03:28:59 -- nvmf/common.sh@625 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:28:25.583 03:28:59 -- nvmf/common.sh@626 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:28:25.583 03:28:59 -- nvmf/common.sh@628 -- # local block nvme 00:28:25.583 03:28:59 -- nvmf/common.sh@630 -- # [[ ! -e /sys/module/nvmet ]] 00:28:25.583 03:28:59 -- nvmf/common.sh@631 -- # modprobe nvmet 00:28:25.583 03:28:59 -- nvmf/common.sh@634 -- # [[ -e /sys/kernel/config/nvmet ]] 00:28:25.583 03:28:59 -- nvmf/common.sh@636 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh reset 00:28:27.484 0000:5f:00.0 (1b96 2600): Skipping denied controller at 0000:5f:00.0 00:28:27.742 Waiting for block devices as requested 00:28:27.742 0000:5e:00.0 (8086 0a54): vfio-pci -> nvme 00:28:28.017 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:28:28.017 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:28:28.017 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:28:28.295 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:28:28.295 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:28:28.295 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:28:28.295 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:28:28.553 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:28:28.553 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:28:28.553 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:28:28.553 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:28:28.812 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:28:28.812 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:28:28.812 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:28:29.069 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:28:29.069 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:28:29.069 03:29:03 -- nvmf/common.sh@639 -- # for block in /sys/block/nvme* 00:28:29.069 03:29:03 -- nvmf/common.sh@640 -- # [[ -e /sys/block/nvme0n1 ]] 00:28:29.069 03:29:03 -- nvmf/common.sh@641 -- # is_block_zoned nvme0n1 00:28:29.069 03:29:03 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:28:29.069 03:29:03 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:28:29.069 03:29:03 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:28:29.069 03:29:03 -- nvmf/common.sh@642 -- # block_in_use nvme0n1 00:28:29.069 03:29:03 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:28:29.069 03:29:03 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:28:29.069 No valid GPT data, bailing 00:28:29.069 03:29:03 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:28:29.069 03:29:03 -- scripts/common.sh@391 -- # pt= 00:28:29.069 03:29:03 -- scripts/common.sh@392 -- # return 1 00:28:29.069 03:29:03 -- nvmf/common.sh@642 -- # nvme=/dev/nvme0n1 00:28:29.069 03:29:03 -- nvmf/common.sh@639 -- # for block in /sys/block/nvme* 00:28:29.069 03:29:03 -- nvmf/common.sh@640 -- # [[ -e /sys/block/nvme1n1 ]] 00:28:29.069 03:29:03 -- nvmf/common.sh@641 -- # is_block_zoned nvme1n1 00:28:29.069 03:29:03 -- common/autotest_common.sh@1648 -- # local device=nvme1n1 00:28:29.069 03:29:03 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme1n1/queue/zoned ]] 00:28:29.069 03:29:03 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:28:29.069 03:29:03 -- nvmf/common.sh@642 -- # block_in_use nvme1n1 00:28:29.069 03:29:03 -- scripts/common.sh@378 -- # local block=nvme1n1 pt 00:28:29.069 03:29:03 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/spdk-gpt.py nvme1n1 00:28:29.327 No valid GPT data, bailing 00:28:29.327 03:29:03 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme1n1 00:28:29.327 03:29:03 -- scripts/common.sh@391 -- # pt= 00:28:29.327 03:29:03 -- scripts/common.sh@392 -- # return 1 00:28:29.327 03:29:03 -- nvmf/common.sh@642 -- # nvme=/dev/nvme1n1 00:28:29.327 03:29:03 -- nvmf/common.sh@639 -- # for block in /sys/block/nvme* 00:28:29.327 03:29:03 -- nvmf/common.sh@640 -- # [[ -e /sys/block/nvme1n2 ]] 00:28:29.327 03:29:03 -- nvmf/common.sh@641 -- # is_block_zoned nvme1n2 00:28:29.327 03:29:03 -- common/autotest_common.sh@1648 -- # local device=nvme1n2 00:28:29.327 03:29:03 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme1n2/queue/zoned ]] 00:28:29.327 03:29:03 -- common/autotest_common.sh@1651 -- # [[ host-managed != none ]] 00:28:29.327 03:29:03 -- nvmf/common.sh@641 -- # continue 00:28:29.327 03:29:03 -- nvmf/common.sh@645 -- # [[ -b /dev/nvme1n1 ]] 00:28:29.327 03:29:03 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:28:29.328 03:29:03 -- nvmf/common.sh@648 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:28:29.328 03:29:03 -- nvmf/common.sh@649 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:28:29.328 03:29:03 -- nvmf/common.sh@654 -- # echo SPDK-nqn.2016-06.io.spdk:testnqn 00:28:29.328 03:29:03 -- nvmf/common.sh@656 -- # echo 1 00:28:29.328 03:29:03 -- nvmf/common.sh@657 -- # echo /dev/nvme1n1 00:28:29.328 03:29:03 -- nvmf/common.sh@658 -- # echo 1 00:28:29.328 03:29:03 -- nvmf/common.sh@660 -- # echo 192.168.100.8 00:28:29.328 03:29:03 -- nvmf/common.sh@661 -- # echo rdma 00:28:29.328 03:29:03 -- nvmf/common.sh@662 -- # echo 4420 00:28:29.328 03:29:03 -- nvmf/common.sh@663 -- # echo ipv4 00:28:29.328 03:29:03 -- nvmf/common.sh@666 -- # ln -s /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn /sys/kernel/config/nvmet/ports/1/subsystems/ 00:28:29.328 03:29:03 -- nvmf/common.sh@669 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -a 192.168.100.8 -t rdma -s 4420 00:28:29.328 00:28:29.328 Discovery Log Number of Records 2, Generation counter 2 00:28:29.328 =====Discovery Log Entry 0====== 00:28:29.328 trtype: rdma 00:28:29.328 adrfam: ipv4 00:28:29.328 subtype: current discovery subsystem 00:28:29.328 treq: not specified, sq flow control disable supported 00:28:29.328 portid: 1 00:28:29.328 trsvcid: 4420 00:28:29.328 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:28:29.328 traddr: 192.168.100.8 00:28:29.328 eflags: none 00:28:29.328 rdma_prtype: not specified 00:28:29.328 rdma_qptype: connected 00:28:29.328 rdma_cms: rdma-cm 00:28:29.328 rdma_pkey: 0x0000 00:28:29.328 =====Discovery Log Entry 1====== 00:28:29.328 trtype: rdma 00:28:29.328 adrfam: ipv4 00:28:29.328 subtype: nvme subsystem 00:28:29.328 treq: not specified, sq flow control disable supported 00:28:29.328 portid: 1 00:28:29.328 trsvcid: 4420 00:28:29.328 subnqn: nqn.2016-06.io.spdk:testnqn 00:28:29.328 traddr: 192.168.100.8 00:28:29.328 eflags: none 00:28:29.328 rdma_prtype: not specified 00:28:29.328 rdma_qptype: connected 00:28:29.328 rdma_cms: rdma-cm 00:28:29.328 rdma_pkey: 0x0000 00:28:29.328 03:29:03 -- host/identify_kernel_nvmf.sh@18 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 00:28:29.328 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' 00:28:29.328 EAL: No free 2048 kB hugepages reported on node 1 00:28:29.587 ===================================================== 00:28:29.587 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2014-08.org.nvmexpress.discovery 00:28:29.587 ===================================================== 00:28:29.587 Controller Capabilities/Features 00:28:29.587 ================================ 00:28:29.587 Vendor ID: 0000 00:28:29.587 Subsystem Vendor ID: 0000 00:28:29.587 Serial Number: 878f341e1e3a65171338 00:28:29.587 Model Number: Linux 00:28:29.587 Firmware Version: 6.7.0-68 00:28:29.587 Recommended Arb Burst: 0 00:28:29.587 IEEE OUI Identifier: 00 00 00 00:28:29.587 Multi-path I/O 00:28:29.587 May have multiple subsystem ports: No 00:28:29.587 May have multiple controllers: No 00:28:29.587 Associated with SR-IOV VF: No 00:28:29.587 Max Data Transfer Size: Unlimited 00:28:29.587 Max Number of Namespaces: 0 00:28:29.587 Max Number of I/O Queues: 1024 00:28:29.587 NVMe Specification Version (VS): 1.3 00:28:29.587 NVMe Specification Version (Identify): 1.3 00:28:29.587 Maximum Queue Entries: 128 00:28:29.587 Contiguous Queues Required: No 00:28:29.587 Arbitration Mechanisms Supported 00:28:29.587 Weighted Round Robin: Not Supported 00:28:29.587 Vendor Specific: Not Supported 00:28:29.587 Reset Timeout: 7500 ms 00:28:29.587 Doorbell Stride: 4 bytes 00:28:29.587 NVM Subsystem Reset: Not Supported 00:28:29.587 Command Sets Supported 00:28:29.587 NVM Command Set: Supported 00:28:29.587 Boot Partition: Not Supported 00:28:29.587 Memory Page Size Minimum: 4096 bytes 00:28:29.587 Memory Page Size Maximum: 4096 bytes 00:28:29.587 Persistent Memory Region: Not Supported 00:28:29.587 Optional Asynchronous Events Supported 00:28:29.587 Namespace Attribute Notices: Not Supported 00:28:29.587 Firmware Activation Notices: Not Supported 00:28:29.587 ANA Change Notices: Not Supported 00:28:29.587 PLE Aggregate Log Change Notices: Not Supported 00:28:29.587 LBA Status Info Alert Notices: Not Supported 00:28:29.587 EGE Aggregate Log Change Notices: Not Supported 00:28:29.587 Normal NVM Subsystem Shutdown event: Not Supported 00:28:29.587 Zone Descriptor Change Notices: Not Supported 00:28:29.587 Discovery Log Change Notices: Supported 00:28:29.587 Controller Attributes 00:28:29.587 128-bit Host Identifier: Not Supported 00:28:29.587 Non-Operational Permissive Mode: Not Supported 00:28:29.587 NVM Sets: Not Supported 00:28:29.587 Read Recovery Levels: Not Supported 00:28:29.587 Endurance Groups: Not Supported 00:28:29.587 Predictable Latency Mode: Not Supported 00:28:29.587 Traffic Based Keep ALive: Not Supported 00:28:29.587 Namespace Granularity: Not Supported 00:28:29.587 SQ Associations: Not Supported 00:28:29.587 UUID List: Not Supported 00:28:29.587 Multi-Domain Subsystem: Not Supported 00:28:29.587 Fixed Capacity Management: Not Supported 00:28:29.587 Variable Capacity Management: Not Supported 00:28:29.587 Delete Endurance Group: Not Supported 00:28:29.587 Delete NVM Set: Not Supported 00:28:29.587 Extended LBA Formats Supported: Not Supported 00:28:29.587 Flexible Data Placement Supported: Not Supported 00:28:29.587 00:28:29.587 Controller Memory Buffer Support 00:28:29.587 ================================ 00:28:29.587 Supported: No 00:28:29.587 00:28:29.587 Persistent Memory Region Support 00:28:29.587 ================================ 00:28:29.587 Supported: No 00:28:29.587 00:28:29.587 Admin Command Set Attributes 00:28:29.587 ============================ 00:28:29.587 Security Send/Receive: Not Supported 00:28:29.587 Format NVM: Not Supported 00:28:29.587 Firmware Activate/Download: Not Supported 00:28:29.587 Namespace Management: Not Supported 00:28:29.587 Device Self-Test: Not Supported 00:28:29.587 Directives: Not Supported 00:28:29.587 NVMe-MI: Not Supported 00:28:29.587 Virtualization Management: Not Supported 00:28:29.587 Doorbell Buffer Config: Not Supported 00:28:29.587 Get LBA Status Capability: Not Supported 00:28:29.587 Command & Feature Lockdown Capability: Not Supported 00:28:29.587 Abort Command Limit: 1 00:28:29.587 Async Event Request Limit: 1 00:28:29.587 Number of Firmware Slots: N/A 00:28:29.587 Firmware Slot 1 Read-Only: N/A 00:28:29.587 Firmware Activation Without Reset: N/A 00:28:29.587 Multiple Update Detection Support: N/A 00:28:29.587 Firmware Update Granularity: No Information Provided 00:28:29.587 Per-Namespace SMART Log: No 00:28:29.587 Asymmetric Namespace Access Log Page: Not Supported 00:28:29.587 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:28:29.587 Command Effects Log Page: Not Supported 00:28:29.587 Get Log Page Extended Data: Supported 00:28:29.587 Telemetry Log Pages: Not Supported 00:28:29.587 Persistent Event Log Pages: Not Supported 00:28:29.587 Supported Log Pages Log Page: May Support 00:28:29.587 Commands Supported & Effects Log Page: Not Supported 00:28:29.587 Feature Identifiers & Effects Log Page:May Support 00:28:29.587 NVMe-MI Commands & Effects Log Page: May Support 00:28:29.587 Data Area 4 for Telemetry Log: Not Supported 00:28:29.587 Error Log Page Entries Supported: 1 00:28:29.587 Keep Alive: Not Supported 00:28:29.587 00:28:29.587 NVM Command Set Attributes 00:28:29.587 ========================== 00:28:29.587 Submission Queue Entry Size 00:28:29.587 Max: 1 00:28:29.587 Min: 1 00:28:29.587 Completion Queue Entry Size 00:28:29.587 Max: 1 00:28:29.587 Min: 1 00:28:29.587 Number of Namespaces: 0 00:28:29.587 Compare Command: Not Supported 00:28:29.587 Write Uncorrectable Command: Not Supported 00:28:29.587 Dataset Management Command: Not Supported 00:28:29.587 Write Zeroes Command: Not Supported 00:28:29.587 Set Features Save Field: Not Supported 00:28:29.587 Reservations: Not Supported 00:28:29.587 Timestamp: Not Supported 00:28:29.588 Copy: Not Supported 00:28:29.588 Volatile Write Cache: Not Present 00:28:29.588 Atomic Write Unit (Normal): 1 00:28:29.588 Atomic Write Unit (PFail): 1 00:28:29.588 Atomic Compare & Write Unit: 1 00:28:29.588 Fused Compare & Write: Not Supported 00:28:29.588 Scatter-Gather List 00:28:29.588 SGL Command Set: Supported 00:28:29.588 SGL Keyed: Supported 00:28:29.588 SGL Bit Bucket Descriptor: Not Supported 00:28:29.588 SGL Metadata Pointer: Not Supported 00:28:29.588 Oversized SGL: Not Supported 00:28:29.588 SGL Metadata Address: Not Supported 00:28:29.588 SGL Offset: Supported 00:28:29.588 Transport SGL Data Block: Not Supported 00:28:29.588 Replay Protected Memory Block: Not Supported 00:28:29.588 00:28:29.588 Firmware Slot Information 00:28:29.588 ========================= 00:28:29.588 Active slot: 0 00:28:29.588 00:28:29.588 00:28:29.588 Error Log 00:28:29.588 ========= 00:28:29.588 00:28:29.588 Active Namespaces 00:28:29.588 ================= 00:28:29.588 Discovery Log Page 00:28:29.588 ================== 00:28:29.588 Generation Counter: 2 00:28:29.588 Number of Records: 2 00:28:29.588 Record Format: 0 00:28:29.588 00:28:29.588 Discovery Log Entry 0 00:28:29.588 ---------------------- 00:28:29.588 Transport Type: 1 (RDMA) 00:28:29.588 Address Family: 1 (IPv4) 00:28:29.588 Subsystem Type: 3 (Current Discovery Subsystem) 00:28:29.588 Entry Flags: 00:28:29.588 Duplicate Returned Information: 0 00:28:29.588 Explicit Persistent Connection Support for Discovery: 0 00:28:29.588 Transport Requirements: 00:28:29.588 Secure Channel: Not Specified 00:28:29.588 Port ID: 1 (0x0001) 00:28:29.588 Controller ID: 65535 (0xffff) 00:28:29.588 Admin Max SQ Size: 32 00:28:29.588 Transport Service Identifier: 4420 00:28:29.588 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:28:29.588 Transport Address: 192.168.100.8 00:28:29.588 Transport Specific Address Subtype - RDMA 00:28:29.588 RDMA QP Service Type: 1 (Reliable Connected) 00:28:29.588 RDMA Provider Type: 1 (No provider specified) 00:28:29.588 RDMA CM Service: 1 (RDMA_CM) 00:28:29.588 Discovery Log Entry 1 00:28:29.588 ---------------------- 00:28:29.588 Transport Type: 1 (RDMA) 00:28:29.588 Address Family: 1 (IPv4) 00:28:29.588 Subsystem Type: 2 (NVM Subsystem) 00:28:29.588 Entry Flags: 00:28:29.588 Duplicate Returned Information: 0 00:28:29.588 Explicit Persistent Connection Support for Discovery: 0 00:28:29.588 Transport Requirements: 00:28:29.588 Secure Channel: Not Specified 00:28:29.588 Port ID: 1 (0x0001) 00:28:29.588 Controller ID: 65535 (0xffff) 00:28:29.588 Admin Max SQ Size: 32 00:28:29.588 Transport Service Identifier: 4420 00:28:29.588 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:testnqn 00:28:29.588 Transport Address: 192.168.100.8 00:28:29.588 Transport Specific Address Subtype - RDMA 00:28:29.588 RDMA QP Service Type: 1 (Reliable Connected) 00:28:29.588 RDMA Provider Type: 1 (No provider specified) 00:28:29.588 RDMA CM Service: 1 (RDMA_CM) 00:28:29.588 03:29:03 -- host/identify_kernel_nvmf.sh@24 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:testnqn' 00:28:29.588 EAL: No free 2048 kB hugepages reported on node 1 00:28:29.588 get_feature(0x01) failed 00:28:29.588 get_feature(0x02) failed 00:28:29.588 get_feature(0x04) failed 00:28:29.588 ===================================================== 00:28:29.588 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:testnqn 00:28:29.588 ===================================================== 00:28:29.588 Controller Capabilities/Features 00:28:29.588 ================================ 00:28:29.588 Vendor ID: 0000 00:28:29.588 Subsystem Vendor ID: 0000 00:28:29.588 Serial Number: d1032d7db2e856045a57 00:28:29.588 Model Number: SPDK-nqn.2016-06.io.spdk:testnqn 00:28:29.588 Firmware Version: 6.7.0-68 00:28:29.588 Recommended Arb Burst: 6 00:28:29.588 IEEE OUI Identifier: 00 00 00 00:28:29.588 Multi-path I/O 00:28:29.588 May have multiple subsystem ports: Yes 00:28:29.588 May have multiple controllers: Yes 00:28:29.588 Associated with SR-IOV VF: No 00:28:29.588 Max Data Transfer Size: 1048576 00:28:29.588 Max Number of Namespaces: 1024 00:28:29.588 Max Number of I/O Queues: 128 00:28:29.588 NVMe Specification Version (VS): 1.3 00:28:29.588 NVMe Specification Version (Identify): 1.3 00:28:29.588 Maximum Queue Entries: 128 00:28:29.588 Contiguous Queues Required: No 00:28:29.588 Arbitration Mechanisms Supported 00:28:29.588 Weighted Round Robin: Not Supported 00:28:29.588 Vendor Specific: Not Supported 00:28:29.588 Reset Timeout: 7500 ms 00:28:29.588 Doorbell Stride: 4 bytes 00:28:29.588 NVM Subsystem Reset: Not Supported 00:28:29.588 Command Sets Supported 00:28:29.588 NVM Command Set: Supported 00:28:29.588 Boot Partition: Not Supported 00:28:29.588 Memory Page Size Minimum: 4096 bytes 00:28:29.588 Memory Page Size Maximum: 4096 bytes 00:28:29.588 Persistent Memory Region: Not Supported 00:28:29.588 Optional Asynchronous Events Supported 00:28:29.588 Namespace Attribute Notices: Supported 00:28:29.588 Firmware Activation Notices: Not Supported 00:28:29.588 ANA Change Notices: Supported 00:28:29.588 PLE Aggregate Log Change Notices: Not Supported 00:28:29.588 LBA Status Info Alert Notices: Not Supported 00:28:29.588 EGE Aggregate Log Change Notices: Not Supported 00:28:29.588 Normal NVM Subsystem Shutdown event: Not Supported 00:28:29.588 Zone Descriptor Change Notices: Not Supported 00:28:29.588 Discovery Log Change Notices: Not Supported 00:28:29.588 Controller Attributes 00:28:29.588 128-bit Host Identifier: Supported 00:28:29.588 Non-Operational Permissive Mode: Not Supported 00:28:29.588 NVM Sets: Not Supported 00:28:29.588 Read Recovery Levels: Not Supported 00:28:29.588 Endurance Groups: Not Supported 00:28:29.588 Predictable Latency Mode: Not Supported 00:28:29.588 Traffic Based Keep ALive: Supported 00:28:29.588 Namespace Granularity: Not Supported 00:28:29.588 SQ Associations: Not Supported 00:28:29.588 UUID List: Not Supported 00:28:29.588 Multi-Domain Subsystem: Not Supported 00:28:29.588 Fixed Capacity Management: Not Supported 00:28:29.588 Variable Capacity Management: Not Supported 00:28:29.588 Delete Endurance Group: Not Supported 00:28:29.588 Delete NVM Set: Not Supported 00:28:29.588 Extended LBA Formats Supported: Not Supported 00:28:29.588 Flexible Data Placement Supported: Not Supported 00:28:29.588 00:28:29.588 Controller Memory Buffer Support 00:28:29.588 ================================ 00:28:29.588 Supported: No 00:28:29.588 00:28:29.588 Persistent Memory Region Support 00:28:29.588 ================================ 00:28:29.588 Supported: No 00:28:29.588 00:28:29.588 Admin Command Set Attributes 00:28:29.588 ============================ 00:28:29.588 Security Send/Receive: Not Supported 00:28:29.588 Format NVM: Not Supported 00:28:29.588 Firmware Activate/Download: Not Supported 00:28:29.588 Namespace Management: Not Supported 00:28:29.588 Device Self-Test: Not Supported 00:28:29.588 Directives: Not Supported 00:28:29.588 NVMe-MI: Not Supported 00:28:29.588 Virtualization Management: Not Supported 00:28:29.588 Doorbell Buffer Config: Not Supported 00:28:29.588 Get LBA Status Capability: Not Supported 00:28:29.588 Command & Feature Lockdown Capability: Not Supported 00:28:29.588 Abort Command Limit: 4 00:28:29.588 Async Event Request Limit: 4 00:28:29.588 Number of Firmware Slots: N/A 00:28:29.588 Firmware Slot 1 Read-Only: N/A 00:28:29.588 Firmware Activation Without Reset: N/A 00:28:29.588 Multiple Update Detection Support: N/A 00:28:29.588 Firmware Update Granularity: No Information Provided 00:28:29.588 Per-Namespace SMART Log: Yes 00:28:29.588 Asymmetric Namespace Access Log Page: Supported 00:28:29.588 ANA Transition Time : 10 sec 00:28:29.588 00:28:29.588 Asymmetric Namespace Access Capabilities 00:28:29.588 ANA Optimized State : Supported 00:28:29.588 ANA Non-Optimized State : Supported 00:28:29.588 ANA Inaccessible State : Supported 00:28:29.588 ANA Persistent Loss State : Supported 00:28:29.588 ANA Change State : Supported 00:28:29.588 ANAGRPID is not changed : No 00:28:29.588 Non-Zero ANAGRPID for NS Mgmt Cmd : Not Supported 00:28:29.588 00:28:29.588 ANA Group Identifier Maximum : 128 00:28:29.588 Number of ANA Group Identifiers : 128 00:28:29.588 Max Number of Allowed Namespaces : 1024 00:28:29.588 Subsystem NQN: nqn.2016-06.io.spdk:testnqn 00:28:29.588 Command Effects Log Page: Supported 00:28:29.588 Get Log Page Extended Data: Supported 00:28:29.588 Telemetry Log Pages: Not Supported 00:28:29.588 Persistent Event Log Pages: Not Supported 00:28:29.588 Supported Log Pages Log Page: May Support 00:28:29.588 Commands Supported & Effects Log Page: Not Supported 00:28:29.588 Feature Identifiers & Effects Log Page:May Support 00:28:29.588 NVMe-MI Commands & Effects Log Page: May Support 00:28:29.588 Data Area 4 for Telemetry Log: Not Supported 00:28:29.589 Error Log Page Entries Supported: 128 00:28:29.589 Keep Alive: Supported 00:28:29.589 Keep Alive Granularity: 1000 ms 00:28:29.589 00:28:29.589 NVM Command Set Attributes 00:28:29.589 ========================== 00:28:29.589 Submission Queue Entry Size 00:28:29.589 Max: 64 00:28:29.589 Min: 64 00:28:29.589 Completion Queue Entry Size 00:28:29.589 Max: 16 00:28:29.589 Min: 16 00:28:29.589 Number of Namespaces: 1024 00:28:29.589 Compare Command: Not Supported 00:28:29.589 Write Uncorrectable Command: Not Supported 00:28:29.589 Dataset Management Command: Supported 00:28:29.589 Write Zeroes Command: Supported 00:28:29.589 Set Features Save Field: Not Supported 00:28:29.589 Reservations: Not Supported 00:28:29.589 Timestamp: Not Supported 00:28:29.589 Copy: Not Supported 00:28:29.589 Volatile Write Cache: Present 00:28:29.589 Atomic Write Unit (Normal): 1 00:28:29.589 Atomic Write Unit (PFail): 1 00:28:29.589 Atomic Compare & Write Unit: 1 00:28:29.589 Fused Compare & Write: Not Supported 00:28:29.589 Scatter-Gather List 00:28:29.589 SGL Command Set: Supported 00:28:29.589 SGL Keyed: Supported 00:28:29.589 SGL Bit Bucket Descriptor: Not Supported 00:28:29.589 SGL Metadata Pointer: Not Supported 00:28:29.589 Oversized SGL: Not Supported 00:28:29.589 SGL Metadata Address: Not Supported 00:28:29.589 SGL Offset: Supported 00:28:29.589 Transport SGL Data Block: Not Supported 00:28:29.589 Replay Protected Memory Block: Not Supported 00:28:29.589 00:28:29.589 Firmware Slot Information 00:28:29.589 ========================= 00:28:29.589 Active slot: 0 00:28:29.589 00:28:29.589 Asymmetric Namespace Access 00:28:29.589 =========================== 00:28:29.589 Change Count : 0 00:28:29.589 Number of ANA Group Descriptors : 1 00:28:29.589 ANA Group Descriptor : 0 00:28:29.589 ANA Group ID : 1 00:28:29.589 Number of NSID Values : 1 00:28:29.589 Change Count : 0 00:28:29.589 ANA State : 1 00:28:29.589 Namespace Identifier : 1 00:28:29.589 00:28:29.589 Commands Supported and Effects 00:28:29.589 ============================== 00:28:29.589 Admin Commands 00:28:29.589 -------------- 00:28:29.589 Get Log Page (02h): Supported 00:28:29.589 Identify (06h): Supported 00:28:29.589 Abort (08h): Supported 00:28:29.589 Set Features (09h): Supported 00:28:29.589 Get Features (0Ah): Supported 00:28:29.589 Asynchronous Event Request (0Ch): Supported 00:28:29.589 Keep Alive (18h): Supported 00:28:29.589 I/O Commands 00:28:29.589 ------------ 00:28:29.589 Flush (00h): Supported 00:28:29.589 Write (01h): Supported LBA-Change 00:28:29.589 Read (02h): Supported 00:28:29.589 Write Zeroes (08h): Supported LBA-Change 00:28:29.589 Dataset Management (09h): Supported 00:28:29.589 00:28:29.589 Error Log 00:28:29.589 ========= 00:28:29.589 Entry: 0 00:28:29.589 Error Count: 0x3 00:28:29.589 Submission Queue Id: 0x0 00:28:29.589 Command Id: 0x5 00:28:29.589 Phase Bit: 0 00:28:29.589 Status Code: 0x2 00:28:29.589 Status Code Type: 0x0 00:28:29.589 Do Not Retry: 1 00:28:29.589 Error Location: 0x28 00:28:29.589 LBA: 0x0 00:28:29.589 Namespace: 0x0 00:28:29.589 Vendor Log Page: 0x0 00:28:29.589 ----------- 00:28:29.589 Entry: 1 00:28:29.589 Error Count: 0x2 00:28:29.589 Submission Queue Id: 0x0 00:28:29.589 Command Id: 0x5 00:28:29.589 Phase Bit: 0 00:28:29.589 Status Code: 0x2 00:28:29.589 Status Code Type: 0x0 00:28:29.589 Do Not Retry: 1 00:28:29.589 Error Location: 0x28 00:28:29.589 LBA: 0x0 00:28:29.589 Namespace: 0x0 00:28:29.589 Vendor Log Page: 0x0 00:28:29.589 ----------- 00:28:29.589 Entry: 2 00:28:29.589 Error Count: 0x1 00:28:29.589 Submission Queue Id: 0x0 00:28:29.589 Command Id: 0x0 00:28:29.589 Phase Bit: 0 00:28:29.589 Status Code: 0x2 00:28:29.589 Status Code Type: 0x0 00:28:29.589 Do Not Retry: 1 00:28:29.589 Error Location: 0x28 00:28:29.589 LBA: 0x0 00:28:29.589 Namespace: 0x0 00:28:29.589 Vendor Log Page: 0x0 00:28:29.589 00:28:29.589 Number of Queues 00:28:29.589 ================ 00:28:29.589 Number of I/O Submission Queues: 128 00:28:29.589 Number of I/O Completion Queues: 128 00:28:29.589 00:28:29.589 ZNS Specific Controller Data 00:28:29.589 ============================ 00:28:29.589 Zone Append Size Limit: 0 00:28:29.589 00:28:29.589 00:28:29.589 Active Namespaces 00:28:29.589 ================= 00:28:29.589 get_feature(0x05) failed 00:28:29.589 Namespace ID:1 00:28:29.589 Command Set Identifier: NVM (00h) 00:28:29.589 Deallocate: Supported 00:28:29.589 Deallocated/Unwritten Error: Not Supported 00:28:29.589 Deallocated Read Value: Unknown 00:28:29.589 Deallocate in Write Zeroes: Not Supported 00:28:29.589 Deallocated Guard Field: 0xFFFF 00:28:29.589 Flush: Supported 00:28:29.589 Reservation: Not Supported 00:28:29.589 Namespace Sharing Capabilities: Multiple Controllers 00:28:29.589 Size (in LBAs): 4194304 (2GiB) 00:28:29.589 Capacity (in LBAs): 4194304 (2GiB) 00:28:29.589 Utilization (in LBAs): 4194304 (2GiB) 00:28:29.589 UUID: 07149627-17b5-400b-b396-6fb4a4484f29 00:28:29.589 Thin Provisioning: Not Supported 00:28:29.589 Per-NS Atomic Units: Yes 00:28:29.589 Atomic Boundary Size (Normal): 0 00:28:29.589 Atomic Boundary Size (PFail): 0 00:28:29.589 Atomic Boundary Offset: 0 00:28:29.589 NGUID/EUI64 Never Reused: No 00:28:29.589 ANA group ID: 1 00:28:29.589 Namespace Write Protected: No 00:28:29.589 Number of LBA Formats: 1 00:28:29.589 Current LBA Format: LBA Format #00 00:28:29.589 LBA Format #00: Data Size: 512 Metadata Size: 0 00:28:29.589 00:28:29.589 03:29:03 -- host/identify_kernel_nvmf.sh@1 -- # nvmftestfini 00:28:29.589 03:29:03 -- nvmf/common.sh@477 -- # nvmfcleanup 00:28:29.589 03:29:03 -- nvmf/common.sh@117 -- # sync 00:28:29.589 03:29:03 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:28:29.589 03:29:03 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:28:29.589 03:29:03 -- nvmf/common.sh@120 -- # set +e 00:28:29.589 03:29:03 -- nvmf/common.sh@121 -- # for i in {1..20} 00:28:29.589 03:29:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:28:29.589 rmmod nvme_rdma 00:28:29.589 rmmod nvme_fabrics 00:28:29.589 03:29:04 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:28:29.589 03:29:04 -- nvmf/common.sh@124 -- # set -e 00:28:29.589 03:29:04 -- nvmf/common.sh@125 -- # return 0 00:28:29.589 03:29:04 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:28:29.589 03:29:04 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:28:29.589 03:29:04 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:28:29.589 03:29:04 -- host/identify_kernel_nvmf.sh@1 -- # clean_kernel_target 00:28:29.589 03:29:04 -- nvmf/common.sh@673 -- # [[ -e /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn ]] 00:28:29.589 03:29:04 -- nvmf/common.sh@675 -- # echo 0 00:28:29.589 03:29:04 -- nvmf/common.sh@677 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/nqn.2016-06.io.spdk:testnqn 00:28:29.589 03:29:04 -- nvmf/common.sh@678 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:28:29.589 03:29:04 -- nvmf/common.sh@679 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:28:29.589 03:29:04 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:28:29.589 03:29:04 -- nvmf/common.sh@682 -- # modules=(/sys/module/nvmet/holders/*) 00:28:29.589 03:29:04 -- nvmf/common.sh@684 -- # modprobe -r nvmet_rdma nvmet 00:28:29.589 03:29:04 -- nvmf/common.sh@687 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh 00:28:32.115 0000:5f:00.0 (1b96 2600): Skipping denied controller at 0000:5f:00.0 00:28:32.375 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:28:32.375 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:28:32.375 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:28:32.375 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:28:32.375 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:28:32.375 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:28:32.375 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:28:32.375 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:28:32.375 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:28:32.375 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:28:32.375 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:28:32.375 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:28:32.375 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:28:32.375 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:28:32.375 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:28:32.375 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:28:33.313 0000:5e:00.0 (8086 0a54): nvme -> vfio-pci 00:28:33.313 00:28:33.313 real 0m14.522s 00:28:33.313 user 0m4.245s 00:28:33.313 sys 0m8.701s 00:28:33.313 03:29:07 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:28:33.313 03:29:07 -- common/autotest_common.sh@10 -- # set +x 00:28:33.313 ************************************ 00:28:33.313 END TEST nvmf_identify_kernel_target 00:28:33.314 ************************************ 00:28:33.314 03:29:07 -- nvmf/nvmf.sh@102 -- # run_test nvmf_auth /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/auth.sh --transport=rdma 00:28:33.314 03:29:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:33.314 03:29:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:33.314 03:29:07 -- common/autotest_common.sh@10 -- # set +x 00:28:33.573 ************************************ 00:28:33.573 START TEST nvmf_auth 00:28:33.573 ************************************ 00:28:33.573 03:29:07 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/auth.sh --transport=rdma 00:28:33.573 * Looking for test storage... 00:28:33.573 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host 00:28:33.573 03:29:07 -- host/auth.sh@10 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:28:33.573 03:29:07 -- nvmf/common.sh@7 -- # uname -s 00:28:33.573 03:29:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:33.573 03:29:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:33.573 03:29:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:33.573 03:29:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:33.573 03:29:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:33.573 03:29:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:33.573 03:29:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:33.573 03:29:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:33.573 03:29:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:33.573 03:29:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:33.573 03:29:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:28:33.573 03:29:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:28:33.573 03:29:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:33.573 03:29:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:33.573 03:29:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:33.573 03:29:07 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:28:33.573 03:29:07 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:28:33.573 03:29:07 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:33.573 03:29:07 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:33.573 03:29:07 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:33.573 03:29:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:33.573 03:29:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:33.573 03:29:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:33.573 03:29:07 -- paths/export.sh@5 -- # export PATH 00:28:33.573 03:29:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:33.573 03:29:07 -- nvmf/common.sh@47 -- # : 0 00:28:33.573 03:29:07 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:28:33.573 03:29:07 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:28:33.573 03:29:07 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:28:33.573 03:29:07 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:33.573 03:29:07 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:33.573 03:29:07 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:28:33.573 03:29:07 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:28:33.573 03:29:07 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:28:33.573 03:29:07 -- host/auth.sh@13 -- # digests=("sha256" "sha384" "sha512") 00:28:33.573 03:29:07 -- host/auth.sh@16 -- # dhgroups=("ffdhe2048" "ffdhe3072" "ffdhe4096" "ffdhe6144" "ffdhe8192") 00:28:33.573 03:29:07 -- host/auth.sh@17 -- # subnqn=nqn.2024-02.io.spdk:cnode0 00:28:33.573 03:29:07 -- host/auth.sh@18 -- # hostnqn=nqn.2024-02.io.spdk:host0 00:28:33.573 03:29:07 -- host/auth.sh@19 -- # nvmet_subsys=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:28:33.573 03:29:07 -- host/auth.sh@20 -- # nvmet_host=/sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:28:33.573 03:29:07 -- host/auth.sh@21 -- # keys=() 00:28:33.573 03:29:07 -- host/auth.sh@77 -- # nvmftestinit 00:28:33.573 03:29:07 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:28:33.573 03:29:07 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:33.573 03:29:07 -- nvmf/common.sh@437 -- # prepare_net_devs 00:28:33.573 03:29:07 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:28:33.573 03:29:07 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:28:33.573 03:29:07 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:33.574 03:29:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:33.574 03:29:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:33.574 03:29:07 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:28:33.574 03:29:07 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:28:33.574 03:29:07 -- nvmf/common.sh@285 -- # xtrace_disable 00:28:33.574 03:29:07 -- common/autotest_common.sh@10 -- # set +x 00:28:40.143 03:29:13 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:40.143 03:29:13 -- nvmf/common.sh@291 -- # pci_devs=() 00:28:40.143 03:29:13 -- nvmf/common.sh@291 -- # local -a pci_devs 00:28:40.143 03:29:13 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:28:40.143 03:29:13 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:28:40.143 03:29:13 -- nvmf/common.sh@293 -- # pci_drivers=() 00:28:40.143 03:29:13 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:28:40.143 03:29:13 -- nvmf/common.sh@295 -- # net_devs=() 00:28:40.143 03:29:13 -- nvmf/common.sh@295 -- # local -ga net_devs 00:28:40.143 03:29:13 -- nvmf/common.sh@296 -- # e810=() 00:28:40.143 03:29:13 -- nvmf/common.sh@296 -- # local -ga e810 00:28:40.143 03:29:13 -- nvmf/common.sh@297 -- # x722=() 00:28:40.143 03:29:13 -- nvmf/common.sh@297 -- # local -ga x722 00:28:40.143 03:29:13 -- nvmf/common.sh@298 -- # mlx=() 00:28:40.143 03:29:13 -- nvmf/common.sh@298 -- # local -ga mlx 00:28:40.143 03:29:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:40.143 03:29:13 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:40.143 03:29:13 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:40.143 03:29:13 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:40.143 03:29:13 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:40.143 03:29:13 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:40.143 03:29:13 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:40.143 03:29:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:40.143 03:29:13 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:40.143 03:29:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:40.143 03:29:13 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:40.143 03:29:13 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:28:40.143 03:29:13 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:28:40.143 03:29:13 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:28:40.143 03:29:13 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:28:40.143 03:29:13 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:28:40.143 03:29:13 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:28:40.143 03:29:13 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:28:40.143 03:29:13 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:28:40.143 03:29:13 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:28:40.143 03:29:13 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:28:40.143 Found 0000:af:00.0 (0x8086 - 0x159b) 00:28:40.143 03:29:13 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:28:40.143 03:29:13 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:28:40.143 03:29:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:40.143 03:29:13 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:40.143 03:29:13 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:28:40.143 03:29:13 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:28:40.143 03:29:13 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:28:40.143 03:29:13 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:28:40.143 Found 0000:af:00.1 (0x8086 - 0x159b) 00:28:40.143 03:29:13 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:28:40.143 03:29:13 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:28:40.143 03:29:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:40.143 03:29:13 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:40.143 03:29:13 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:28:40.143 03:29:13 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:28:40.143 03:29:13 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:28:40.143 03:29:13 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:28:40.143 03:29:13 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:28:40.143 03:29:13 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:28:40.143 03:29:13 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:28:40.143 03:29:13 -- nvmf/common.sh@377 -- # modinfo irdma 00:28:40.143 03:29:13 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:28:40.143 03:29:13 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:28:40.143 03:29:13 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:40.143 03:29:13 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:28:40.143 03:29:13 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:40.143 03:29:13 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:28:40.143 Found net devices under 0000:af:00.0: cvl_0_0 00:28:40.143 03:29:13 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:28:40.143 03:29:13 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:28:40.143 03:29:13 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:40.143 03:29:13 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:28:40.143 03:29:13 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:40.143 03:29:13 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:28:40.143 Found net devices under 0000:af:00.1: cvl_0_1 00:28:40.143 03:29:13 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:28:40.143 03:29:13 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:28:40.143 03:29:13 -- nvmf/common.sh@403 -- # is_hw=yes 00:28:40.143 03:29:13 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:28:40.143 03:29:13 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:28:40.143 03:29:13 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:28:40.143 03:29:13 -- nvmf/common.sh@409 -- # rdma_device_init 00:28:40.143 03:29:13 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:28:40.143 03:29:13 -- nvmf/common.sh@58 -- # uname 00:28:40.143 03:29:13 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:28:40.143 03:29:13 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:28:40.143 03:29:13 -- nvmf/common.sh@63 -- # modprobe ib_core 00:28:40.143 03:29:13 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:28:40.143 03:29:13 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:28:40.143 03:29:13 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:28:40.143 03:29:13 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:28:40.143 03:29:13 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:28:40.143 03:29:13 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:28:40.143 03:29:13 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:28:40.143 03:29:13 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:28:40.143 03:29:13 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:28:40.143 03:29:13 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:28:40.143 03:29:13 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:28:40.143 03:29:13 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:28:40.143 03:29:13 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:28:40.143 03:29:13 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:28:40.143 03:29:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:40.143 03:29:13 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:28:40.143 03:29:13 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:28:40.143 03:29:13 -- nvmf/common.sh@105 -- # continue 2 00:28:40.143 03:29:13 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:28:40.143 03:29:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:40.143 03:29:13 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:28:40.143 03:29:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:40.144 03:29:13 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:28:40.144 03:29:13 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:28:40.144 03:29:13 -- nvmf/common.sh@105 -- # continue 2 00:28:40.144 03:29:13 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:28:40.144 03:29:13 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:28:40.144 03:29:13 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:28:40.144 03:29:13 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:28:40.144 03:29:13 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:28:40.144 03:29:13 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:28:40.144 03:29:13 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:28:40.144 03:29:13 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:28:40.144 03:29:13 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:28:40.144 50: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:28:40.144 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:28:40.144 altname enp175s0f0np0 00:28:40.144 altname ens801f0np0 00:28:40.144 inet 192.168.100.8/24 scope global cvl_0_0 00:28:40.144 valid_lft forever preferred_lft forever 00:28:40.144 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:28:40.144 valid_lft forever preferred_lft forever 00:28:40.144 03:29:13 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:28:40.144 03:29:13 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:28:40.144 03:29:13 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:28:40.144 03:29:13 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:28:40.144 03:29:13 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:28:40.144 03:29:13 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:28:40.144 03:29:13 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:28:40.144 03:29:13 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:28:40.144 03:29:13 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:28:40.144 51: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:28:40.144 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:28:40.144 altname enp175s0f1np1 00:28:40.144 altname ens801f1np1 00:28:40.144 inet 192.168.100.9/24 scope global cvl_0_1 00:28:40.144 valid_lft forever preferred_lft forever 00:28:40.144 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:28:40.144 valid_lft forever preferred_lft forever 00:28:40.144 03:29:13 -- nvmf/common.sh@411 -- # return 0 00:28:40.144 03:29:13 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:28:40.144 03:29:13 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:28:40.144 03:29:13 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:28:40.144 03:29:13 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:28:40.144 03:29:13 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:28:40.144 03:29:13 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:28:40.144 03:29:13 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:28:40.144 03:29:13 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:28:40.144 03:29:13 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:28:40.144 03:29:13 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:28:40.144 03:29:13 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:28:40.144 03:29:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:40.144 03:29:13 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:28:40.144 03:29:13 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:28:40.144 03:29:13 -- nvmf/common.sh@105 -- # continue 2 00:28:40.144 03:29:13 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:28:40.144 03:29:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:40.144 03:29:13 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:28:40.144 03:29:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:40.144 03:29:13 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:28:40.144 03:29:13 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:28:40.144 03:29:13 -- nvmf/common.sh@105 -- # continue 2 00:28:40.144 03:29:13 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:28:40.144 03:29:13 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:28:40.144 03:29:13 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:28:40.144 03:29:13 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:28:40.144 03:29:13 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:28:40.144 03:29:13 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:28:40.144 03:29:13 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:28:40.144 03:29:13 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:28:40.144 03:29:13 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:28:40.144 03:29:13 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:28:40.144 03:29:13 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:28:40.144 03:29:13 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:28:40.144 03:29:14 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:28:40.144 192.168.100.9' 00:28:40.144 03:29:14 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:28:40.144 192.168.100.9' 00:28:40.144 03:29:14 -- nvmf/common.sh@446 -- # head -n 1 00:28:40.144 03:29:14 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:28:40.144 03:29:14 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:28:40.144 192.168.100.9' 00:28:40.144 03:29:14 -- nvmf/common.sh@447 -- # tail -n +2 00:28:40.144 03:29:14 -- nvmf/common.sh@447 -- # head -n 1 00:28:40.144 03:29:14 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:28:40.144 03:29:14 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:28:40.144 03:29:14 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:28:40.144 03:29:14 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:28:40.144 03:29:14 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:28:40.144 03:29:14 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:28:40.144 03:29:14 -- host/auth.sh@78 -- # nvmfappstart -L nvme_auth 00:28:40.144 03:29:14 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:28:40.144 03:29:14 -- common/autotest_common.sh@710 -- # xtrace_disable 00:28:40.144 03:29:14 -- common/autotest_common.sh@10 -- # set +x 00:28:40.144 03:29:14 -- nvmf/common.sh@470 -- # nvmfpid=55318 00:28:40.144 03:29:14 -- nvmf/common.sh@471 -- # waitforlisten 55318 00:28:40.144 03:29:14 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -L nvme_auth 00:28:40.144 03:29:14 -- common/autotest_common.sh@817 -- # '[' -z 55318 ']' 00:28:40.144 03:29:14 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:40.144 03:29:14 -- common/autotest_common.sh@822 -- # local max_retries=100 00:28:40.144 03:29:14 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:40.144 03:29:14 -- common/autotest_common.sh@826 -- # xtrace_disable 00:28:40.144 03:29:14 -- common/autotest_common.sh@10 -- # set +x 00:28:40.403 03:29:14 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:28:40.403 03:29:14 -- common/autotest_common.sh@850 -- # return 0 00:28:40.403 03:29:14 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:28:40.403 03:29:14 -- common/autotest_common.sh@716 -- # xtrace_disable 00:28:40.403 03:29:14 -- common/autotest_common.sh@10 -- # set +x 00:28:40.662 03:29:14 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:40.662 03:29:14 -- host/auth.sh@79 -- # trap 'cat /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/nvme-auth.log; cleanup' SIGINT SIGTERM EXIT 00:28:40.662 03:29:14 -- host/auth.sh@81 -- # gen_key null 32 00:28:40.662 03:29:14 -- host/auth.sh@53 -- # local digest len file key 00:28:40.662 03:29:14 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:28:40.662 03:29:14 -- host/auth.sh@54 -- # local -A digests 00:28:40.662 03:29:14 -- host/auth.sh@56 -- # digest=null 00:28:40.662 03:29:14 -- host/auth.sh@56 -- # len=32 00:28:40.662 03:29:14 -- host/auth.sh@57 -- # xxd -p -c0 -l 16 /dev/urandom 00:28:40.662 03:29:14 -- host/auth.sh@57 -- # key=a7fb11969a014eacbf27160d40463580 00:28:40.662 03:29:14 -- host/auth.sh@58 -- # mktemp -t spdk.key-null.XXX 00:28:40.662 03:29:14 -- host/auth.sh@58 -- # file=/tmp/spdk.key-null.1JM 00:28:40.662 03:29:14 -- host/auth.sh@59 -- # format_dhchap_key a7fb11969a014eacbf27160d40463580 0 00:28:40.662 03:29:14 -- nvmf/common.sh@708 -- # format_key DHHC-1 a7fb11969a014eacbf27160d40463580 0 00:28:40.662 03:29:14 -- nvmf/common.sh@691 -- # local prefix key digest 00:28:40.662 03:29:14 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:28:40.662 03:29:14 -- nvmf/common.sh@693 -- # key=a7fb11969a014eacbf27160d40463580 00:28:40.662 03:29:14 -- nvmf/common.sh@693 -- # digest=0 00:28:40.662 03:29:14 -- nvmf/common.sh@694 -- # python - 00:28:40.662 03:29:14 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-null.1JM 00:28:40.662 03:29:15 -- host/auth.sh@62 -- # echo /tmp/spdk.key-null.1JM 00:28:40.662 03:29:15 -- host/auth.sh@81 -- # keys[0]=/tmp/spdk.key-null.1JM 00:28:40.662 03:29:15 -- host/auth.sh@82 -- # gen_key null 48 00:28:40.662 03:29:15 -- host/auth.sh@53 -- # local digest len file key 00:28:40.662 03:29:15 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:28:40.662 03:29:15 -- host/auth.sh@54 -- # local -A digests 00:28:40.662 03:29:15 -- host/auth.sh@56 -- # digest=null 00:28:40.662 03:29:15 -- host/auth.sh@56 -- # len=48 00:28:40.662 03:29:15 -- host/auth.sh@57 -- # xxd -p -c0 -l 24 /dev/urandom 00:28:40.662 03:29:15 -- host/auth.sh@57 -- # key=b135ee7179c7fe8f84923b7ec0f245fc2d119cbf1de21959 00:28:40.662 03:29:15 -- host/auth.sh@58 -- # mktemp -t spdk.key-null.XXX 00:28:40.662 03:29:15 -- host/auth.sh@58 -- # file=/tmp/spdk.key-null.ef2 00:28:40.662 03:29:15 -- host/auth.sh@59 -- # format_dhchap_key b135ee7179c7fe8f84923b7ec0f245fc2d119cbf1de21959 0 00:28:40.662 03:29:15 -- nvmf/common.sh@708 -- # format_key DHHC-1 b135ee7179c7fe8f84923b7ec0f245fc2d119cbf1de21959 0 00:28:40.662 03:29:15 -- nvmf/common.sh@691 -- # local prefix key digest 00:28:40.662 03:29:15 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:28:40.662 03:29:15 -- nvmf/common.sh@693 -- # key=b135ee7179c7fe8f84923b7ec0f245fc2d119cbf1de21959 00:28:40.662 03:29:15 -- nvmf/common.sh@693 -- # digest=0 00:28:40.662 03:29:15 -- nvmf/common.sh@694 -- # python - 00:28:40.662 03:29:15 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-null.ef2 00:28:40.662 03:29:15 -- host/auth.sh@62 -- # echo /tmp/spdk.key-null.ef2 00:28:40.662 03:29:15 -- host/auth.sh@82 -- # keys[1]=/tmp/spdk.key-null.ef2 00:28:40.662 03:29:15 -- host/auth.sh@83 -- # gen_key sha256 32 00:28:40.662 03:29:15 -- host/auth.sh@53 -- # local digest len file key 00:28:40.662 03:29:15 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:28:40.662 03:29:15 -- host/auth.sh@54 -- # local -A digests 00:28:40.662 03:29:15 -- host/auth.sh@56 -- # digest=sha256 00:28:40.662 03:29:15 -- host/auth.sh@56 -- # len=32 00:28:40.662 03:29:15 -- host/auth.sh@57 -- # xxd -p -c0 -l 16 /dev/urandom 00:28:40.662 03:29:15 -- host/auth.sh@57 -- # key=8c87876491ad796bc8ae4891c5c13179 00:28:40.662 03:29:15 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha256.XXX 00:28:40.662 03:29:15 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha256.GFB 00:28:40.662 03:29:15 -- host/auth.sh@59 -- # format_dhchap_key 8c87876491ad796bc8ae4891c5c13179 1 00:28:40.662 03:29:15 -- nvmf/common.sh@708 -- # format_key DHHC-1 8c87876491ad796bc8ae4891c5c13179 1 00:28:40.662 03:29:15 -- nvmf/common.sh@691 -- # local prefix key digest 00:28:40.663 03:29:15 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:28:40.663 03:29:15 -- nvmf/common.sh@693 -- # key=8c87876491ad796bc8ae4891c5c13179 00:28:40.663 03:29:15 -- nvmf/common.sh@693 -- # digest=1 00:28:40.663 03:29:15 -- nvmf/common.sh@694 -- # python - 00:28:40.663 03:29:15 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha256.GFB 00:28:40.663 03:29:15 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha256.GFB 00:28:40.663 03:29:15 -- host/auth.sh@83 -- # keys[2]=/tmp/spdk.key-sha256.GFB 00:28:40.663 03:29:15 -- host/auth.sh@84 -- # gen_key sha384 48 00:28:40.663 03:29:15 -- host/auth.sh@53 -- # local digest len file key 00:28:40.663 03:29:15 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:28:40.663 03:29:15 -- host/auth.sh@54 -- # local -A digests 00:28:40.663 03:29:15 -- host/auth.sh@56 -- # digest=sha384 00:28:40.663 03:29:15 -- host/auth.sh@56 -- # len=48 00:28:40.663 03:29:15 -- host/auth.sh@57 -- # xxd -p -c0 -l 24 /dev/urandom 00:28:40.663 03:29:15 -- host/auth.sh@57 -- # key=f5581ca996cb58e246fb87d171814772aff030967eaf50ff 00:28:40.663 03:29:15 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha384.XXX 00:28:40.663 03:29:15 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha384.Xoq 00:28:40.663 03:29:15 -- host/auth.sh@59 -- # format_dhchap_key f5581ca996cb58e246fb87d171814772aff030967eaf50ff 2 00:28:40.663 03:29:15 -- nvmf/common.sh@708 -- # format_key DHHC-1 f5581ca996cb58e246fb87d171814772aff030967eaf50ff 2 00:28:40.663 03:29:15 -- nvmf/common.sh@691 -- # local prefix key digest 00:28:40.663 03:29:15 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:28:40.663 03:29:15 -- nvmf/common.sh@693 -- # key=f5581ca996cb58e246fb87d171814772aff030967eaf50ff 00:28:40.663 03:29:15 -- nvmf/common.sh@693 -- # digest=2 00:28:40.663 03:29:15 -- nvmf/common.sh@694 -- # python - 00:28:40.922 03:29:15 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha384.Xoq 00:28:40.922 03:29:15 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha384.Xoq 00:28:40.922 03:29:15 -- host/auth.sh@84 -- # keys[3]=/tmp/spdk.key-sha384.Xoq 00:28:40.922 03:29:15 -- host/auth.sh@85 -- # gen_key sha512 64 00:28:40.922 03:29:15 -- host/auth.sh@53 -- # local digest len file key 00:28:40.922 03:29:15 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:28:40.922 03:29:15 -- host/auth.sh@54 -- # local -A digests 00:28:40.922 03:29:15 -- host/auth.sh@56 -- # digest=sha512 00:28:40.922 03:29:15 -- host/auth.sh@56 -- # len=64 00:28:40.922 03:29:15 -- host/auth.sh@57 -- # xxd -p -c0 -l 32 /dev/urandom 00:28:40.922 03:29:15 -- host/auth.sh@57 -- # key=273cf8cbe5afc302a3d3f6afdfbca2883156fa448664fe8811c57ef4bdabdfbc 00:28:40.922 03:29:15 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha512.XXX 00:28:40.922 03:29:15 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha512.L6a 00:28:40.922 03:29:15 -- host/auth.sh@59 -- # format_dhchap_key 273cf8cbe5afc302a3d3f6afdfbca2883156fa448664fe8811c57ef4bdabdfbc 3 00:28:40.922 03:29:15 -- nvmf/common.sh@708 -- # format_key DHHC-1 273cf8cbe5afc302a3d3f6afdfbca2883156fa448664fe8811c57ef4bdabdfbc 3 00:28:40.922 03:29:15 -- nvmf/common.sh@691 -- # local prefix key digest 00:28:40.922 03:29:15 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:28:40.922 03:29:15 -- nvmf/common.sh@693 -- # key=273cf8cbe5afc302a3d3f6afdfbca2883156fa448664fe8811c57ef4bdabdfbc 00:28:40.922 03:29:15 -- nvmf/common.sh@693 -- # digest=3 00:28:40.922 03:29:15 -- nvmf/common.sh@694 -- # python - 00:28:40.922 03:29:15 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha512.L6a 00:28:40.922 03:29:15 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha512.L6a 00:28:40.922 03:29:15 -- host/auth.sh@85 -- # keys[4]=/tmp/spdk.key-sha512.L6a 00:28:40.922 03:29:15 -- host/auth.sh@87 -- # waitforlisten 55318 00:28:40.922 03:29:15 -- common/autotest_common.sh@817 -- # '[' -z 55318 ']' 00:28:40.922 03:29:15 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:40.922 03:29:15 -- common/autotest_common.sh@822 -- # local max_retries=100 00:28:40.922 03:29:15 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:40.922 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:40.922 03:29:15 -- common/autotest_common.sh@826 -- # xtrace_disable 00:28:40.922 03:29:15 -- common/autotest_common.sh@10 -- # set +x 00:28:40.922 03:29:15 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:28:40.922 03:29:15 -- common/autotest_common.sh@850 -- # return 0 00:28:40.922 03:29:15 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:28:40.922 03:29:15 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key0 /tmp/spdk.key-null.1JM 00:28:40.922 03:29:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:40.922 03:29:15 -- common/autotest_common.sh@10 -- # set +x 00:28:40.922 03:29:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:40.922 03:29:15 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:28:40.922 03:29:15 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key1 /tmp/spdk.key-null.ef2 00:28:40.922 03:29:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:40.922 03:29:15 -- common/autotest_common.sh@10 -- # set +x 00:28:40.922 03:29:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:40.922 03:29:15 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:28:40.922 03:29:15 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key2 /tmp/spdk.key-sha256.GFB 00:28:40.922 03:29:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:40.922 03:29:15 -- common/autotest_common.sh@10 -- # set +x 00:28:41.181 03:29:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:41.181 03:29:15 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:28:41.181 03:29:15 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key3 /tmp/spdk.key-sha384.Xoq 00:28:41.181 03:29:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:41.181 03:29:15 -- common/autotest_common.sh@10 -- # set +x 00:28:41.181 03:29:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:41.181 03:29:15 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:28:41.181 03:29:15 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key4 /tmp/spdk.key-sha512.L6a 00:28:41.181 03:29:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:41.181 03:29:15 -- common/autotest_common.sh@10 -- # set +x 00:28:41.181 03:29:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:41.181 03:29:15 -- host/auth.sh@92 -- # nvmet_auth_init 00:28:41.181 03:29:15 -- host/auth.sh@35 -- # get_main_ns_ip 00:28:41.181 03:29:15 -- nvmf/common.sh@717 -- # local ip 00:28:41.181 03:29:15 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:41.181 03:29:15 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:41.181 03:29:15 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:41.181 03:29:15 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:41.181 03:29:15 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:28:41.181 03:29:15 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:28:41.181 03:29:15 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:28:41.181 03:29:15 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:28:41.181 03:29:15 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:28:41.181 03:29:15 -- host/auth.sh@35 -- # configure_kernel_target nqn.2024-02.io.spdk:cnode0 192.168.100.8 00:28:41.181 03:29:15 -- nvmf/common.sh@621 -- # local kernel_name=nqn.2024-02.io.spdk:cnode0 kernel_target_ip=192.168.100.8 00:28:41.181 03:29:15 -- nvmf/common.sh@623 -- # nvmet=/sys/kernel/config/nvmet 00:28:41.181 03:29:15 -- nvmf/common.sh@624 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:28:41.181 03:29:15 -- nvmf/common.sh@625 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:28:41.181 03:29:15 -- nvmf/common.sh@626 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:28:41.181 03:29:15 -- nvmf/common.sh@628 -- # local block nvme 00:28:41.181 03:29:15 -- nvmf/common.sh@630 -- # [[ ! -e /sys/module/nvmet ]] 00:28:41.181 03:29:15 -- nvmf/common.sh@631 -- # modprobe nvmet 00:28:41.181 03:29:15 -- nvmf/common.sh@634 -- # [[ -e /sys/kernel/config/nvmet ]] 00:28:41.181 03:29:15 -- nvmf/common.sh@636 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh reset 00:28:43.722 0000:5f:00.0 (1b96 2600): Skipping denied controller at 0000:5f:00.0 00:28:43.722 Waiting for block devices as requested 00:28:43.722 0000:5e:00.0 (8086 0a54): vfio-pci -> nvme 00:28:43.980 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:28:43.980 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:28:43.980 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:28:44.238 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:28:44.238 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:28:44.238 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:28:44.238 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:28:44.496 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:28:44.496 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:28:44.496 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:28:44.496 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:28:44.754 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:28:44.754 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:28:44.754 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:28:45.012 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:28:45.012 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:28:45.578 03:29:19 -- nvmf/common.sh@639 -- # for block in /sys/block/nvme* 00:28:45.578 03:29:19 -- nvmf/common.sh@640 -- # [[ -e /sys/block/nvme0n1 ]] 00:28:45.578 03:29:19 -- nvmf/common.sh@641 -- # is_block_zoned nvme0n1 00:28:45.578 03:29:19 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:28:45.578 03:29:19 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:28:45.578 03:29:19 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:28:45.578 03:29:19 -- nvmf/common.sh@642 -- # block_in_use nvme0n1 00:28:45.578 03:29:19 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:28:45.578 03:29:19 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:28:45.578 No valid GPT data, bailing 00:28:45.578 03:29:20 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:28:45.578 03:29:20 -- scripts/common.sh@391 -- # pt= 00:28:45.578 03:29:20 -- scripts/common.sh@392 -- # return 1 00:28:45.578 03:29:20 -- nvmf/common.sh@642 -- # nvme=/dev/nvme0n1 00:28:45.578 03:29:20 -- nvmf/common.sh@639 -- # for block in /sys/block/nvme* 00:28:45.578 03:29:20 -- nvmf/common.sh@640 -- # [[ -e /sys/block/nvme1n1 ]] 00:28:45.578 03:29:20 -- nvmf/common.sh@641 -- # is_block_zoned nvme1n1 00:28:45.578 03:29:20 -- common/autotest_common.sh@1648 -- # local device=nvme1n1 00:28:45.578 03:29:20 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme1n1/queue/zoned ]] 00:28:45.578 03:29:20 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:28:45.578 03:29:20 -- nvmf/common.sh@642 -- # block_in_use nvme1n1 00:28:45.578 03:29:20 -- scripts/common.sh@378 -- # local block=nvme1n1 pt 00:28:45.578 03:29:20 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/spdk-gpt.py nvme1n1 00:28:45.578 No valid GPT data, bailing 00:28:45.578 03:29:20 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme1n1 00:28:45.837 03:29:20 -- scripts/common.sh@391 -- # pt= 00:28:45.837 03:29:20 -- scripts/common.sh@392 -- # return 1 00:28:45.837 03:29:20 -- nvmf/common.sh@642 -- # nvme=/dev/nvme1n1 00:28:45.837 03:29:20 -- nvmf/common.sh@639 -- # for block in /sys/block/nvme* 00:28:45.837 03:29:20 -- nvmf/common.sh@640 -- # [[ -e /sys/block/nvme1n2 ]] 00:28:45.837 03:29:20 -- nvmf/common.sh@641 -- # is_block_zoned nvme1n2 00:28:45.837 03:29:20 -- common/autotest_common.sh@1648 -- # local device=nvme1n2 00:28:45.837 03:29:20 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme1n2/queue/zoned ]] 00:28:45.837 03:29:20 -- common/autotest_common.sh@1651 -- # [[ host-managed != none ]] 00:28:45.837 03:29:20 -- nvmf/common.sh@641 -- # continue 00:28:45.837 03:29:20 -- nvmf/common.sh@645 -- # [[ -b /dev/nvme1n1 ]] 00:28:45.837 03:29:20 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:28:45.837 03:29:20 -- nvmf/common.sh@648 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:28:45.837 03:29:20 -- nvmf/common.sh@649 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:28:45.837 03:29:20 -- nvmf/common.sh@654 -- # echo SPDK-nqn.2024-02.io.spdk:cnode0 00:28:45.837 03:29:20 -- nvmf/common.sh@656 -- # echo 1 00:28:45.837 03:29:20 -- nvmf/common.sh@657 -- # echo /dev/nvme1n1 00:28:45.837 03:29:20 -- nvmf/common.sh@658 -- # echo 1 00:28:45.837 03:29:20 -- nvmf/common.sh@660 -- # echo 192.168.100.8 00:28:45.837 03:29:20 -- nvmf/common.sh@661 -- # echo rdma 00:28:45.837 03:29:20 -- nvmf/common.sh@662 -- # echo 4420 00:28:45.837 03:29:20 -- nvmf/common.sh@663 -- # echo ipv4 00:28:45.837 03:29:20 -- nvmf/common.sh@666 -- # ln -s /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 /sys/kernel/config/nvmet/ports/1/subsystems/ 00:28:45.837 03:29:20 -- nvmf/common.sh@669 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 --hostid=801347e8-3fd0-e911-906e-0017a4403562 -a 192.168.100.8 -t rdma -s 4420 00:28:45.837 00:28:45.837 Discovery Log Number of Records 2, Generation counter 2 00:28:45.837 =====Discovery Log Entry 0====== 00:28:45.837 trtype: rdma 00:28:45.837 adrfam: ipv4 00:28:45.837 subtype: current discovery subsystem 00:28:45.837 treq: not specified, sq flow control disable supported 00:28:45.837 portid: 1 00:28:45.837 trsvcid: 4420 00:28:45.837 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:28:45.837 traddr: 192.168.100.8 00:28:45.837 eflags: none 00:28:45.837 rdma_prtype: not specified 00:28:45.837 rdma_qptype: connected 00:28:45.837 rdma_cms: rdma-cm 00:28:45.837 rdma_pkey: 0x0000 00:28:45.837 =====Discovery Log Entry 1====== 00:28:45.837 trtype: rdma 00:28:45.837 adrfam: ipv4 00:28:45.837 subtype: nvme subsystem 00:28:45.837 treq: not specified, sq flow control disable supported 00:28:45.837 portid: 1 00:28:45.837 trsvcid: 4420 00:28:45.837 subnqn: nqn.2024-02.io.spdk:cnode0 00:28:45.837 traddr: 192.168.100.8 00:28:45.837 eflags: none 00:28:45.837 rdma_prtype: not specified 00:28:45.837 rdma_qptype: connected 00:28:45.837 rdma_cms: rdma-cm 00:28:45.837 rdma_pkey: 0x0000 00:28:45.837 03:29:20 -- host/auth.sh@36 -- # mkdir /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:28:45.837 03:29:20 -- host/auth.sh@37 -- # echo 0 00:28:45.837 03:29:20 -- host/auth.sh@38 -- # ln -s /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/allowed_hosts/nqn.2024-02.io.spdk:host0 00:28:45.837 03:29:20 -- host/auth.sh@95 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:28:45.837 03:29:20 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:45.837 03:29:20 -- host/auth.sh@44 -- # digest=sha256 00:28:45.837 03:29:20 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:28:45.837 03:29:20 -- host/auth.sh@44 -- # keyid=1 00:28:45.837 03:29:20 -- host/auth.sh@45 -- # key=DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:28:45.837 03:29:20 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:45.837 03:29:20 -- host/auth.sh@48 -- # echo ffdhe2048 00:28:46.096 03:29:20 -- host/auth.sh@49 -- # echo DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:28:46.096 03:29:20 -- host/auth.sh@100 -- # IFS=, 00:28:46.096 03:29:20 -- host/auth.sh@101 -- # printf %s sha256,sha384,sha512 00:28:46.096 03:29:20 -- host/auth.sh@100 -- # IFS=, 00:28:46.096 03:29:20 -- host/auth.sh@101 -- # printf %s ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:28:46.096 03:29:20 -- host/auth.sh@100 -- # connect_authenticate sha256,sha384,sha512 ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 1 00:28:46.096 03:29:20 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:46.096 03:29:20 -- host/auth.sh@68 -- # digest=sha256,sha384,sha512 00:28:46.096 03:29:20 -- host/auth.sh@68 -- # dhgroup=ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:28:46.096 03:29:20 -- host/auth.sh@68 -- # keyid=1 00:28:46.096 03:29:20 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256,sha384,sha512 --dhchap-dhgroups ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:28:46.096 03:29:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:46.096 03:29:20 -- common/autotest_common.sh@10 -- # set +x 00:28:46.096 03:29:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:46.096 03:29:20 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:46.096 03:29:20 -- nvmf/common.sh@717 -- # local ip 00:28:46.096 03:29:20 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:46.096 03:29:20 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:46.096 03:29:20 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:46.096 03:29:20 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:46.096 03:29:20 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:28:46.096 03:29:20 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:28:46.096 03:29:20 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:28:46.096 03:29:20 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:28:46.096 03:29:20 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:28:46.096 03:29:20 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:28:46.096 03:29:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:46.096 03:29:20 -- common/autotest_common.sh@10 -- # set +x 00:28:46.096 nvme0n1 00:28:46.096 03:29:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:46.096 03:29:20 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:46.096 03:29:20 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:46.096 03:29:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:46.096 03:29:20 -- common/autotest_common.sh@10 -- # set +x 00:28:46.096 03:29:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:46.096 03:29:20 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:46.096 03:29:20 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:46.096 03:29:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:46.096 03:29:20 -- common/autotest_common.sh@10 -- # set +x 00:28:46.096 03:29:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:46.096 03:29:20 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:28:46.096 03:29:20 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:28:46.096 03:29:20 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:46.096 03:29:20 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 0 00:28:46.096 03:29:20 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:46.096 03:29:20 -- host/auth.sh@44 -- # digest=sha256 00:28:46.096 03:29:20 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:28:46.096 03:29:20 -- host/auth.sh@44 -- # keyid=0 00:28:46.096 03:29:20 -- host/auth.sh@45 -- # key=DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:28:46.096 03:29:20 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:46.096 03:29:20 -- host/auth.sh@48 -- # echo ffdhe2048 00:28:46.096 03:29:20 -- host/auth.sh@49 -- # echo DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:28:46.096 03:29:20 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 0 00:28:46.096 03:29:20 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:46.096 03:29:20 -- host/auth.sh@68 -- # digest=sha256 00:28:46.096 03:29:20 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:28:46.096 03:29:20 -- host/auth.sh@68 -- # keyid=0 00:28:46.096 03:29:20 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:28:46.096 03:29:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:46.096 03:29:20 -- common/autotest_common.sh@10 -- # set +x 00:28:46.354 03:29:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:46.354 03:29:20 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:46.354 03:29:20 -- nvmf/common.sh@717 -- # local ip 00:28:46.354 03:29:20 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:46.354 03:29:20 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:46.355 03:29:20 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:46.355 03:29:20 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:46.355 03:29:20 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:28:46.355 03:29:20 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:28:46.355 03:29:20 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:28:46.355 03:29:20 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:28:46.355 03:29:20 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:28:46.355 03:29:20 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:28:46.355 03:29:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:46.355 03:29:20 -- common/autotest_common.sh@10 -- # set +x 00:28:46.355 nvme0n1 00:28:46.355 03:29:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:46.355 03:29:20 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:46.355 03:29:20 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:46.355 03:29:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:46.355 03:29:20 -- common/autotest_common.sh@10 -- # set +x 00:28:46.355 03:29:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:46.355 03:29:20 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:46.355 03:29:20 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:46.355 03:29:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:46.355 03:29:20 -- common/autotest_common.sh@10 -- # set +x 00:28:46.355 03:29:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:46.355 03:29:20 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:46.355 03:29:20 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:28:46.355 03:29:20 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:46.355 03:29:20 -- host/auth.sh@44 -- # digest=sha256 00:28:46.355 03:29:20 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:28:46.355 03:29:20 -- host/auth.sh@44 -- # keyid=1 00:28:46.355 03:29:20 -- host/auth.sh@45 -- # key=DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:28:46.355 03:29:20 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:46.355 03:29:20 -- host/auth.sh@48 -- # echo ffdhe2048 00:28:46.355 03:29:20 -- host/auth.sh@49 -- # echo DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:28:46.355 03:29:20 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 1 00:28:46.355 03:29:20 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:46.355 03:29:20 -- host/auth.sh@68 -- # digest=sha256 00:28:46.355 03:29:20 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:28:46.355 03:29:20 -- host/auth.sh@68 -- # keyid=1 00:28:46.355 03:29:20 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:28:46.355 03:29:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:46.355 03:29:20 -- common/autotest_common.sh@10 -- # set +x 00:28:46.355 03:29:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:46.355 03:29:20 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:46.355 03:29:20 -- nvmf/common.sh@717 -- # local ip 00:28:46.355 03:29:20 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:46.355 03:29:20 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:46.355 03:29:20 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:46.355 03:29:20 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:46.355 03:29:20 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:28:46.355 03:29:20 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:28:46.355 03:29:20 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:28:46.355 03:29:20 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:28:46.355 03:29:20 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:28:46.355 03:29:20 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:28:46.355 03:29:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:46.355 03:29:20 -- common/autotest_common.sh@10 -- # set +x 00:28:46.613 nvme0n1 00:28:46.613 03:29:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:46.613 03:29:20 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:46.613 03:29:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:46.613 03:29:20 -- common/autotest_common.sh@10 -- # set +x 00:28:46.613 03:29:20 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:46.613 03:29:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:46.613 03:29:21 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:46.613 03:29:21 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:46.613 03:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:46.613 03:29:21 -- common/autotest_common.sh@10 -- # set +x 00:28:46.613 03:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:46.613 03:29:21 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:46.613 03:29:21 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 2 00:28:46.613 03:29:21 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:46.613 03:29:21 -- host/auth.sh@44 -- # digest=sha256 00:28:46.613 03:29:21 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:28:46.613 03:29:21 -- host/auth.sh@44 -- # keyid=2 00:28:46.613 03:29:21 -- host/auth.sh@45 -- # key=DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:28:46.613 03:29:21 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:46.613 03:29:21 -- host/auth.sh@48 -- # echo ffdhe2048 00:28:46.613 03:29:21 -- host/auth.sh@49 -- # echo DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:28:46.613 03:29:21 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 2 00:28:46.613 03:29:21 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:46.613 03:29:21 -- host/auth.sh@68 -- # digest=sha256 00:28:46.613 03:29:21 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:28:46.613 03:29:21 -- host/auth.sh@68 -- # keyid=2 00:28:46.613 03:29:21 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:28:46.613 03:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:46.613 03:29:21 -- common/autotest_common.sh@10 -- # set +x 00:28:46.613 03:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:46.613 03:29:21 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:46.613 03:29:21 -- nvmf/common.sh@717 -- # local ip 00:28:46.613 03:29:21 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:46.613 03:29:21 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:46.613 03:29:21 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:46.613 03:29:21 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:46.613 03:29:21 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:28:46.613 03:29:21 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:28:46.613 03:29:21 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:28:46.613 03:29:21 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:28:46.613 03:29:21 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:28:46.613 03:29:21 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:28:46.613 03:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:46.613 03:29:21 -- common/autotest_common.sh@10 -- # set +x 00:28:46.872 nvme0n1 00:28:46.872 03:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:46.872 03:29:21 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:46.872 03:29:21 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:46.872 03:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:46.872 03:29:21 -- common/autotest_common.sh@10 -- # set +x 00:28:46.872 03:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:46.872 03:29:21 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:46.872 03:29:21 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:46.872 03:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:46.872 03:29:21 -- common/autotest_common.sh@10 -- # set +x 00:28:46.872 03:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:46.872 03:29:21 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:46.872 03:29:21 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 3 00:28:46.872 03:29:21 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:46.872 03:29:21 -- host/auth.sh@44 -- # digest=sha256 00:28:46.872 03:29:21 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:28:46.872 03:29:21 -- host/auth.sh@44 -- # keyid=3 00:28:46.872 03:29:21 -- host/auth.sh@45 -- # key=DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:28:46.872 03:29:21 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:46.872 03:29:21 -- host/auth.sh@48 -- # echo ffdhe2048 00:28:46.872 03:29:21 -- host/auth.sh@49 -- # echo DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:28:46.872 03:29:21 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 3 00:28:46.872 03:29:21 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:46.872 03:29:21 -- host/auth.sh@68 -- # digest=sha256 00:28:46.872 03:29:21 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:28:46.872 03:29:21 -- host/auth.sh@68 -- # keyid=3 00:28:46.872 03:29:21 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:28:46.872 03:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:46.872 03:29:21 -- common/autotest_common.sh@10 -- # set +x 00:28:46.872 03:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:46.872 03:29:21 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:46.872 03:29:21 -- nvmf/common.sh@717 -- # local ip 00:28:46.872 03:29:21 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:46.872 03:29:21 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:46.872 03:29:21 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:46.872 03:29:21 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:46.872 03:29:21 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:28:46.872 03:29:21 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:28:46.872 03:29:21 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:28:46.872 03:29:21 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:28:46.872 03:29:21 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:28:46.872 03:29:21 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:28:46.872 03:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:46.872 03:29:21 -- common/autotest_common.sh@10 -- # set +x 00:28:47.130 nvme0n1 00:28:47.130 03:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.130 03:29:21 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:47.130 03:29:21 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:47.130 03:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.130 03:29:21 -- common/autotest_common.sh@10 -- # set +x 00:28:47.130 03:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.130 03:29:21 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:47.130 03:29:21 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:47.130 03:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.130 03:29:21 -- common/autotest_common.sh@10 -- # set +x 00:28:47.130 03:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.130 03:29:21 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:47.130 03:29:21 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 4 00:28:47.130 03:29:21 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:47.131 03:29:21 -- host/auth.sh@44 -- # digest=sha256 00:28:47.131 03:29:21 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:28:47.131 03:29:21 -- host/auth.sh@44 -- # keyid=4 00:28:47.131 03:29:21 -- host/auth.sh@45 -- # key=DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:28:47.131 03:29:21 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:47.131 03:29:21 -- host/auth.sh@48 -- # echo ffdhe2048 00:28:47.131 03:29:21 -- host/auth.sh@49 -- # echo DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:28:47.131 03:29:21 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 4 00:28:47.131 03:29:21 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:47.131 03:29:21 -- host/auth.sh@68 -- # digest=sha256 00:28:47.131 03:29:21 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:28:47.131 03:29:21 -- host/auth.sh@68 -- # keyid=4 00:28:47.131 03:29:21 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:28:47.131 03:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.131 03:29:21 -- common/autotest_common.sh@10 -- # set +x 00:28:47.131 03:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.131 03:29:21 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:47.131 03:29:21 -- nvmf/common.sh@717 -- # local ip 00:28:47.131 03:29:21 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:47.131 03:29:21 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:47.131 03:29:21 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:47.131 03:29:21 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:47.131 03:29:21 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:28:47.131 03:29:21 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:28:47.131 03:29:21 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:28:47.131 03:29:21 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:28:47.131 03:29:21 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:28:47.131 03:29:21 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:28:47.131 03:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.131 03:29:21 -- common/autotest_common.sh@10 -- # set +x 00:28:47.389 nvme0n1 00:28:47.390 03:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.390 03:29:21 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:47.390 03:29:21 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:47.390 03:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.390 03:29:21 -- common/autotest_common.sh@10 -- # set +x 00:28:47.390 03:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.390 03:29:21 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:47.390 03:29:21 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:47.390 03:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.390 03:29:21 -- common/autotest_common.sh@10 -- # set +x 00:28:47.390 03:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.390 03:29:21 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:28:47.390 03:29:21 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:47.390 03:29:21 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 0 00:28:47.390 03:29:21 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:47.390 03:29:21 -- host/auth.sh@44 -- # digest=sha256 00:28:47.390 03:29:21 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:28:47.390 03:29:21 -- host/auth.sh@44 -- # keyid=0 00:28:47.390 03:29:21 -- host/auth.sh@45 -- # key=DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:28:47.390 03:29:21 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:47.390 03:29:21 -- host/auth.sh@48 -- # echo ffdhe3072 00:28:47.648 03:29:21 -- host/auth.sh@49 -- # echo DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:28:47.648 03:29:21 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 0 00:28:47.648 03:29:21 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:47.648 03:29:21 -- host/auth.sh@68 -- # digest=sha256 00:28:47.648 03:29:21 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:28:47.648 03:29:21 -- host/auth.sh@68 -- # keyid=0 00:28:47.648 03:29:21 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:28:47.648 03:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.648 03:29:21 -- common/autotest_common.sh@10 -- # set +x 00:28:47.648 03:29:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.648 03:29:21 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:47.648 03:29:21 -- nvmf/common.sh@717 -- # local ip 00:28:47.648 03:29:21 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:47.648 03:29:21 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:47.648 03:29:21 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:47.648 03:29:21 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:47.648 03:29:21 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:28:47.648 03:29:21 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:28:47.648 03:29:21 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:28:47.648 03:29:21 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:28:47.648 03:29:21 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:28:47.648 03:29:21 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:28:47.648 03:29:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.648 03:29:21 -- common/autotest_common.sh@10 -- # set +x 00:28:47.648 nvme0n1 00:28:47.648 03:29:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.648 03:29:22 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:47.648 03:29:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.648 03:29:22 -- common/autotest_common.sh@10 -- # set +x 00:28:47.648 03:29:22 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:47.648 03:29:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.906 03:29:22 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:47.906 03:29:22 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:47.906 03:29:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.906 03:29:22 -- common/autotest_common.sh@10 -- # set +x 00:28:47.906 03:29:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.906 03:29:22 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:47.906 03:29:22 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 1 00:28:47.906 03:29:22 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:47.906 03:29:22 -- host/auth.sh@44 -- # digest=sha256 00:28:47.906 03:29:22 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:28:47.906 03:29:22 -- host/auth.sh@44 -- # keyid=1 00:28:47.906 03:29:22 -- host/auth.sh@45 -- # key=DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:28:47.906 03:29:22 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:47.906 03:29:22 -- host/auth.sh@48 -- # echo ffdhe3072 00:28:47.906 03:29:22 -- host/auth.sh@49 -- # echo DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:28:47.906 03:29:22 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 1 00:28:47.906 03:29:22 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:47.906 03:29:22 -- host/auth.sh@68 -- # digest=sha256 00:28:47.906 03:29:22 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:28:47.906 03:29:22 -- host/auth.sh@68 -- # keyid=1 00:28:47.907 03:29:22 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:28:47.907 03:29:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.907 03:29:22 -- common/autotest_common.sh@10 -- # set +x 00:28:47.907 03:29:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.907 03:29:22 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:47.907 03:29:22 -- nvmf/common.sh@717 -- # local ip 00:28:47.907 03:29:22 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:47.907 03:29:22 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:47.907 03:29:22 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:47.907 03:29:22 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:47.907 03:29:22 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:28:47.907 03:29:22 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:28:47.907 03:29:22 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:28:47.907 03:29:22 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:28:47.907 03:29:22 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:28:47.907 03:29:22 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:28:47.907 03:29:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.907 03:29:22 -- common/autotest_common.sh@10 -- # set +x 00:28:47.907 nvme0n1 00:28:47.907 03:29:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:47.907 03:29:22 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:47.907 03:29:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:47.907 03:29:22 -- common/autotest_common.sh@10 -- # set +x 00:28:47.907 03:29:22 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:47.907 03:29:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.165 03:29:22 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:48.165 03:29:22 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:48.165 03:29:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.165 03:29:22 -- common/autotest_common.sh@10 -- # set +x 00:28:48.165 03:29:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.165 03:29:22 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:48.165 03:29:22 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 2 00:28:48.165 03:29:22 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:48.165 03:29:22 -- host/auth.sh@44 -- # digest=sha256 00:28:48.165 03:29:22 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:28:48.165 03:29:22 -- host/auth.sh@44 -- # keyid=2 00:28:48.165 03:29:22 -- host/auth.sh@45 -- # key=DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:28:48.165 03:29:22 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:48.165 03:29:22 -- host/auth.sh@48 -- # echo ffdhe3072 00:28:48.165 03:29:22 -- host/auth.sh@49 -- # echo DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:28:48.165 03:29:22 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 2 00:28:48.165 03:29:22 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:48.165 03:29:22 -- host/auth.sh@68 -- # digest=sha256 00:28:48.165 03:29:22 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:28:48.165 03:29:22 -- host/auth.sh@68 -- # keyid=2 00:28:48.165 03:29:22 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:28:48.165 03:29:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.165 03:29:22 -- common/autotest_common.sh@10 -- # set +x 00:28:48.165 03:29:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.165 03:29:22 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:48.165 03:29:22 -- nvmf/common.sh@717 -- # local ip 00:28:48.165 03:29:22 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:48.165 03:29:22 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:48.165 03:29:22 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:48.165 03:29:22 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:48.165 03:29:22 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:28:48.165 03:29:22 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:28:48.165 03:29:22 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:28:48.165 03:29:22 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:28:48.165 03:29:22 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:28:48.165 03:29:22 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:28:48.165 03:29:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.165 03:29:22 -- common/autotest_common.sh@10 -- # set +x 00:28:48.165 nvme0n1 00:28:48.165 03:29:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.165 03:29:22 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:48.165 03:29:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.165 03:29:22 -- common/autotest_common.sh@10 -- # set +x 00:28:48.165 03:29:22 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:48.165 03:29:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.424 03:29:22 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:48.424 03:29:22 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:48.424 03:29:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.424 03:29:22 -- common/autotest_common.sh@10 -- # set +x 00:28:48.424 03:29:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.424 03:29:22 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:48.424 03:29:22 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 3 00:28:48.424 03:29:22 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:48.424 03:29:22 -- host/auth.sh@44 -- # digest=sha256 00:28:48.424 03:29:22 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:28:48.424 03:29:22 -- host/auth.sh@44 -- # keyid=3 00:28:48.424 03:29:22 -- host/auth.sh@45 -- # key=DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:28:48.424 03:29:22 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:48.424 03:29:22 -- host/auth.sh@48 -- # echo ffdhe3072 00:28:48.424 03:29:22 -- host/auth.sh@49 -- # echo DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:28:48.424 03:29:22 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 3 00:28:48.424 03:29:22 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:48.424 03:29:22 -- host/auth.sh@68 -- # digest=sha256 00:28:48.424 03:29:22 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:28:48.424 03:29:22 -- host/auth.sh@68 -- # keyid=3 00:28:48.424 03:29:22 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:28:48.424 03:29:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.424 03:29:22 -- common/autotest_common.sh@10 -- # set +x 00:28:48.424 03:29:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.424 03:29:22 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:48.424 03:29:22 -- nvmf/common.sh@717 -- # local ip 00:28:48.424 03:29:22 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:48.424 03:29:22 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:48.424 03:29:22 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:48.424 03:29:22 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:48.424 03:29:22 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:28:48.424 03:29:22 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:28:48.424 03:29:22 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:28:48.424 03:29:22 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:28:48.424 03:29:22 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:28:48.424 03:29:22 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:28:48.424 03:29:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.424 03:29:22 -- common/autotest_common.sh@10 -- # set +x 00:28:48.424 nvme0n1 00:28:48.424 03:29:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.424 03:29:22 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:48.424 03:29:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.424 03:29:22 -- common/autotest_common.sh@10 -- # set +x 00:28:48.424 03:29:22 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:48.424 03:29:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.424 03:29:22 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:48.681 03:29:22 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:48.681 03:29:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.681 03:29:22 -- common/autotest_common.sh@10 -- # set +x 00:28:48.681 03:29:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.681 03:29:22 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:48.681 03:29:22 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 4 00:28:48.681 03:29:22 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:48.681 03:29:22 -- host/auth.sh@44 -- # digest=sha256 00:28:48.681 03:29:22 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:28:48.681 03:29:22 -- host/auth.sh@44 -- # keyid=4 00:28:48.681 03:29:22 -- host/auth.sh@45 -- # key=DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:28:48.681 03:29:22 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:48.681 03:29:22 -- host/auth.sh@48 -- # echo ffdhe3072 00:28:48.681 03:29:22 -- host/auth.sh@49 -- # echo DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:28:48.681 03:29:22 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 4 00:28:48.681 03:29:22 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:48.681 03:29:22 -- host/auth.sh@68 -- # digest=sha256 00:28:48.681 03:29:22 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:28:48.681 03:29:22 -- host/auth.sh@68 -- # keyid=4 00:28:48.681 03:29:22 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:28:48.681 03:29:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.681 03:29:22 -- common/autotest_common.sh@10 -- # set +x 00:28:48.681 03:29:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.681 03:29:22 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:48.681 03:29:22 -- nvmf/common.sh@717 -- # local ip 00:28:48.681 03:29:22 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:48.681 03:29:22 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:48.681 03:29:22 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:48.682 03:29:22 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:48.682 03:29:22 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:28:48.682 03:29:22 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:28:48.682 03:29:22 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:28:48.682 03:29:22 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:28:48.682 03:29:22 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:28:48.682 03:29:22 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:28:48.682 03:29:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.682 03:29:22 -- common/autotest_common.sh@10 -- # set +x 00:28:48.682 nvme0n1 00:28:48.682 03:29:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.682 03:29:23 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:48.682 03:29:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.682 03:29:23 -- common/autotest_common.sh@10 -- # set +x 00:28:48.682 03:29:23 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:48.682 03:29:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.682 03:29:23 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:48.682 03:29:23 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:48.682 03:29:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:48.682 03:29:23 -- common/autotest_common.sh@10 -- # set +x 00:28:48.939 03:29:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:48.939 03:29:23 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:28:48.939 03:29:23 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:48.940 03:29:23 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 0 00:28:48.940 03:29:23 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:48.940 03:29:23 -- host/auth.sh@44 -- # digest=sha256 00:28:48.940 03:29:23 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:28:48.940 03:29:23 -- host/auth.sh@44 -- # keyid=0 00:28:48.940 03:29:23 -- host/auth.sh@45 -- # key=DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:28:48.940 03:29:23 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:48.940 03:29:23 -- host/auth.sh@48 -- # echo ffdhe4096 00:28:49.198 03:29:23 -- host/auth.sh@49 -- # echo DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:28:49.198 03:29:23 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 0 00:28:49.198 03:29:23 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:49.198 03:29:23 -- host/auth.sh@68 -- # digest=sha256 00:28:49.198 03:29:23 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:28:49.198 03:29:23 -- host/auth.sh@68 -- # keyid=0 00:28:49.198 03:29:23 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:28:49.198 03:29:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:49.198 03:29:23 -- common/autotest_common.sh@10 -- # set +x 00:28:49.198 03:29:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:49.198 03:29:23 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:49.198 03:29:23 -- nvmf/common.sh@717 -- # local ip 00:28:49.198 03:29:23 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:49.198 03:29:23 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:49.198 03:29:23 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:49.198 03:29:23 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:49.198 03:29:23 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:28:49.198 03:29:23 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:28:49.198 03:29:23 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:28:49.198 03:29:23 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:28:49.198 03:29:23 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:28:49.198 03:29:23 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:28:49.198 03:29:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:49.198 03:29:23 -- common/autotest_common.sh@10 -- # set +x 00:28:49.457 nvme0n1 00:28:49.457 03:29:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:49.457 03:29:23 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:49.457 03:29:23 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:49.457 03:29:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:49.457 03:29:23 -- common/autotest_common.sh@10 -- # set +x 00:28:49.457 03:29:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:49.457 03:29:23 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:49.457 03:29:23 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:49.457 03:29:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:49.457 03:29:23 -- common/autotest_common.sh@10 -- # set +x 00:28:49.457 03:29:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:49.457 03:29:23 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:49.457 03:29:23 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 1 00:28:49.457 03:29:23 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:49.457 03:29:23 -- host/auth.sh@44 -- # digest=sha256 00:28:49.457 03:29:23 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:28:49.457 03:29:23 -- host/auth.sh@44 -- # keyid=1 00:28:49.457 03:29:23 -- host/auth.sh@45 -- # key=DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:28:49.457 03:29:23 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:49.457 03:29:23 -- host/auth.sh@48 -- # echo ffdhe4096 00:28:49.457 03:29:23 -- host/auth.sh@49 -- # echo DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:28:49.457 03:29:23 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 1 00:28:49.457 03:29:23 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:49.457 03:29:23 -- host/auth.sh@68 -- # digest=sha256 00:28:49.457 03:29:23 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:28:49.457 03:29:23 -- host/auth.sh@68 -- # keyid=1 00:28:49.457 03:29:23 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:28:49.457 03:29:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:49.457 03:29:23 -- common/autotest_common.sh@10 -- # set +x 00:28:49.457 03:29:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:49.457 03:29:23 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:49.457 03:29:23 -- nvmf/common.sh@717 -- # local ip 00:28:49.457 03:29:23 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:49.457 03:29:23 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:49.457 03:29:23 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:49.457 03:29:23 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:49.457 03:29:23 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:28:49.457 03:29:23 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:28:49.457 03:29:23 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:28:49.457 03:29:23 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:28:49.457 03:29:23 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:28:49.457 03:29:23 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:28:49.457 03:29:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:49.457 03:29:23 -- common/autotest_common.sh@10 -- # set +x 00:28:49.716 nvme0n1 00:28:49.716 03:29:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:49.716 03:29:24 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:49.716 03:29:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:49.716 03:29:24 -- common/autotest_common.sh@10 -- # set +x 00:28:49.716 03:29:24 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:49.975 03:29:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:49.975 03:29:24 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:49.975 03:29:24 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:49.975 03:29:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:49.975 03:29:24 -- common/autotest_common.sh@10 -- # set +x 00:28:49.975 03:29:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:49.975 03:29:24 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:49.975 03:29:24 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 2 00:28:49.975 03:29:24 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:49.975 03:29:24 -- host/auth.sh@44 -- # digest=sha256 00:28:49.975 03:29:24 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:28:49.975 03:29:24 -- host/auth.sh@44 -- # keyid=2 00:28:49.975 03:29:24 -- host/auth.sh@45 -- # key=DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:28:49.975 03:29:24 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:49.975 03:29:24 -- host/auth.sh@48 -- # echo ffdhe4096 00:28:49.975 03:29:24 -- host/auth.sh@49 -- # echo DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:28:49.975 03:29:24 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 2 00:28:49.975 03:29:24 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:49.975 03:29:24 -- host/auth.sh@68 -- # digest=sha256 00:28:49.975 03:29:24 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:28:49.975 03:29:24 -- host/auth.sh@68 -- # keyid=2 00:28:49.975 03:29:24 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:28:49.975 03:29:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:49.975 03:29:24 -- common/autotest_common.sh@10 -- # set +x 00:28:49.975 03:29:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:49.975 03:29:24 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:49.975 03:29:24 -- nvmf/common.sh@717 -- # local ip 00:28:49.975 03:29:24 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:49.975 03:29:24 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:49.975 03:29:24 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:49.975 03:29:24 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:49.975 03:29:24 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:28:49.975 03:29:24 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:28:49.975 03:29:24 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:28:49.975 03:29:24 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:28:49.975 03:29:24 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:28:49.975 03:29:24 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:28:49.975 03:29:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:49.975 03:29:24 -- common/autotest_common.sh@10 -- # set +x 00:28:50.300 nvme0n1 00:28:50.300 03:29:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:50.300 03:29:24 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:50.300 03:29:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:50.300 03:29:24 -- common/autotest_common.sh@10 -- # set +x 00:28:50.300 03:29:24 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:50.300 03:29:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:50.300 03:29:24 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:50.300 03:29:24 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:50.300 03:29:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:50.300 03:29:24 -- common/autotest_common.sh@10 -- # set +x 00:28:50.300 03:29:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:50.300 03:29:24 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:50.300 03:29:24 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 3 00:28:50.300 03:29:24 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:50.300 03:29:24 -- host/auth.sh@44 -- # digest=sha256 00:28:50.300 03:29:24 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:28:50.300 03:29:24 -- host/auth.sh@44 -- # keyid=3 00:28:50.300 03:29:24 -- host/auth.sh@45 -- # key=DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:28:50.300 03:29:24 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:50.300 03:29:24 -- host/auth.sh@48 -- # echo ffdhe4096 00:28:50.300 03:29:24 -- host/auth.sh@49 -- # echo DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:28:50.300 03:29:24 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 3 00:28:50.300 03:29:24 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:50.300 03:29:24 -- host/auth.sh@68 -- # digest=sha256 00:28:50.300 03:29:24 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:28:50.300 03:29:24 -- host/auth.sh@68 -- # keyid=3 00:28:50.300 03:29:24 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:28:50.300 03:29:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:50.300 03:29:24 -- common/autotest_common.sh@10 -- # set +x 00:28:50.300 03:29:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:50.300 03:29:24 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:50.300 03:29:24 -- nvmf/common.sh@717 -- # local ip 00:28:50.300 03:29:24 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:50.300 03:29:24 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:50.300 03:29:24 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:50.300 03:29:24 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:50.300 03:29:24 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:28:50.300 03:29:24 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:28:50.300 03:29:24 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:28:50.300 03:29:24 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:28:50.300 03:29:24 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:28:50.300 03:29:24 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:28:50.300 03:29:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:50.300 03:29:24 -- common/autotest_common.sh@10 -- # set +x 00:28:50.575 nvme0n1 00:28:50.575 03:29:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:50.575 03:29:24 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:50.575 03:29:24 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:50.575 03:29:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:50.575 03:29:24 -- common/autotest_common.sh@10 -- # set +x 00:28:50.575 03:29:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:50.575 03:29:24 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:50.575 03:29:24 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:50.575 03:29:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:50.575 03:29:24 -- common/autotest_common.sh@10 -- # set +x 00:28:50.575 03:29:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:50.575 03:29:24 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:50.575 03:29:24 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 4 00:28:50.575 03:29:24 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:50.575 03:29:24 -- host/auth.sh@44 -- # digest=sha256 00:28:50.575 03:29:24 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:28:50.575 03:29:24 -- host/auth.sh@44 -- # keyid=4 00:28:50.575 03:29:24 -- host/auth.sh@45 -- # key=DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:28:50.575 03:29:24 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:50.576 03:29:24 -- host/auth.sh@48 -- # echo ffdhe4096 00:28:50.576 03:29:24 -- host/auth.sh@49 -- # echo DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:28:50.576 03:29:24 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 4 00:28:50.576 03:29:24 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:50.576 03:29:24 -- host/auth.sh@68 -- # digest=sha256 00:28:50.576 03:29:24 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:28:50.576 03:29:24 -- host/auth.sh@68 -- # keyid=4 00:28:50.576 03:29:24 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:28:50.576 03:29:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:50.576 03:29:24 -- common/autotest_common.sh@10 -- # set +x 00:28:50.576 03:29:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:50.576 03:29:24 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:50.576 03:29:24 -- nvmf/common.sh@717 -- # local ip 00:28:50.576 03:29:24 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:50.576 03:29:24 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:50.576 03:29:24 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:50.576 03:29:24 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:50.576 03:29:24 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:28:50.576 03:29:24 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:28:50.576 03:29:24 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:28:50.576 03:29:24 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:28:50.576 03:29:24 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:28:50.576 03:29:24 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:28:50.576 03:29:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:50.576 03:29:24 -- common/autotest_common.sh@10 -- # set +x 00:28:50.835 nvme0n1 00:28:50.835 03:29:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:50.835 03:29:25 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:50.835 03:29:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:50.835 03:29:25 -- common/autotest_common.sh@10 -- # set +x 00:28:50.835 03:29:25 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:50.835 03:29:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:50.835 03:29:25 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:50.835 03:29:25 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:50.835 03:29:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:50.835 03:29:25 -- common/autotest_common.sh@10 -- # set +x 00:28:50.835 03:29:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:50.835 03:29:25 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:28:50.835 03:29:25 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:50.835 03:29:25 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 0 00:28:50.835 03:29:25 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:50.835 03:29:25 -- host/auth.sh@44 -- # digest=sha256 00:28:50.835 03:29:25 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:28:50.835 03:29:25 -- host/auth.sh@44 -- # keyid=0 00:28:50.835 03:29:25 -- host/auth.sh@45 -- # key=DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:28:50.835 03:29:25 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:50.835 03:29:25 -- host/auth.sh@48 -- # echo ffdhe6144 00:28:52.212 03:29:26 -- host/auth.sh@49 -- # echo DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:28:52.212 03:29:26 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 0 00:28:52.212 03:29:26 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:52.212 03:29:26 -- host/auth.sh@68 -- # digest=sha256 00:28:52.212 03:29:26 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:28:52.212 03:29:26 -- host/auth.sh@68 -- # keyid=0 00:28:52.212 03:29:26 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:28:52.212 03:29:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:52.212 03:29:26 -- common/autotest_common.sh@10 -- # set +x 00:28:52.212 03:29:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:52.212 03:29:26 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:52.212 03:29:26 -- nvmf/common.sh@717 -- # local ip 00:28:52.212 03:29:26 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:52.212 03:29:26 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:52.212 03:29:26 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:52.212 03:29:26 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:52.212 03:29:26 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:28:52.212 03:29:26 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:28:52.212 03:29:26 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:28:52.212 03:29:26 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:28:52.212 03:29:26 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:28:52.212 03:29:26 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:28:52.212 03:29:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:52.212 03:29:26 -- common/autotest_common.sh@10 -- # set +x 00:28:52.471 nvme0n1 00:28:52.471 03:29:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:52.471 03:29:26 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:52.471 03:29:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:52.471 03:29:26 -- common/autotest_common.sh@10 -- # set +x 00:28:52.471 03:29:26 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:52.471 03:29:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:52.471 03:29:26 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:52.471 03:29:26 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:52.471 03:29:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:52.471 03:29:26 -- common/autotest_common.sh@10 -- # set +x 00:28:52.729 03:29:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:52.729 03:29:26 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:52.729 03:29:26 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 1 00:28:52.729 03:29:26 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:52.729 03:29:26 -- host/auth.sh@44 -- # digest=sha256 00:28:52.729 03:29:26 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:28:52.729 03:29:26 -- host/auth.sh@44 -- # keyid=1 00:28:52.729 03:29:26 -- host/auth.sh@45 -- # key=DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:28:52.729 03:29:26 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:52.729 03:29:26 -- host/auth.sh@48 -- # echo ffdhe6144 00:28:52.729 03:29:26 -- host/auth.sh@49 -- # echo DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:28:52.729 03:29:26 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 1 00:28:52.729 03:29:26 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:52.729 03:29:26 -- host/auth.sh@68 -- # digest=sha256 00:28:52.729 03:29:26 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:28:52.729 03:29:26 -- host/auth.sh@68 -- # keyid=1 00:28:52.729 03:29:26 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:28:52.729 03:29:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:52.729 03:29:26 -- common/autotest_common.sh@10 -- # set +x 00:28:52.729 03:29:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:52.729 03:29:27 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:52.729 03:29:27 -- nvmf/common.sh@717 -- # local ip 00:28:52.729 03:29:27 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:52.729 03:29:27 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:52.729 03:29:27 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:52.729 03:29:27 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:52.729 03:29:27 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:28:52.729 03:29:27 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:28:52.729 03:29:27 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:28:52.729 03:29:27 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:28:52.729 03:29:27 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:28:52.729 03:29:27 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:28:52.729 03:29:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:52.729 03:29:27 -- common/autotest_common.sh@10 -- # set +x 00:28:52.988 nvme0n1 00:28:52.988 03:29:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:52.988 03:29:27 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:52.988 03:29:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:52.988 03:29:27 -- common/autotest_common.sh@10 -- # set +x 00:28:52.988 03:29:27 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:52.988 03:29:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:52.988 03:29:27 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:52.988 03:29:27 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:52.988 03:29:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:52.988 03:29:27 -- common/autotest_common.sh@10 -- # set +x 00:28:52.988 03:29:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:52.988 03:29:27 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:52.988 03:29:27 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 2 00:28:52.988 03:29:27 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:52.988 03:29:27 -- host/auth.sh@44 -- # digest=sha256 00:28:52.988 03:29:27 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:28:52.988 03:29:27 -- host/auth.sh@44 -- # keyid=2 00:28:52.988 03:29:27 -- host/auth.sh@45 -- # key=DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:28:52.988 03:29:27 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:52.988 03:29:27 -- host/auth.sh@48 -- # echo ffdhe6144 00:28:52.988 03:29:27 -- host/auth.sh@49 -- # echo DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:28:52.988 03:29:27 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 2 00:28:52.988 03:29:27 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:52.988 03:29:27 -- host/auth.sh@68 -- # digest=sha256 00:28:52.988 03:29:27 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:28:52.988 03:29:27 -- host/auth.sh@68 -- # keyid=2 00:28:52.988 03:29:27 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:28:52.988 03:29:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:52.988 03:29:27 -- common/autotest_common.sh@10 -- # set +x 00:28:52.988 03:29:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:52.988 03:29:27 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:52.988 03:29:27 -- nvmf/common.sh@717 -- # local ip 00:28:52.988 03:29:27 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:52.988 03:29:27 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:52.988 03:29:27 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:52.988 03:29:27 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:52.988 03:29:27 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:28:52.988 03:29:27 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:28:52.988 03:29:27 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:28:52.988 03:29:27 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:28:52.988 03:29:27 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:28:52.988 03:29:27 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:28:52.988 03:29:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:52.988 03:29:27 -- common/autotest_common.sh@10 -- # set +x 00:28:53.554 nvme0n1 00:28:53.554 03:29:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:53.554 03:29:27 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:53.554 03:29:27 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:53.554 03:29:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:53.554 03:29:27 -- common/autotest_common.sh@10 -- # set +x 00:28:53.554 03:29:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:53.554 03:29:27 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:53.554 03:29:27 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:53.554 03:29:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:53.554 03:29:27 -- common/autotest_common.sh@10 -- # set +x 00:28:53.554 03:29:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:53.554 03:29:27 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:53.554 03:29:27 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 3 00:28:53.554 03:29:27 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:53.554 03:29:27 -- host/auth.sh@44 -- # digest=sha256 00:28:53.554 03:29:27 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:28:53.554 03:29:27 -- host/auth.sh@44 -- # keyid=3 00:28:53.554 03:29:27 -- host/auth.sh@45 -- # key=DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:28:53.554 03:29:27 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:53.554 03:29:27 -- host/auth.sh@48 -- # echo ffdhe6144 00:28:53.554 03:29:27 -- host/auth.sh@49 -- # echo DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:28:53.554 03:29:27 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 3 00:28:53.554 03:29:27 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:53.554 03:29:27 -- host/auth.sh@68 -- # digest=sha256 00:28:53.554 03:29:27 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:28:53.554 03:29:27 -- host/auth.sh@68 -- # keyid=3 00:28:53.554 03:29:27 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:28:53.554 03:29:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:53.554 03:29:27 -- common/autotest_common.sh@10 -- # set +x 00:28:53.554 03:29:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:53.554 03:29:27 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:53.554 03:29:27 -- nvmf/common.sh@717 -- # local ip 00:28:53.554 03:29:27 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:53.554 03:29:27 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:53.554 03:29:27 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:53.554 03:29:27 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:53.554 03:29:27 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:28:53.554 03:29:27 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:28:53.554 03:29:27 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:28:53.554 03:29:27 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:28:53.554 03:29:27 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:28:53.554 03:29:27 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:28:53.554 03:29:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:53.554 03:29:27 -- common/autotest_common.sh@10 -- # set +x 00:28:53.812 nvme0n1 00:28:53.812 03:29:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:53.812 03:29:28 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:53.812 03:29:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:53.812 03:29:28 -- common/autotest_common.sh@10 -- # set +x 00:28:53.812 03:29:28 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:53.812 03:29:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:53.812 03:29:28 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:53.812 03:29:28 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:53.812 03:29:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:53.812 03:29:28 -- common/autotest_common.sh@10 -- # set +x 00:28:54.071 03:29:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:54.071 03:29:28 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:54.071 03:29:28 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 4 00:28:54.071 03:29:28 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:54.071 03:29:28 -- host/auth.sh@44 -- # digest=sha256 00:28:54.071 03:29:28 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:28:54.071 03:29:28 -- host/auth.sh@44 -- # keyid=4 00:28:54.071 03:29:28 -- host/auth.sh@45 -- # key=DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:28:54.071 03:29:28 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:54.071 03:29:28 -- host/auth.sh@48 -- # echo ffdhe6144 00:28:54.071 03:29:28 -- host/auth.sh@49 -- # echo DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:28:54.071 03:29:28 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 4 00:28:54.071 03:29:28 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:54.071 03:29:28 -- host/auth.sh@68 -- # digest=sha256 00:28:54.071 03:29:28 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:28:54.071 03:29:28 -- host/auth.sh@68 -- # keyid=4 00:28:54.071 03:29:28 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:28:54.071 03:29:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:54.071 03:29:28 -- common/autotest_common.sh@10 -- # set +x 00:28:54.071 03:29:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:54.071 03:29:28 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:54.071 03:29:28 -- nvmf/common.sh@717 -- # local ip 00:28:54.071 03:29:28 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:54.071 03:29:28 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:54.071 03:29:28 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:54.071 03:29:28 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:54.071 03:29:28 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:28:54.071 03:29:28 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:28:54.071 03:29:28 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:28:54.071 03:29:28 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:28:54.071 03:29:28 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:28:54.071 03:29:28 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:28:54.071 03:29:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:54.071 03:29:28 -- common/autotest_common.sh@10 -- # set +x 00:28:54.329 nvme0n1 00:28:54.329 03:29:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:54.329 03:29:28 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:54.329 03:29:28 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:54.329 03:29:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:54.329 03:29:28 -- common/autotest_common.sh@10 -- # set +x 00:28:54.329 03:29:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:54.329 03:29:28 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:54.329 03:29:28 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:54.329 03:29:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:54.329 03:29:28 -- common/autotest_common.sh@10 -- # set +x 00:28:54.329 03:29:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:54.329 03:29:28 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:28:54.329 03:29:28 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:54.329 03:29:28 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 0 00:28:54.329 03:29:28 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:54.329 03:29:28 -- host/auth.sh@44 -- # digest=sha256 00:28:54.329 03:29:28 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:28:54.329 03:29:28 -- host/auth.sh@44 -- # keyid=0 00:28:54.329 03:29:28 -- host/auth.sh@45 -- # key=DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:28:54.329 03:29:28 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:54.329 03:29:28 -- host/auth.sh@48 -- # echo ffdhe8192 00:28:57.616 03:29:31 -- host/auth.sh@49 -- # echo DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:28:57.616 03:29:31 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 0 00:28:57.616 03:29:31 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:57.616 03:29:31 -- host/auth.sh@68 -- # digest=sha256 00:28:57.616 03:29:31 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:28:57.616 03:29:31 -- host/auth.sh@68 -- # keyid=0 00:28:57.616 03:29:31 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:28:57.616 03:29:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:57.616 03:29:31 -- common/autotest_common.sh@10 -- # set +x 00:28:57.616 03:29:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:57.616 03:29:31 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:57.616 03:29:31 -- nvmf/common.sh@717 -- # local ip 00:28:57.616 03:29:31 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:57.616 03:29:31 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:57.616 03:29:31 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:57.616 03:29:31 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:57.616 03:29:31 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:28:57.616 03:29:31 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:28:57.616 03:29:31 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:28:57.616 03:29:31 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:28:57.616 03:29:31 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:28:57.616 03:29:31 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:28:57.616 03:29:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:57.616 03:29:31 -- common/autotest_common.sh@10 -- # set +x 00:28:57.616 nvme0n1 00:28:57.616 03:29:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:57.616 03:29:32 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:57.616 03:29:32 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:57.616 03:29:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:57.616 03:29:32 -- common/autotest_common.sh@10 -- # set +x 00:28:57.616 03:29:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:57.875 03:29:32 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:57.875 03:29:32 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:57.875 03:29:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:57.875 03:29:32 -- common/autotest_common.sh@10 -- # set +x 00:28:57.875 03:29:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:57.875 03:29:32 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:57.875 03:29:32 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 1 00:28:57.875 03:29:32 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:57.875 03:29:32 -- host/auth.sh@44 -- # digest=sha256 00:28:57.875 03:29:32 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:28:57.875 03:29:32 -- host/auth.sh@44 -- # keyid=1 00:28:57.875 03:29:32 -- host/auth.sh@45 -- # key=DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:28:57.875 03:29:32 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:57.875 03:29:32 -- host/auth.sh@48 -- # echo ffdhe8192 00:28:57.875 03:29:32 -- host/auth.sh@49 -- # echo DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:28:57.875 03:29:32 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 1 00:28:57.875 03:29:32 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:57.875 03:29:32 -- host/auth.sh@68 -- # digest=sha256 00:28:57.875 03:29:32 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:28:57.875 03:29:32 -- host/auth.sh@68 -- # keyid=1 00:28:57.875 03:29:32 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:28:57.875 03:29:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:57.875 03:29:32 -- common/autotest_common.sh@10 -- # set +x 00:28:57.875 03:29:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:57.875 03:29:32 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:57.875 03:29:32 -- nvmf/common.sh@717 -- # local ip 00:28:57.875 03:29:32 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:57.875 03:29:32 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:57.875 03:29:32 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:57.875 03:29:32 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:57.875 03:29:32 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:28:57.875 03:29:32 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:28:57.875 03:29:32 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:28:57.875 03:29:32 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:28:57.875 03:29:32 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:28:57.875 03:29:32 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:28:57.875 03:29:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:57.875 03:29:32 -- common/autotest_common.sh@10 -- # set +x 00:28:58.443 nvme0n1 00:28:58.444 03:29:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:58.444 03:29:32 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:58.444 03:29:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:58.444 03:29:32 -- common/autotest_common.sh@10 -- # set +x 00:28:58.444 03:29:32 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:58.444 03:29:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:58.444 03:29:32 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:58.444 03:29:32 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:58.444 03:29:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:58.444 03:29:32 -- common/autotest_common.sh@10 -- # set +x 00:28:58.444 03:29:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:58.444 03:29:32 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:58.444 03:29:32 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 2 00:28:58.444 03:29:32 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:58.444 03:29:32 -- host/auth.sh@44 -- # digest=sha256 00:28:58.444 03:29:32 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:28:58.444 03:29:32 -- host/auth.sh@44 -- # keyid=2 00:28:58.444 03:29:32 -- host/auth.sh@45 -- # key=DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:28:58.444 03:29:32 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:58.444 03:29:32 -- host/auth.sh@48 -- # echo ffdhe8192 00:28:58.444 03:29:32 -- host/auth.sh@49 -- # echo DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:28:58.444 03:29:32 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 2 00:28:58.444 03:29:32 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:58.444 03:29:32 -- host/auth.sh@68 -- # digest=sha256 00:28:58.444 03:29:32 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:28:58.444 03:29:32 -- host/auth.sh@68 -- # keyid=2 00:28:58.444 03:29:32 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:28:58.444 03:29:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:58.444 03:29:32 -- common/autotest_common.sh@10 -- # set +x 00:28:58.444 03:29:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:58.444 03:29:32 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:58.444 03:29:32 -- nvmf/common.sh@717 -- # local ip 00:28:58.444 03:29:32 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:58.444 03:29:32 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:58.444 03:29:32 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:58.444 03:29:32 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:58.444 03:29:32 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:28:58.444 03:29:32 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:28:58.444 03:29:32 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:28:58.444 03:29:32 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:28:58.444 03:29:32 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:28:58.444 03:29:32 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:28:58.444 03:29:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:58.444 03:29:32 -- common/autotest_common.sh@10 -- # set +x 00:28:59.008 nvme0n1 00:28:59.008 03:29:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:59.008 03:29:33 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:59.008 03:29:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:59.008 03:29:33 -- common/autotest_common.sh@10 -- # set +x 00:28:59.008 03:29:33 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:59.008 03:29:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:59.008 03:29:33 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:59.008 03:29:33 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:59.008 03:29:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:59.008 03:29:33 -- common/autotest_common.sh@10 -- # set +x 00:28:59.008 03:29:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:59.008 03:29:33 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:59.008 03:29:33 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 3 00:28:59.008 03:29:33 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:59.008 03:29:33 -- host/auth.sh@44 -- # digest=sha256 00:28:59.008 03:29:33 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:28:59.008 03:29:33 -- host/auth.sh@44 -- # keyid=3 00:28:59.008 03:29:33 -- host/auth.sh@45 -- # key=DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:28:59.008 03:29:33 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:59.008 03:29:33 -- host/auth.sh@48 -- # echo ffdhe8192 00:28:59.008 03:29:33 -- host/auth.sh@49 -- # echo DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:28:59.008 03:29:33 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 3 00:28:59.008 03:29:33 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:59.008 03:29:33 -- host/auth.sh@68 -- # digest=sha256 00:28:59.008 03:29:33 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:28:59.008 03:29:33 -- host/auth.sh@68 -- # keyid=3 00:28:59.008 03:29:33 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:28:59.008 03:29:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:59.008 03:29:33 -- common/autotest_common.sh@10 -- # set +x 00:28:59.008 03:29:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:59.008 03:29:33 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:59.008 03:29:33 -- nvmf/common.sh@717 -- # local ip 00:28:59.008 03:29:33 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:59.008 03:29:33 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:59.008 03:29:33 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:59.008 03:29:33 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:59.008 03:29:33 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:28:59.008 03:29:33 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:28:59.008 03:29:33 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:28:59.008 03:29:33 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:28:59.008 03:29:33 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:28:59.008 03:29:33 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:28:59.008 03:29:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:59.008 03:29:33 -- common/autotest_common.sh@10 -- # set +x 00:28:59.573 nvme0n1 00:28:59.573 03:29:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:59.573 03:29:34 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:28:59.573 03:29:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:59.573 03:29:34 -- common/autotest_common.sh@10 -- # set +x 00:28:59.573 03:29:34 -- host/auth.sh@73 -- # jq -r '.[].name' 00:28:59.573 03:29:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:59.573 03:29:34 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:59.573 03:29:34 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:28:59.573 03:29:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:59.573 03:29:34 -- common/autotest_common.sh@10 -- # set +x 00:28:59.574 03:29:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:59.832 03:29:34 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:28:59.832 03:29:34 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 4 00:28:59.832 03:29:34 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:28:59.832 03:29:34 -- host/auth.sh@44 -- # digest=sha256 00:28:59.832 03:29:34 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:28:59.832 03:29:34 -- host/auth.sh@44 -- # keyid=4 00:28:59.832 03:29:34 -- host/auth.sh@45 -- # key=DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:28:59.832 03:29:34 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:28:59.832 03:29:34 -- host/auth.sh@48 -- # echo ffdhe8192 00:28:59.832 03:29:34 -- host/auth.sh@49 -- # echo DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:28:59.832 03:29:34 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 4 00:28:59.832 03:29:34 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:28:59.832 03:29:34 -- host/auth.sh@68 -- # digest=sha256 00:28:59.832 03:29:34 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:28:59.833 03:29:34 -- host/auth.sh@68 -- # keyid=4 00:28:59.833 03:29:34 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:28:59.833 03:29:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:59.833 03:29:34 -- common/autotest_common.sh@10 -- # set +x 00:28:59.833 03:29:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:59.833 03:29:34 -- host/auth.sh@70 -- # get_main_ns_ip 00:28:59.833 03:29:34 -- nvmf/common.sh@717 -- # local ip 00:28:59.833 03:29:34 -- nvmf/common.sh@718 -- # ip_candidates=() 00:28:59.833 03:29:34 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:28:59.833 03:29:34 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:28:59.833 03:29:34 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:28:59.833 03:29:34 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:28:59.833 03:29:34 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:28:59.833 03:29:34 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:28:59.833 03:29:34 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:28:59.833 03:29:34 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:28:59.833 03:29:34 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:28:59.833 03:29:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:59.833 03:29:34 -- common/autotest_common.sh@10 -- # set +x 00:29:00.400 nvme0n1 00:29:00.400 03:29:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:00.400 03:29:34 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:00.400 03:29:34 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:00.400 03:29:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:00.400 03:29:34 -- common/autotest_common.sh@10 -- # set +x 00:29:00.400 03:29:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:00.400 03:29:34 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:00.400 03:29:34 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:00.400 03:29:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:00.400 03:29:34 -- common/autotest_common.sh@10 -- # set +x 00:29:00.400 03:29:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:00.400 03:29:34 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:29:00.400 03:29:34 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:29:00.400 03:29:34 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:00.400 03:29:34 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 0 00:29:00.400 03:29:34 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:00.401 03:29:34 -- host/auth.sh@44 -- # digest=sha384 00:29:00.401 03:29:34 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:29:00.401 03:29:34 -- host/auth.sh@44 -- # keyid=0 00:29:00.401 03:29:34 -- host/auth.sh@45 -- # key=DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:29:00.401 03:29:34 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:29:00.401 03:29:34 -- host/auth.sh@48 -- # echo ffdhe2048 00:29:00.401 03:29:34 -- host/auth.sh@49 -- # echo DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:29:00.401 03:29:34 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 0 00:29:00.401 03:29:34 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:00.401 03:29:34 -- host/auth.sh@68 -- # digest=sha384 00:29:00.401 03:29:34 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:29:00.401 03:29:34 -- host/auth.sh@68 -- # keyid=0 00:29:00.401 03:29:34 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:29:00.401 03:29:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:00.401 03:29:34 -- common/autotest_common.sh@10 -- # set +x 00:29:00.401 03:29:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:00.401 03:29:34 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:00.401 03:29:34 -- nvmf/common.sh@717 -- # local ip 00:29:00.401 03:29:34 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:00.401 03:29:34 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:00.401 03:29:34 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:00.401 03:29:34 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:00.401 03:29:34 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:00.401 03:29:34 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:00.401 03:29:34 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:00.401 03:29:34 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:00.401 03:29:34 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:00.401 03:29:34 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:29:00.401 03:29:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:00.401 03:29:34 -- common/autotest_common.sh@10 -- # set +x 00:29:00.401 nvme0n1 00:29:00.401 03:29:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:00.401 03:29:34 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:00.401 03:29:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:00.401 03:29:34 -- common/autotest_common.sh@10 -- # set +x 00:29:00.401 03:29:34 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:00.401 03:29:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:00.660 03:29:34 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:00.660 03:29:34 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:00.660 03:29:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:00.660 03:29:34 -- common/autotest_common.sh@10 -- # set +x 00:29:00.660 03:29:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:00.660 03:29:34 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:00.660 03:29:34 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 1 00:29:00.660 03:29:34 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:00.660 03:29:34 -- host/auth.sh@44 -- # digest=sha384 00:29:00.660 03:29:34 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:29:00.660 03:29:34 -- host/auth.sh@44 -- # keyid=1 00:29:00.660 03:29:34 -- host/auth.sh@45 -- # key=DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:29:00.660 03:29:34 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:29:00.660 03:29:34 -- host/auth.sh@48 -- # echo ffdhe2048 00:29:00.660 03:29:34 -- host/auth.sh@49 -- # echo DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:29:00.661 03:29:34 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 1 00:29:00.661 03:29:34 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:00.661 03:29:34 -- host/auth.sh@68 -- # digest=sha384 00:29:00.661 03:29:34 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:29:00.661 03:29:34 -- host/auth.sh@68 -- # keyid=1 00:29:00.661 03:29:34 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:29:00.661 03:29:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:00.661 03:29:34 -- common/autotest_common.sh@10 -- # set +x 00:29:00.661 03:29:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:00.661 03:29:34 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:00.661 03:29:34 -- nvmf/common.sh@717 -- # local ip 00:29:00.661 03:29:34 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:00.661 03:29:34 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:00.661 03:29:34 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:00.661 03:29:34 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:00.661 03:29:34 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:00.661 03:29:34 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:00.661 03:29:34 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:00.661 03:29:34 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:00.661 03:29:34 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:00.661 03:29:34 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:29:00.661 03:29:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:00.661 03:29:34 -- common/autotest_common.sh@10 -- # set +x 00:29:00.661 nvme0n1 00:29:00.661 03:29:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:00.661 03:29:35 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:00.661 03:29:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:00.661 03:29:35 -- common/autotest_common.sh@10 -- # set +x 00:29:00.661 03:29:35 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:00.661 03:29:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:00.661 03:29:35 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:00.661 03:29:35 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:00.661 03:29:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:00.661 03:29:35 -- common/autotest_common.sh@10 -- # set +x 00:29:00.661 03:29:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:00.661 03:29:35 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:00.661 03:29:35 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 2 00:29:00.661 03:29:35 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:00.661 03:29:35 -- host/auth.sh@44 -- # digest=sha384 00:29:00.661 03:29:35 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:29:00.661 03:29:35 -- host/auth.sh@44 -- # keyid=2 00:29:00.661 03:29:35 -- host/auth.sh@45 -- # key=DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:29:00.661 03:29:35 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:29:00.920 03:29:35 -- host/auth.sh@48 -- # echo ffdhe2048 00:29:00.920 03:29:35 -- host/auth.sh@49 -- # echo DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:29:00.920 03:29:35 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 2 00:29:00.920 03:29:35 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:00.920 03:29:35 -- host/auth.sh@68 -- # digest=sha384 00:29:00.920 03:29:35 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:29:00.920 03:29:35 -- host/auth.sh@68 -- # keyid=2 00:29:00.920 03:29:35 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:29:00.920 03:29:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:00.920 03:29:35 -- common/autotest_common.sh@10 -- # set +x 00:29:00.920 03:29:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:00.920 03:29:35 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:00.920 03:29:35 -- nvmf/common.sh@717 -- # local ip 00:29:00.920 03:29:35 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:00.920 03:29:35 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:00.920 03:29:35 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:00.920 03:29:35 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:00.920 03:29:35 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:00.920 03:29:35 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:00.920 03:29:35 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:00.920 03:29:35 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:00.920 03:29:35 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:00.920 03:29:35 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:29:00.920 03:29:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:00.920 03:29:35 -- common/autotest_common.sh@10 -- # set +x 00:29:00.920 nvme0n1 00:29:00.920 03:29:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:00.920 03:29:35 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:00.920 03:29:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:00.920 03:29:35 -- common/autotest_common.sh@10 -- # set +x 00:29:00.920 03:29:35 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:00.920 03:29:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:00.920 03:29:35 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:00.920 03:29:35 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:00.920 03:29:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:00.920 03:29:35 -- common/autotest_common.sh@10 -- # set +x 00:29:00.920 03:29:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:00.920 03:29:35 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:00.920 03:29:35 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 3 00:29:00.920 03:29:35 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:00.920 03:29:35 -- host/auth.sh@44 -- # digest=sha384 00:29:00.920 03:29:35 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:29:00.920 03:29:35 -- host/auth.sh@44 -- # keyid=3 00:29:00.920 03:29:35 -- host/auth.sh@45 -- # key=DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:29:00.920 03:29:35 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:29:00.920 03:29:35 -- host/auth.sh@48 -- # echo ffdhe2048 00:29:00.920 03:29:35 -- host/auth.sh@49 -- # echo DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:29:00.920 03:29:35 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 3 00:29:00.920 03:29:35 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:00.920 03:29:35 -- host/auth.sh@68 -- # digest=sha384 00:29:00.920 03:29:35 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:29:00.920 03:29:35 -- host/auth.sh@68 -- # keyid=3 00:29:00.920 03:29:35 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:29:00.920 03:29:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:00.920 03:29:35 -- common/autotest_common.sh@10 -- # set +x 00:29:00.920 03:29:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:00.920 03:29:35 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:00.920 03:29:35 -- nvmf/common.sh@717 -- # local ip 00:29:00.921 03:29:35 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:00.921 03:29:35 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:00.921 03:29:35 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:00.921 03:29:35 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:00.921 03:29:35 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:00.921 03:29:35 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:00.921 03:29:35 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:00.921 03:29:35 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:00.921 03:29:35 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:00.921 03:29:35 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:29:00.921 03:29:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:00.921 03:29:35 -- common/autotest_common.sh@10 -- # set +x 00:29:01.179 nvme0n1 00:29:01.179 03:29:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:01.179 03:29:35 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:01.179 03:29:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:01.179 03:29:35 -- common/autotest_common.sh@10 -- # set +x 00:29:01.179 03:29:35 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:01.179 03:29:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:01.179 03:29:35 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:01.179 03:29:35 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:01.179 03:29:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:01.179 03:29:35 -- common/autotest_common.sh@10 -- # set +x 00:29:01.179 03:29:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:01.179 03:29:35 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:01.179 03:29:35 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 4 00:29:01.179 03:29:35 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:01.179 03:29:35 -- host/auth.sh@44 -- # digest=sha384 00:29:01.179 03:29:35 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:29:01.179 03:29:35 -- host/auth.sh@44 -- # keyid=4 00:29:01.179 03:29:35 -- host/auth.sh@45 -- # key=DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:29:01.179 03:29:35 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:29:01.179 03:29:35 -- host/auth.sh@48 -- # echo ffdhe2048 00:29:01.179 03:29:35 -- host/auth.sh@49 -- # echo DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:29:01.179 03:29:35 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 4 00:29:01.179 03:29:35 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:01.179 03:29:35 -- host/auth.sh@68 -- # digest=sha384 00:29:01.179 03:29:35 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:29:01.179 03:29:35 -- host/auth.sh@68 -- # keyid=4 00:29:01.179 03:29:35 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:29:01.179 03:29:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:01.179 03:29:35 -- common/autotest_common.sh@10 -- # set +x 00:29:01.179 03:29:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:01.179 03:29:35 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:01.179 03:29:35 -- nvmf/common.sh@717 -- # local ip 00:29:01.179 03:29:35 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:01.179 03:29:35 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:01.179 03:29:35 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:01.179 03:29:35 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:01.179 03:29:35 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:01.179 03:29:35 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:01.179 03:29:35 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:01.179 03:29:35 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:01.179 03:29:35 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:01.179 03:29:35 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:29:01.179 03:29:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:01.179 03:29:35 -- common/autotest_common.sh@10 -- # set +x 00:29:01.438 nvme0n1 00:29:01.438 03:29:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:01.438 03:29:35 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:01.438 03:29:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:01.438 03:29:35 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:01.438 03:29:35 -- common/autotest_common.sh@10 -- # set +x 00:29:01.438 03:29:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:01.438 03:29:35 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:01.438 03:29:35 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:01.438 03:29:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:01.438 03:29:35 -- common/autotest_common.sh@10 -- # set +x 00:29:01.438 03:29:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:01.438 03:29:35 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:29:01.438 03:29:35 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:01.438 03:29:35 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 0 00:29:01.438 03:29:35 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:01.438 03:29:35 -- host/auth.sh@44 -- # digest=sha384 00:29:01.438 03:29:35 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:29:01.438 03:29:35 -- host/auth.sh@44 -- # keyid=0 00:29:01.438 03:29:35 -- host/auth.sh@45 -- # key=DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:29:01.438 03:29:35 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:29:01.438 03:29:35 -- host/auth.sh@48 -- # echo ffdhe3072 00:29:01.438 03:29:35 -- host/auth.sh@49 -- # echo DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:29:01.438 03:29:35 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 0 00:29:01.438 03:29:35 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:01.438 03:29:35 -- host/auth.sh@68 -- # digest=sha384 00:29:01.438 03:29:35 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:29:01.438 03:29:35 -- host/auth.sh@68 -- # keyid=0 00:29:01.438 03:29:35 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:29:01.438 03:29:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:01.438 03:29:35 -- common/autotest_common.sh@10 -- # set +x 00:29:01.438 03:29:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:01.438 03:29:35 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:01.438 03:29:35 -- nvmf/common.sh@717 -- # local ip 00:29:01.438 03:29:35 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:01.438 03:29:35 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:01.438 03:29:35 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:01.438 03:29:35 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:01.438 03:29:35 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:01.438 03:29:35 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:01.438 03:29:35 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:01.438 03:29:35 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:01.438 03:29:35 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:01.438 03:29:35 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:29:01.438 03:29:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:01.438 03:29:35 -- common/autotest_common.sh@10 -- # set +x 00:29:01.697 nvme0n1 00:29:01.697 03:29:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:01.697 03:29:36 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:01.697 03:29:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:01.697 03:29:36 -- common/autotest_common.sh@10 -- # set +x 00:29:01.697 03:29:36 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:01.697 03:29:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:01.697 03:29:36 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:01.697 03:29:36 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:01.697 03:29:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:01.697 03:29:36 -- common/autotest_common.sh@10 -- # set +x 00:29:01.697 03:29:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:01.697 03:29:36 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:01.697 03:29:36 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 1 00:29:01.697 03:29:36 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:01.697 03:29:36 -- host/auth.sh@44 -- # digest=sha384 00:29:01.697 03:29:36 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:29:01.697 03:29:36 -- host/auth.sh@44 -- # keyid=1 00:29:01.697 03:29:36 -- host/auth.sh@45 -- # key=DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:29:01.697 03:29:36 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:29:01.697 03:29:36 -- host/auth.sh@48 -- # echo ffdhe3072 00:29:01.697 03:29:36 -- host/auth.sh@49 -- # echo DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:29:01.697 03:29:36 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 1 00:29:01.697 03:29:36 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:01.697 03:29:36 -- host/auth.sh@68 -- # digest=sha384 00:29:01.697 03:29:36 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:29:01.697 03:29:36 -- host/auth.sh@68 -- # keyid=1 00:29:01.697 03:29:36 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:29:01.697 03:29:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:01.697 03:29:36 -- common/autotest_common.sh@10 -- # set +x 00:29:01.697 03:29:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:01.697 03:29:36 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:01.697 03:29:36 -- nvmf/common.sh@717 -- # local ip 00:29:01.697 03:29:36 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:01.697 03:29:36 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:01.697 03:29:36 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:01.697 03:29:36 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:01.697 03:29:36 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:01.697 03:29:36 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:01.697 03:29:36 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:01.697 03:29:36 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:01.697 03:29:36 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:01.697 03:29:36 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:29:01.697 03:29:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:01.697 03:29:36 -- common/autotest_common.sh@10 -- # set +x 00:29:01.956 nvme0n1 00:29:01.956 03:29:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:01.956 03:29:36 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:01.956 03:29:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:01.956 03:29:36 -- common/autotest_common.sh@10 -- # set +x 00:29:01.956 03:29:36 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:01.956 03:29:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:01.956 03:29:36 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:01.956 03:29:36 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:01.956 03:29:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:01.956 03:29:36 -- common/autotest_common.sh@10 -- # set +x 00:29:01.956 03:29:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:01.956 03:29:36 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:01.956 03:29:36 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 2 00:29:01.956 03:29:36 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:01.956 03:29:36 -- host/auth.sh@44 -- # digest=sha384 00:29:01.956 03:29:36 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:29:01.956 03:29:36 -- host/auth.sh@44 -- # keyid=2 00:29:01.956 03:29:36 -- host/auth.sh@45 -- # key=DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:29:01.956 03:29:36 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:29:01.956 03:29:36 -- host/auth.sh@48 -- # echo ffdhe3072 00:29:01.956 03:29:36 -- host/auth.sh@49 -- # echo DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:29:01.956 03:29:36 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 2 00:29:01.956 03:29:36 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:01.956 03:29:36 -- host/auth.sh@68 -- # digest=sha384 00:29:01.956 03:29:36 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:29:01.956 03:29:36 -- host/auth.sh@68 -- # keyid=2 00:29:01.956 03:29:36 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:29:01.956 03:29:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:01.956 03:29:36 -- common/autotest_common.sh@10 -- # set +x 00:29:01.956 03:29:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:01.956 03:29:36 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:01.956 03:29:36 -- nvmf/common.sh@717 -- # local ip 00:29:01.956 03:29:36 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:01.956 03:29:36 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:01.956 03:29:36 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:01.956 03:29:36 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:01.956 03:29:36 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:01.956 03:29:36 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:01.956 03:29:36 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:01.956 03:29:36 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:01.956 03:29:36 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:01.956 03:29:36 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:29:01.956 03:29:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:01.956 03:29:36 -- common/autotest_common.sh@10 -- # set +x 00:29:02.215 nvme0n1 00:29:02.215 03:29:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:02.215 03:29:36 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:02.215 03:29:36 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:02.215 03:29:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:02.215 03:29:36 -- common/autotest_common.sh@10 -- # set +x 00:29:02.215 03:29:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:02.215 03:29:36 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:02.215 03:29:36 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:02.215 03:29:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:02.215 03:29:36 -- common/autotest_common.sh@10 -- # set +x 00:29:02.215 03:29:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:02.215 03:29:36 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:02.215 03:29:36 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 3 00:29:02.215 03:29:36 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:02.215 03:29:36 -- host/auth.sh@44 -- # digest=sha384 00:29:02.215 03:29:36 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:29:02.215 03:29:36 -- host/auth.sh@44 -- # keyid=3 00:29:02.215 03:29:36 -- host/auth.sh@45 -- # key=DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:29:02.215 03:29:36 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:29:02.215 03:29:36 -- host/auth.sh@48 -- # echo ffdhe3072 00:29:02.215 03:29:36 -- host/auth.sh@49 -- # echo DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:29:02.215 03:29:36 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 3 00:29:02.215 03:29:36 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:02.215 03:29:36 -- host/auth.sh@68 -- # digest=sha384 00:29:02.215 03:29:36 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:29:02.215 03:29:36 -- host/auth.sh@68 -- # keyid=3 00:29:02.215 03:29:36 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:29:02.215 03:29:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:02.215 03:29:36 -- common/autotest_common.sh@10 -- # set +x 00:29:02.215 03:29:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:02.215 03:29:36 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:02.215 03:29:36 -- nvmf/common.sh@717 -- # local ip 00:29:02.215 03:29:36 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:02.215 03:29:36 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:02.215 03:29:36 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:02.215 03:29:36 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:02.215 03:29:36 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:02.215 03:29:36 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:02.215 03:29:36 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:02.215 03:29:36 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:02.215 03:29:36 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:02.215 03:29:36 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:29:02.215 03:29:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:02.215 03:29:36 -- common/autotest_common.sh@10 -- # set +x 00:29:02.474 nvme0n1 00:29:02.474 03:29:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:02.474 03:29:36 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:02.474 03:29:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:02.474 03:29:36 -- common/autotest_common.sh@10 -- # set +x 00:29:02.474 03:29:36 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:02.474 03:29:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:02.474 03:29:36 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:02.474 03:29:36 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:02.474 03:29:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:02.474 03:29:36 -- common/autotest_common.sh@10 -- # set +x 00:29:02.474 03:29:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:02.474 03:29:36 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:02.474 03:29:36 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 4 00:29:02.474 03:29:36 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:02.474 03:29:36 -- host/auth.sh@44 -- # digest=sha384 00:29:02.474 03:29:36 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:29:02.474 03:29:36 -- host/auth.sh@44 -- # keyid=4 00:29:02.474 03:29:36 -- host/auth.sh@45 -- # key=DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:29:02.474 03:29:36 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:29:02.474 03:29:36 -- host/auth.sh@48 -- # echo ffdhe3072 00:29:02.474 03:29:36 -- host/auth.sh@49 -- # echo DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:29:02.474 03:29:36 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 4 00:29:02.474 03:29:36 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:02.474 03:29:36 -- host/auth.sh@68 -- # digest=sha384 00:29:02.474 03:29:36 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:29:02.474 03:29:36 -- host/auth.sh@68 -- # keyid=4 00:29:02.474 03:29:36 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:29:02.475 03:29:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:02.475 03:29:36 -- common/autotest_common.sh@10 -- # set +x 00:29:02.475 03:29:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:02.475 03:29:36 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:02.475 03:29:36 -- nvmf/common.sh@717 -- # local ip 00:29:02.475 03:29:36 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:02.475 03:29:36 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:02.475 03:29:36 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:02.475 03:29:36 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:02.475 03:29:36 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:02.475 03:29:36 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:02.475 03:29:36 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:02.475 03:29:36 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:02.475 03:29:36 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:02.475 03:29:36 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:29:02.475 03:29:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:02.475 03:29:36 -- common/autotest_common.sh@10 -- # set +x 00:29:02.734 nvme0n1 00:29:02.734 03:29:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:02.734 03:29:37 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:02.734 03:29:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:02.734 03:29:37 -- common/autotest_common.sh@10 -- # set +x 00:29:02.734 03:29:37 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:02.734 03:29:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:02.735 03:29:37 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:02.735 03:29:37 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:02.735 03:29:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:02.735 03:29:37 -- common/autotest_common.sh@10 -- # set +x 00:29:02.735 03:29:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:02.735 03:29:37 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:29:02.735 03:29:37 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:02.735 03:29:37 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 0 00:29:02.735 03:29:37 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:02.735 03:29:37 -- host/auth.sh@44 -- # digest=sha384 00:29:02.735 03:29:37 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:29:02.735 03:29:37 -- host/auth.sh@44 -- # keyid=0 00:29:02.735 03:29:37 -- host/auth.sh@45 -- # key=DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:29:02.735 03:29:37 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:29:02.735 03:29:37 -- host/auth.sh@48 -- # echo ffdhe4096 00:29:02.735 03:29:37 -- host/auth.sh@49 -- # echo DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:29:02.735 03:29:37 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 0 00:29:02.735 03:29:37 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:02.735 03:29:37 -- host/auth.sh@68 -- # digest=sha384 00:29:02.735 03:29:37 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:29:02.735 03:29:37 -- host/auth.sh@68 -- # keyid=0 00:29:02.735 03:29:37 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:29:02.735 03:29:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:02.735 03:29:37 -- common/autotest_common.sh@10 -- # set +x 00:29:02.735 03:29:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:02.735 03:29:37 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:02.735 03:29:37 -- nvmf/common.sh@717 -- # local ip 00:29:02.735 03:29:37 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:02.735 03:29:37 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:02.735 03:29:37 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:02.735 03:29:37 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:02.735 03:29:37 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:02.735 03:29:37 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:02.735 03:29:37 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:02.735 03:29:37 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:02.735 03:29:37 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:02.735 03:29:37 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:29:02.735 03:29:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:02.735 03:29:37 -- common/autotest_common.sh@10 -- # set +x 00:29:02.994 nvme0n1 00:29:02.994 03:29:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:02.994 03:29:37 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:02.994 03:29:37 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:02.994 03:29:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:02.994 03:29:37 -- common/autotest_common.sh@10 -- # set +x 00:29:02.994 03:29:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:02.994 03:29:37 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:02.994 03:29:37 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:02.994 03:29:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:02.994 03:29:37 -- common/autotest_common.sh@10 -- # set +x 00:29:02.994 03:29:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:02.994 03:29:37 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:02.994 03:29:37 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 1 00:29:02.994 03:29:37 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:02.994 03:29:37 -- host/auth.sh@44 -- # digest=sha384 00:29:02.994 03:29:37 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:29:02.994 03:29:37 -- host/auth.sh@44 -- # keyid=1 00:29:02.994 03:29:37 -- host/auth.sh@45 -- # key=DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:29:02.994 03:29:37 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:29:02.994 03:29:37 -- host/auth.sh@48 -- # echo ffdhe4096 00:29:02.994 03:29:37 -- host/auth.sh@49 -- # echo DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:29:02.994 03:29:37 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 1 00:29:02.994 03:29:37 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:02.994 03:29:37 -- host/auth.sh@68 -- # digest=sha384 00:29:02.994 03:29:37 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:29:02.994 03:29:37 -- host/auth.sh@68 -- # keyid=1 00:29:02.994 03:29:37 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:29:02.994 03:29:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:02.994 03:29:37 -- common/autotest_common.sh@10 -- # set +x 00:29:03.253 03:29:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:03.253 03:29:37 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:03.253 03:29:37 -- nvmf/common.sh@717 -- # local ip 00:29:03.253 03:29:37 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:03.253 03:29:37 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:03.253 03:29:37 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:03.253 03:29:37 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:03.253 03:29:37 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:03.253 03:29:37 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:03.253 03:29:37 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:03.253 03:29:37 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:03.253 03:29:37 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:03.253 03:29:37 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:29:03.253 03:29:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:03.253 03:29:37 -- common/autotest_common.sh@10 -- # set +x 00:29:03.253 nvme0n1 00:29:03.253 03:29:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:03.512 03:29:37 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:03.512 03:29:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:03.512 03:29:37 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:03.512 03:29:37 -- common/autotest_common.sh@10 -- # set +x 00:29:03.512 03:29:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:03.512 03:29:37 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:03.512 03:29:37 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:03.512 03:29:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:03.512 03:29:37 -- common/autotest_common.sh@10 -- # set +x 00:29:03.512 03:29:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:03.512 03:29:37 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:03.512 03:29:37 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 2 00:29:03.512 03:29:37 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:03.512 03:29:37 -- host/auth.sh@44 -- # digest=sha384 00:29:03.512 03:29:37 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:29:03.512 03:29:37 -- host/auth.sh@44 -- # keyid=2 00:29:03.512 03:29:37 -- host/auth.sh@45 -- # key=DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:29:03.512 03:29:37 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:29:03.512 03:29:37 -- host/auth.sh@48 -- # echo ffdhe4096 00:29:03.512 03:29:37 -- host/auth.sh@49 -- # echo DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:29:03.512 03:29:37 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 2 00:29:03.512 03:29:37 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:03.512 03:29:37 -- host/auth.sh@68 -- # digest=sha384 00:29:03.512 03:29:37 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:29:03.512 03:29:37 -- host/auth.sh@68 -- # keyid=2 00:29:03.512 03:29:37 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:29:03.512 03:29:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:03.512 03:29:37 -- common/autotest_common.sh@10 -- # set +x 00:29:03.512 03:29:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:03.512 03:29:37 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:03.512 03:29:37 -- nvmf/common.sh@717 -- # local ip 00:29:03.512 03:29:37 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:03.513 03:29:37 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:03.513 03:29:37 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:03.513 03:29:37 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:03.513 03:29:37 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:03.513 03:29:37 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:03.513 03:29:37 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:03.513 03:29:37 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:03.513 03:29:37 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:03.513 03:29:37 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:29:03.513 03:29:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:03.513 03:29:37 -- common/autotest_common.sh@10 -- # set +x 00:29:03.772 nvme0n1 00:29:03.772 03:29:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:03.772 03:29:38 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:03.772 03:29:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:03.772 03:29:38 -- common/autotest_common.sh@10 -- # set +x 00:29:03.772 03:29:38 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:03.772 03:29:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:03.772 03:29:38 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:03.772 03:29:38 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:03.772 03:29:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:03.772 03:29:38 -- common/autotest_common.sh@10 -- # set +x 00:29:03.772 03:29:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:03.772 03:29:38 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:03.772 03:29:38 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 3 00:29:03.772 03:29:38 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:03.772 03:29:38 -- host/auth.sh@44 -- # digest=sha384 00:29:03.772 03:29:38 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:29:03.772 03:29:38 -- host/auth.sh@44 -- # keyid=3 00:29:03.772 03:29:38 -- host/auth.sh@45 -- # key=DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:29:03.772 03:29:38 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:29:03.772 03:29:38 -- host/auth.sh@48 -- # echo ffdhe4096 00:29:03.772 03:29:38 -- host/auth.sh@49 -- # echo DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:29:03.772 03:29:38 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 3 00:29:03.772 03:29:38 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:03.772 03:29:38 -- host/auth.sh@68 -- # digest=sha384 00:29:03.772 03:29:38 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:29:03.772 03:29:38 -- host/auth.sh@68 -- # keyid=3 00:29:03.772 03:29:38 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:29:03.772 03:29:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:03.772 03:29:38 -- common/autotest_common.sh@10 -- # set +x 00:29:03.772 03:29:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:03.772 03:29:38 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:03.772 03:29:38 -- nvmf/common.sh@717 -- # local ip 00:29:03.772 03:29:38 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:03.772 03:29:38 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:03.772 03:29:38 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:03.772 03:29:38 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:03.772 03:29:38 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:03.772 03:29:38 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:03.772 03:29:38 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:03.772 03:29:38 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:03.772 03:29:38 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:03.772 03:29:38 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:29:03.772 03:29:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:03.772 03:29:38 -- common/autotest_common.sh@10 -- # set +x 00:29:04.031 nvme0n1 00:29:04.031 03:29:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:04.031 03:29:38 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:04.031 03:29:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:04.031 03:29:38 -- common/autotest_common.sh@10 -- # set +x 00:29:04.031 03:29:38 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:04.031 03:29:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:04.031 03:29:38 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:04.031 03:29:38 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:04.031 03:29:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:04.031 03:29:38 -- common/autotest_common.sh@10 -- # set +x 00:29:04.031 03:29:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:04.031 03:29:38 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:04.031 03:29:38 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 4 00:29:04.031 03:29:38 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:04.031 03:29:38 -- host/auth.sh@44 -- # digest=sha384 00:29:04.031 03:29:38 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:29:04.031 03:29:38 -- host/auth.sh@44 -- # keyid=4 00:29:04.031 03:29:38 -- host/auth.sh@45 -- # key=DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:29:04.031 03:29:38 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:29:04.031 03:29:38 -- host/auth.sh@48 -- # echo ffdhe4096 00:29:04.031 03:29:38 -- host/auth.sh@49 -- # echo DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:29:04.031 03:29:38 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 4 00:29:04.031 03:29:38 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:04.031 03:29:38 -- host/auth.sh@68 -- # digest=sha384 00:29:04.031 03:29:38 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:29:04.031 03:29:38 -- host/auth.sh@68 -- # keyid=4 00:29:04.031 03:29:38 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:29:04.031 03:29:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:04.031 03:29:38 -- common/autotest_common.sh@10 -- # set +x 00:29:04.031 03:29:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:04.031 03:29:38 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:04.031 03:29:38 -- nvmf/common.sh@717 -- # local ip 00:29:04.031 03:29:38 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:04.031 03:29:38 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:04.031 03:29:38 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:04.031 03:29:38 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:04.031 03:29:38 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:04.031 03:29:38 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:04.032 03:29:38 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:04.032 03:29:38 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:04.032 03:29:38 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:04.032 03:29:38 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:29:04.032 03:29:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:04.032 03:29:38 -- common/autotest_common.sh@10 -- # set +x 00:29:04.291 nvme0n1 00:29:04.291 03:29:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:04.291 03:29:38 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:04.291 03:29:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:04.291 03:29:38 -- common/autotest_common.sh@10 -- # set +x 00:29:04.291 03:29:38 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:04.291 03:29:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:04.291 03:29:38 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:04.291 03:29:38 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:04.291 03:29:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:04.291 03:29:38 -- common/autotest_common.sh@10 -- # set +x 00:29:04.291 03:29:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:04.291 03:29:38 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:29:04.291 03:29:38 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:04.291 03:29:38 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 0 00:29:04.291 03:29:38 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:04.291 03:29:38 -- host/auth.sh@44 -- # digest=sha384 00:29:04.291 03:29:38 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:29:04.291 03:29:38 -- host/auth.sh@44 -- # keyid=0 00:29:04.291 03:29:38 -- host/auth.sh@45 -- # key=DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:29:04.291 03:29:38 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:29:04.291 03:29:38 -- host/auth.sh@48 -- # echo ffdhe6144 00:29:04.291 03:29:38 -- host/auth.sh@49 -- # echo DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:29:04.291 03:29:38 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 0 00:29:04.291 03:29:38 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:04.291 03:29:38 -- host/auth.sh@68 -- # digest=sha384 00:29:04.291 03:29:38 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:29:04.291 03:29:38 -- host/auth.sh@68 -- # keyid=0 00:29:04.291 03:29:38 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:29:04.291 03:29:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:04.291 03:29:38 -- common/autotest_common.sh@10 -- # set +x 00:29:04.291 03:29:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:04.550 03:29:38 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:04.550 03:29:38 -- nvmf/common.sh@717 -- # local ip 00:29:04.550 03:29:38 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:04.550 03:29:38 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:04.550 03:29:38 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:04.550 03:29:38 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:04.550 03:29:38 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:04.550 03:29:38 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:04.550 03:29:38 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:04.550 03:29:38 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:04.550 03:29:38 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:04.550 03:29:38 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:29:04.550 03:29:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:04.550 03:29:38 -- common/autotest_common.sh@10 -- # set +x 00:29:04.809 nvme0n1 00:29:04.809 03:29:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:04.809 03:29:39 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:04.809 03:29:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:04.809 03:29:39 -- common/autotest_common.sh@10 -- # set +x 00:29:04.809 03:29:39 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:04.809 03:29:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:04.809 03:29:39 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:04.809 03:29:39 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:04.809 03:29:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:04.809 03:29:39 -- common/autotest_common.sh@10 -- # set +x 00:29:04.809 03:29:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:04.809 03:29:39 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:04.809 03:29:39 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 1 00:29:04.809 03:29:39 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:04.809 03:29:39 -- host/auth.sh@44 -- # digest=sha384 00:29:04.809 03:29:39 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:29:04.809 03:29:39 -- host/auth.sh@44 -- # keyid=1 00:29:04.809 03:29:39 -- host/auth.sh@45 -- # key=DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:29:04.809 03:29:39 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:29:04.809 03:29:39 -- host/auth.sh@48 -- # echo ffdhe6144 00:29:04.809 03:29:39 -- host/auth.sh@49 -- # echo DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:29:04.809 03:29:39 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 1 00:29:04.809 03:29:39 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:04.809 03:29:39 -- host/auth.sh@68 -- # digest=sha384 00:29:04.809 03:29:39 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:29:04.809 03:29:39 -- host/auth.sh@68 -- # keyid=1 00:29:04.809 03:29:39 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:29:04.809 03:29:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:04.809 03:29:39 -- common/autotest_common.sh@10 -- # set +x 00:29:04.809 03:29:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:04.809 03:29:39 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:04.809 03:29:39 -- nvmf/common.sh@717 -- # local ip 00:29:04.809 03:29:39 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:04.809 03:29:39 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:04.809 03:29:39 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:04.809 03:29:39 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:04.809 03:29:39 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:04.809 03:29:39 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:04.809 03:29:39 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:04.809 03:29:39 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:04.809 03:29:39 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:04.809 03:29:39 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:29:04.809 03:29:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:04.809 03:29:39 -- common/autotest_common.sh@10 -- # set +x 00:29:05.425 nvme0n1 00:29:05.425 03:29:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:05.425 03:29:39 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:05.425 03:29:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:05.425 03:29:39 -- common/autotest_common.sh@10 -- # set +x 00:29:05.425 03:29:39 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:05.425 03:29:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:05.425 03:29:39 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:05.425 03:29:39 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:05.425 03:29:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:05.425 03:29:39 -- common/autotest_common.sh@10 -- # set +x 00:29:05.425 03:29:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:05.425 03:29:39 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:05.425 03:29:39 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 2 00:29:05.425 03:29:39 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:05.425 03:29:39 -- host/auth.sh@44 -- # digest=sha384 00:29:05.425 03:29:39 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:29:05.425 03:29:39 -- host/auth.sh@44 -- # keyid=2 00:29:05.425 03:29:39 -- host/auth.sh@45 -- # key=DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:29:05.425 03:29:39 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:29:05.425 03:29:39 -- host/auth.sh@48 -- # echo ffdhe6144 00:29:05.425 03:29:39 -- host/auth.sh@49 -- # echo DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:29:05.425 03:29:39 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 2 00:29:05.425 03:29:39 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:05.425 03:29:39 -- host/auth.sh@68 -- # digest=sha384 00:29:05.425 03:29:39 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:29:05.425 03:29:39 -- host/auth.sh@68 -- # keyid=2 00:29:05.425 03:29:39 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:29:05.425 03:29:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:05.425 03:29:39 -- common/autotest_common.sh@10 -- # set +x 00:29:05.425 03:29:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:05.425 03:29:39 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:05.425 03:29:39 -- nvmf/common.sh@717 -- # local ip 00:29:05.425 03:29:39 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:05.425 03:29:39 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:05.425 03:29:39 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:05.425 03:29:39 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:05.425 03:29:39 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:05.425 03:29:39 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:05.425 03:29:39 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:05.425 03:29:39 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:05.425 03:29:39 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:05.425 03:29:39 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:29:05.425 03:29:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:05.425 03:29:39 -- common/autotest_common.sh@10 -- # set +x 00:29:05.685 nvme0n1 00:29:05.685 03:29:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:05.685 03:29:40 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:05.685 03:29:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:05.685 03:29:40 -- common/autotest_common.sh@10 -- # set +x 00:29:05.685 03:29:40 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:05.685 03:29:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:05.685 03:29:40 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:05.685 03:29:40 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:05.685 03:29:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:05.685 03:29:40 -- common/autotest_common.sh@10 -- # set +x 00:29:05.685 03:29:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:05.685 03:29:40 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:05.685 03:29:40 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 3 00:29:05.685 03:29:40 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:05.685 03:29:40 -- host/auth.sh@44 -- # digest=sha384 00:29:05.685 03:29:40 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:29:05.685 03:29:40 -- host/auth.sh@44 -- # keyid=3 00:29:05.685 03:29:40 -- host/auth.sh@45 -- # key=DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:29:05.685 03:29:40 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:29:05.685 03:29:40 -- host/auth.sh@48 -- # echo ffdhe6144 00:29:05.685 03:29:40 -- host/auth.sh@49 -- # echo DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:29:05.685 03:29:40 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 3 00:29:05.685 03:29:40 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:05.685 03:29:40 -- host/auth.sh@68 -- # digest=sha384 00:29:05.685 03:29:40 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:29:05.685 03:29:40 -- host/auth.sh@68 -- # keyid=3 00:29:05.685 03:29:40 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:29:05.685 03:29:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:05.685 03:29:40 -- common/autotest_common.sh@10 -- # set +x 00:29:05.685 03:29:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:05.685 03:29:40 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:05.685 03:29:40 -- nvmf/common.sh@717 -- # local ip 00:29:05.685 03:29:40 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:05.685 03:29:40 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:05.685 03:29:40 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:05.685 03:29:40 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:05.685 03:29:40 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:05.685 03:29:40 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:05.685 03:29:40 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:05.685 03:29:40 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:05.685 03:29:40 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:05.685 03:29:40 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:29:05.685 03:29:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:05.685 03:29:40 -- common/autotest_common.sh@10 -- # set +x 00:29:06.252 nvme0n1 00:29:06.252 03:29:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:06.252 03:29:40 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:06.252 03:29:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:06.252 03:29:40 -- common/autotest_common.sh@10 -- # set +x 00:29:06.252 03:29:40 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:06.252 03:29:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:06.252 03:29:40 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:06.252 03:29:40 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:06.252 03:29:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:06.252 03:29:40 -- common/autotest_common.sh@10 -- # set +x 00:29:06.252 03:29:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:06.252 03:29:40 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:06.252 03:29:40 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 4 00:29:06.252 03:29:40 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:06.252 03:29:40 -- host/auth.sh@44 -- # digest=sha384 00:29:06.252 03:29:40 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:29:06.252 03:29:40 -- host/auth.sh@44 -- # keyid=4 00:29:06.252 03:29:40 -- host/auth.sh@45 -- # key=DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:29:06.252 03:29:40 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:29:06.252 03:29:40 -- host/auth.sh@48 -- # echo ffdhe6144 00:29:06.252 03:29:40 -- host/auth.sh@49 -- # echo DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:29:06.252 03:29:40 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 4 00:29:06.252 03:29:40 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:06.252 03:29:40 -- host/auth.sh@68 -- # digest=sha384 00:29:06.252 03:29:40 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:29:06.252 03:29:40 -- host/auth.sh@68 -- # keyid=4 00:29:06.252 03:29:40 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:29:06.252 03:29:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:06.252 03:29:40 -- common/autotest_common.sh@10 -- # set +x 00:29:06.252 03:29:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:06.252 03:29:40 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:06.252 03:29:40 -- nvmf/common.sh@717 -- # local ip 00:29:06.252 03:29:40 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:06.252 03:29:40 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:06.252 03:29:40 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:06.252 03:29:40 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:06.252 03:29:40 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:06.252 03:29:40 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:06.252 03:29:40 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:06.252 03:29:40 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:06.252 03:29:40 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:06.252 03:29:40 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:29:06.252 03:29:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:06.252 03:29:40 -- common/autotest_common.sh@10 -- # set +x 00:29:06.510 nvme0n1 00:29:06.510 03:29:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:06.510 03:29:40 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:06.510 03:29:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:06.510 03:29:40 -- common/autotest_common.sh@10 -- # set +x 00:29:06.510 03:29:40 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:06.510 03:29:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:06.768 03:29:41 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:06.768 03:29:41 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:06.768 03:29:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:06.768 03:29:41 -- common/autotest_common.sh@10 -- # set +x 00:29:06.768 03:29:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:06.768 03:29:41 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:29:06.768 03:29:41 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:06.768 03:29:41 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 0 00:29:06.768 03:29:41 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:06.768 03:29:41 -- host/auth.sh@44 -- # digest=sha384 00:29:06.768 03:29:41 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:29:06.768 03:29:41 -- host/auth.sh@44 -- # keyid=0 00:29:06.768 03:29:41 -- host/auth.sh@45 -- # key=DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:29:06.768 03:29:41 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:29:06.768 03:29:41 -- host/auth.sh@48 -- # echo ffdhe8192 00:29:06.768 03:29:41 -- host/auth.sh@49 -- # echo DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:29:06.768 03:29:41 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 0 00:29:06.768 03:29:41 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:06.768 03:29:41 -- host/auth.sh@68 -- # digest=sha384 00:29:06.768 03:29:41 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:29:06.768 03:29:41 -- host/auth.sh@68 -- # keyid=0 00:29:06.768 03:29:41 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:29:06.768 03:29:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:06.768 03:29:41 -- common/autotest_common.sh@10 -- # set +x 00:29:06.768 03:29:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:06.768 03:29:41 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:06.768 03:29:41 -- nvmf/common.sh@717 -- # local ip 00:29:06.768 03:29:41 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:06.768 03:29:41 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:06.768 03:29:41 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:06.768 03:29:41 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:06.768 03:29:41 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:06.768 03:29:41 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:06.768 03:29:41 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:06.768 03:29:41 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:06.768 03:29:41 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:06.769 03:29:41 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:29:06.769 03:29:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:06.769 03:29:41 -- common/autotest_common.sh@10 -- # set +x 00:29:07.336 nvme0n1 00:29:07.336 03:29:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:07.336 03:29:41 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:07.336 03:29:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:07.336 03:29:41 -- common/autotest_common.sh@10 -- # set +x 00:29:07.336 03:29:41 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:07.336 03:29:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:07.336 03:29:41 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:07.336 03:29:41 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:07.336 03:29:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:07.336 03:29:41 -- common/autotest_common.sh@10 -- # set +x 00:29:07.336 03:29:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:07.336 03:29:41 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:07.336 03:29:41 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 1 00:29:07.336 03:29:41 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:07.336 03:29:41 -- host/auth.sh@44 -- # digest=sha384 00:29:07.337 03:29:41 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:29:07.337 03:29:41 -- host/auth.sh@44 -- # keyid=1 00:29:07.337 03:29:41 -- host/auth.sh@45 -- # key=DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:29:07.337 03:29:41 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:29:07.337 03:29:41 -- host/auth.sh@48 -- # echo ffdhe8192 00:29:07.337 03:29:41 -- host/auth.sh@49 -- # echo DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:29:07.337 03:29:41 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 1 00:29:07.337 03:29:41 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:07.337 03:29:41 -- host/auth.sh@68 -- # digest=sha384 00:29:07.337 03:29:41 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:29:07.337 03:29:41 -- host/auth.sh@68 -- # keyid=1 00:29:07.337 03:29:41 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:29:07.337 03:29:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:07.337 03:29:41 -- common/autotest_common.sh@10 -- # set +x 00:29:07.337 03:29:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:07.337 03:29:41 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:07.337 03:29:41 -- nvmf/common.sh@717 -- # local ip 00:29:07.337 03:29:41 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:07.337 03:29:41 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:07.337 03:29:41 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:07.337 03:29:41 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:07.337 03:29:41 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:07.337 03:29:41 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:07.337 03:29:41 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:07.337 03:29:41 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:07.337 03:29:41 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:07.337 03:29:41 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:29:07.337 03:29:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:07.337 03:29:41 -- common/autotest_common.sh@10 -- # set +x 00:29:07.905 nvme0n1 00:29:07.905 03:29:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:07.905 03:29:42 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:07.905 03:29:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:07.905 03:29:42 -- common/autotest_common.sh@10 -- # set +x 00:29:07.905 03:29:42 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:07.905 03:29:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:07.905 03:29:42 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:07.905 03:29:42 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:07.905 03:29:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:07.905 03:29:42 -- common/autotest_common.sh@10 -- # set +x 00:29:07.905 03:29:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:07.905 03:29:42 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:07.905 03:29:42 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 2 00:29:07.905 03:29:42 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:07.905 03:29:42 -- host/auth.sh@44 -- # digest=sha384 00:29:07.905 03:29:42 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:29:07.905 03:29:42 -- host/auth.sh@44 -- # keyid=2 00:29:07.905 03:29:42 -- host/auth.sh@45 -- # key=DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:29:07.905 03:29:42 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:29:07.905 03:29:42 -- host/auth.sh@48 -- # echo ffdhe8192 00:29:07.905 03:29:42 -- host/auth.sh@49 -- # echo DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:29:07.905 03:29:42 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 2 00:29:07.905 03:29:42 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:07.905 03:29:42 -- host/auth.sh@68 -- # digest=sha384 00:29:07.905 03:29:42 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:29:07.905 03:29:42 -- host/auth.sh@68 -- # keyid=2 00:29:07.905 03:29:42 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:29:07.905 03:29:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:07.905 03:29:42 -- common/autotest_common.sh@10 -- # set +x 00:29:07.905 03:29:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:07.905 03:29:42 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:07.905 03:29:42 -- nvmf/common.sh@717 -- # local ip 00:29:07.905 03:29:42 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:07.905 03:29:42 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:07.905 03:29:42 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:07.905 03:29:42 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:07.905 03:29:42 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:07.905 03:29:42 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:07.905 03:29:42 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:07.905 03:29:42 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:07.905 03:29:42 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:07.905 03:29:42 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:29:07.905 03:29:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:07.905 03:29:42 -- common/autotest_common.sh@10 -- # set +x 00:29:08.472 nvme0n1 00:29:08.472 03:29:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:08.472 03:29:42 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:08.472 03:29:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:08.472 03:29:42 -- common/autotest_common.sh@10 -- # set +x 00:29:08.472 03:29:42 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:08.472 03:29:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:08.472 03:29:42 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:08.472 03:29:42 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:08.472 03:29:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:08.472 03:29:42 -- common/autotest_common.sh@10 -- # set +x 00:29:08.472 03:29:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:08.472 03:29:42 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:08.472 03:29:42 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 3 00:29:08.472 03:29:42 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:08.472 03:29:42 -- host/auth.sh@44 -- # digest=sha384 00:29:08.472 03:29:42 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:29:08.472 03:29:42 -- host/auth.sh@44 -- # keyid=3 00:29:08.472 03:29:42 -- host/auth.sh@45 -- # key=DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:29:08.472 03:29:42 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:29:08.472 03:29:42 -- host/auth.sh@48 -- # echo ffdhe8192 00:29:08.472 03:29:42 -- host/auth.sh@49 -- # echo DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:29:08.472 03:29:42 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 3 00:29:08.472 03:29:42 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:08.472 03:29:42 -- host/auth.sh@68 -- # digest=sha384 00:29:08.472 03:29:42 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:29:08.472 03:29:42 -- host/auth.sh@68 -- # keyid=3 00:29:08.472 03:29:42 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:29:08.472 03:29:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:08.472 03:29:42 -- common/autotest_common.sh@10 -- # set +x 00:29:08.472 03:29:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:08.472 03:29:42 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:08.472 03:29:42 -- nvmf/common.sh@717 -- # local ip 00:29:08.472 03:29:42 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:08.472 03:29:42 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:08.472 03:29:42 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:08.472 03:29:42 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:08.472 03:29:42 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:08.472 03:29:42 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:08.472 03:29:42 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:08.472 03:29:42 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:08.472 03:29:42 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:08.472 03:29:42 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:29:08.472 03:29:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:08.472 03:29:42 -- common/autotest_common.sh@10 -- # set +x 00:29:09.038 nvme0n1 00:29:09.038 03:29:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:09.038 03:29:43 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:09.038 03:29:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:09.038 03:29:43 -- common/autotest_common.sh@10 -- # set +x 00:29:09.038 03:29:43 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:09.038 03:29:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:09.297 03:29:43 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:09.297 03:29:43 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:09.297 03:29:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:09.297 03:29:43 -- common/autotest_common.sh@10 -- # set +x 00:29:09.297 03:29:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:09.297 03:29:43 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:09.297 03:29:43 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 4 00:29:09.297 03:29:43 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:09.297 03:29:43 -- host/auth.sh@44 -- # digest=sha384 00:29:09.297 03:29:43 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:29:09.297 03:29:43 -- host/auth.sh@44 -- # keyid=4 00:29:09.297 03:29:43 -- host/auth.sh@45 -- # key=DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:29:09.297 03:29:43 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:29:09.297 03:29:43 -- host/auth.sh@48 -- # echo ffdhe8192 00:29:09.297 03:29:43 -- host/auth.sh@49 -- # echo DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:29:09.297 03:29:43 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 4 00:29:09.297 03:29:43 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:09.297 03:29:43 -- host/auth.sh@68 -- # digest=sha384 00:29:09.297 03:29:43 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:29:09.297 03:29:43 -- host/auth.sh@68 -- # keyid=4 00:29:09.297 03:29:43 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:29:09.297 03:29:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:09.297 03:29:43 -- common/autotest_common.sh@10 -- # set +x 00:29:09.297 03:29:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:09.297 03:29:43 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:09.297 03:29:43 -- nvmf/common.sh@717 -- # local ip 00:29:09.297 03:29:43 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:09.297 03:29:43 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:09.297 03:29:43 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:09.297 03:29:43 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:09.297 03:29:43 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:09.297 03:29:43 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:09.297 03:29:43 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:09.297 03:29:43 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:09.297 03:29:43 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:09.297 03:29:43 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:29:09.297 03:29:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:09.297 03:29:43 -- common/autotest_common.sh@10 -- # set +x 00:29:09.865 nvme0n1 00:29:09.865 03:29:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:09.865 03:29:44 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:09.865 03:29:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:09.865 03:29:44 -- common/autotest_common.sh@10 -- # set +x 00:29:09.865 03:29:44 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:09.865 03:29:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:09.865 03:29:44 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:09.865 03:29:44 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:09.865 03:29:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:09.865 03:29:44 -- common/autotest_common.sh@10 -- # set +x 00:29:09.865 03:29:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:09.865 03:29:44 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:29:09.865 03:29:44 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:29:09.865 03:29:44 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:09.865 03:29:44 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 0 00:29:09.865 03:29:44 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:09.865 03:29:44 -- host/auth.sh@44 -- # digest=sha512 00:29:09.865 03:29:44 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:29:09.865 03:29:44 -- host/auth.sh@44 -- # keyid=0 00:29:09.865 03:29:44 -- host/auth.sh@45 -- # key=DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:29:09.865 03:29:44 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:09.865 03:29:44 -- host/auth.sh@48 -- # echo ffdhe2048 00:29:09.865 03:29:44 -- host/auth.sh@49 -- # echo DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:29:09.865 03:29:44 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 0 00:29:09.865 03:29:44 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:09.865 03:29:44 -- host/auth.sh@68 -- # digest=sha512 00:29:09.865 03:29:44 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:29:09.865 03:29:44 -- host/auth.sh@68 -- # keyid=0 00:29:09.865 03:29:44 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:29:09.865 03:29:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:09.865 03:29:44 -- common/autotest_common.sh@10 -- # set +x 00:29:09.865 03:29:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:09.865 03:29:44 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:09.865 03:29:44 -- nvmf/common.sh@717 -- # local ip 00:29:09.865 03:29:44 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:09.865 03:29:44 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:09.865 03:29:44 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:09.865 03:29:44 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:09.865 03:29:44 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:09.865 03:29:44 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:09.865 03:29:44 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:09.865 03:29:44 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:09.865 03:29:44 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:09.865 03:29:44 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:29:09.865 03:29:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:09.865 03:29:44 -- common/autotest_common.sh@10 -- # set +x 00:29:10.124 nvme0n1 00:29:10.124 03:29:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:10.124 03:29:44 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:10.124 03:29:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:10.124 03:29:44 -- common/autotest_common.sh@10 -- # set +x 00:29:10.124 03:29:44 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:10.124 03:29:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:10.124 03:29:44 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:10.124 03:29:44 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:10.124 03:29:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:10.124 03:29:44 -- common/autotest_common.sh@10 -- # set +x 00:29:10.124 03:29:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:10.124 03:29:44 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:10.124 03:29:44 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 1 00:29:10.124 03:29:44 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:10.124 03:29:44 -- host/auth.sh@44 -- # digest=sha512 00:29:10.124 03:29:44 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:29:10.124 03:29:44 -- host/auth.sh@44 -- # keyid=1 00:29:10.124 03:29:44 -- host/auth.sh@45 -- # key=DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:29:10.124 03:29:44 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:10.124 03:29:44 -- host/auth.sh@48 -- # echo ffdhe2048 00:29:10.124 03:29:44 -- host/auth.sh@49 -- # echo DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:29:10.124 03:29:44 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 1 00:29:10.124 03:29:44 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:10.124 03:29:44 -- host/auth.sh@68 -- # digest=sha512 00:29:10.124 03:29:44 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:29:10.124 03:29:44 -- host/auth.sh@68 -- # keyid=1 00:29:10.124 03:29:44 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:29:10.124 03:29:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:10.124 03:29:44 -- common/autotest_common.sh@10 -- # set +x 00:29:10.124 03:29:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:10.124 03:29:44 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:10.124 03:29:44 -- nvmf/common.sh@717 -- # local ip 00:29:10.124 03:29:44 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:10.124 03:29:44 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:10.124 03:29:44 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:10.124 03:29:44 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:10.124 03:29:44 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:10.124 03:29:44 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:10.124 03:29:44 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:10.124 03:29:44 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:10.124 03:29:44 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:10.124 03:29:44 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:29:10.124 03:29:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:10.124 03:29:44 -- common/autotest_common.sh@10 -- # set +x 00:29:10.124 nvme0n1 00:29:10.124 03:29:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:10.124 03:29:44 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:10.124 03:29:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:10.124 03:29:44 -- common/autotest_common.sh@10 -- # set +x 00:29:10.124 03:29:44 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:10.124 03:29:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:10.382 03:29:44 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:10.383 03:29:44 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:10.383 03:29:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:10.383 03:29:44 -- common/autotest_common.sh@10 -- # set +x 00:29:10.383 03:29:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:10.383 03:29:44 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:10.383 03:29:44 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 2 00:29:10.383 03:29:44 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:10.383 03:29:44 -- host/auth.sh@44 -- # digest=sha512 00:29:10.383 03:29:44 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:29:10.383 03:29:44 -- host/auth.sh@44 -- # keyid=2 00:29:10.383 03:29:44 -- host/auth.sh@45 -- # key=DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:29:10.383 03:29:44 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:10.383 03:29:44 -- host/auth.sh@48 -- # echo ffdhe2048 00:29:10.383 03:29:44 -- host/auth.sh@49 -- # echo DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:29:10.383 03:29:44 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 2 00:29:10.383 03:29:44 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:10.383 03:29:44 -- host/auth.sh@68 -- # digest=sha512 00:29:10.383 03:29:44 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:29:10.383 03:29:44 -- host/auth.sh@68 -- # keyid=2 00:29:10.383 03:29:44 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:29:10.383 03:29:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:10.383 03:29:44 -- common/autotest_common.sh@10 -- # set +x 00:29:10.383 03:29:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:10.383 03:29:44 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:10.383 03:29:44 -- nvmf/common.sh@717 -- # local ip 00:29:10.383 03:29:44 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:10.383 03:29:44 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:10.383 03:29:44 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:10.383 03:29:44 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:10.383 03:29:44 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:10.383 03:29:44 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:10.383 03:29:44 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:10.383 03:29:44 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:10.383 03:29:44 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:10.383 03:29:44 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:29:10.383 03:29:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:10.383 03:29:44 -- common/autotest_common.sh@10 -- # set +x 00:29:10.383 nvme0n1 00:29:10.383 03:29:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:10.383 03:29:44 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:10.383 03:29:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:10.383 03:29:44 -- common/autotest_common.sh@10 -- # set +x 00:29:10.383 03:29:44 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:10.383 03:29:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:10.642 03:29:44 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:10.642 03:29:44 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:10.642 03:29:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:10.642 03:29:44 -- common/autotest_common.sh@10 -- # set +x 00:29:10.642 03:29:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:10.642 03:29:44 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:10.642 03:29:44 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 3 00:29:10.642 03:29:44 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:10.642 03:29:44 -- host/auth.sh@44 -- # digest=sha512 00:29:10.642 03:29:44 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:29:10.642 03:29:44 -- host/auth.sh@44 -- # keyid=3 00:29:10.642 03:29:44 -- host/auth.sh@45 -- # key=DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:29:10.642 03:29:44 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:10.642 03:29:44 -- host/auth.sh@48 -- # echo ffdhe2048 00:29:10.642 03:29:44 -- host/auth.sh@49 -- # echo DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:29:10.642 03:29:44 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 3 00:29:10.642 03:29:44 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:10.642 03:29:44 -- host/auth.sh@68 -- # digest=sha512 00:29:10.642 03:29:44 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:29:10.642 03:29:44 -- host/auth.sh@68 -- # keyid=3 00:29:10.642 03:29:44 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:29:10.642 03:29:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:10.642 03:29:44 -- common/autotest_common.sh@10 -- # set +x 00:29:10.642 03:29:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:10.642 03:29:44 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:10.642 03:29:44 -- nvmf/common.sh@717 -- # local ip 00:29:10.642 03:29:44 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:10.642 03:29:44 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:10.642 03:29:44 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:10.642 03:29:44 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:10.642 03:29:44 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:10.642 03:29:44 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:10.642 03:29:44 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:10.642 03:29:44 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:10.642 03:29:44 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:10.642 03:29:44 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:29:10.642 03:29:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:10.642 03:29:44 -- common/autotest_common.sh@10 -- # set +x 00:29:10.642 nvme0n1 00:29:10.642 03:29:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:10.642 03:29:45 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:10.642 03:29:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:10.642 03:29:45 -- common/autotest_common.sh@10 -- # set +x 00:29:10.642 03:29:45 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:10.642 03:29:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:10.642 03:29:45 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:10.642 03:29:45 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:10.642 03:29:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:10.642 03:29:45 -- common/autotest_common.sh@10 -- # set +x 00:29:10.642 03:29:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:10.642 03:29:45 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:10.642 03:29:45 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 4 00:29:10.642 03:29:45 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:10.642 03:29:45 -- host/auth.sh@44 -- # digest=sha512 00:29:10.642 03:29:45 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:29:10.902 03:29:45 -- host/auth.sh@44 -- # keyid=4 00:29:10.902 03:29:45 -- host/auth.sh@45 -- # key=DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:29:10.902 03:29:45 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:10.902 03:29:45 -- host/auth.sh@48 -- # echo ffdhe2048 00:29:10.902 03:29:45 -- host/auth.sh@49 -- # echo DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:29:10.902 03:29:45 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 4 00:29:10.902 03:29:45 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:10.902 03:29:45 -- host/auth.sh@68 -- # digest=sha512 00:29:10.902 03:29:45 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:29:10.902 03:29:45 -- host/auth.sh@68 -- # keyid=4 00:29:10.902 03:29:45 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:29:10.902 03:29:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:10.902 03:29:45 -- common/autotest_common.sh@10 -- # set +x 00:29:10.902 03:29:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:10.902 03:29:45 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:10.902 03:29:45 -- nvmf/common.sh@717 -- # local ip 00:29:10.902 03:29:45 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:10.902 03:29:45 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:10.902 03:29:45 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:10.902 03:29:45 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:10.902 03:29:45 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:10.902 03:29:45 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:10.902 03:29:45 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:10.902 03:29:45 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:10.902 03:29:45 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:10.902 03:29:45 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:29:10.902 03:29:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:10.902 03:29:45 -- common/autotest_common.sh@10 -- # set +x 00:29:10.902 nvme0n1 00:29:10.902 03:29:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:10.902 03:29:45 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:10.902 03:29:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:10.902 03:29:45 -- common/autotest_common.sh@10 -- # set +x 00:29:10.902 03:29:45 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:10.902 03:29:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:10.902 03:29:45 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:10.902 03:29:45 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:10.902 03:29:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:10.902 03:29:45 -- common/autotest_common.sh@10 -- # set +x 00:29:10.902 03:29:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:10.902 03:29:45 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:29:10.902 03:29:45 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:10.902 03:29:45 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 0 00:29:10.902 03:29:45 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:10.902 03:29:45 -- host/auth.sh@44 -- # digest=sha512 00:29:10.902 03:29:45 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:29:10.902 03:29:45 -- host/auth.sh@44 -- # keyid=0 00:29:10.902 03:29:45 -- host/auth.sh@45 -- # key=DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:29:10.902 03:29:45 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:10.902 03:29:45 -- host/auth.sh@48 -- # echo ffdhe3072 00:29:10.902 03:29:45 -- host/auth.sh@49 -- # echo DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:29:10.902 03:29:45 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 0 00:29:10.902 03:29:45 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:10.902 03:29:45 -- host/auth.sh@68 -- # digest=sha512 00:29:10.902 03:29:45 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:29:10.902 03:29:45 -- host/auth.sh@68 -- # keyid=0 00:29:10.902 03:29:45 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:29:10.902 03:29:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:10.902 03:29:45 -- common/autotest_common.sh@10 -- # set +x 00:29:10.902 03:29:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:10.902 03:29:45 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:10.902 03:29:45 -- nvmf/common.sh@717 -- # local ip 00:29:10.902 03:29:45 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:10.902 03:29:45 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:10.902 03:29:45 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:10.902 03:29:45 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:10.902 03:29:45 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:10.902 03:29:45 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:10.902 03:29:45 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:10.902 03:29:45 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:10.902 03:29:45 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:10.902 03:29:45 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:29:10.902 03:29:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:10.902 03:29:45 -- common/autotest_common.sh@10 -- # set +x 00:29:11.161 nvme0n1 00:29:11.162 03:29:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:11.162 03:29:45 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:11.162 03:29:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:11.162 03:29:45 -- common/autotest_common.sh@10 -- # set +x 00:29:11.162 03:29:45 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:11.162 03:29:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:11.162 03:29:45 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:11.162 03:29:45 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:11.162 03:29:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:11.162 03:29:45 -- common/autotest_common.sh@10 -- # set +x 00:29:11.162 03:29:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:11.162 03:29:45 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:11.162 03:29:45 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 1 00:29:11.162 03:29:45 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:11.162 03:29:45 -- host/auth.sh@44 -- # digest=sha512 00:29:11.162 03:29:45 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:29:11.162 03:29:45 -- host/auth.sh@44 -- # keyid=1 00:29:11.162 03:29:45 -- host/auth.sh@45 -- # key=DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:29:11.162 03:29:45 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:11.162 03:29:45 -- host/auth.sh@48 -- # echo ffdhe3072 00:29:11.162 03:29:45 -- host/auth.sh@49 -- # echo DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:29:11.162 03:29:45 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 1 00:29:11.162 03:29:45 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:11.162 03:29:45 -- host/auth.sh@68 -- # digest=sha512 00:29:11.162 03:29:45 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:29:11.162 03:29:45 -- host/auth.sh@68 -- # keyid=1 00:29:11.162 03:29:45 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:29:11.162 03:29:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:11.162 03:29:45 -- common/autotest_common.sh@10 -- # set +x 00:29:11.162 03:29:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:11.162 03:29:45 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:11.162 03:29:45 -- nvmf/common.sh@717 -- # local ip 00:29:11.162 03:29:45 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:11.162 03:29:45 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:11.162 03:29:45 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:11.162 03:29:45 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:11.162 03:29:45 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:11.162 03:29:45 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:11.162 03:29:45 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:11.162 03:29:45 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:11.162 03:29:45 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:11.162 03:29:45 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:29:11.162 03:29:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:11.162 03:29:45 -- common/autotest_common.sh@10 -- # set +x 00:29:11.421 nvme0n1 00:29:11.421 03:29:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:11.421 03:29:45 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:11.421 03:29:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:11.421 03:29:45 -- common/autotest_common.sh@10 -- # set +x 00:29:11.421 03:29:45 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:11.421 03:29:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:11.421 03:29:45 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:11.421 03:29:45 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:11.421 03:29:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:11.421 03:29:45 -- common/autotest_common.sh@10 -- # set +x 00:29:11.421 03:29:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:11.421 03:29:45 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:11.421 03:29:45 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 2 00:29:11.421 03:29:45 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:11.421 03:29:45 -- host/auth.sh@44 -- # digest=sha512 00:29:11.421 03:29:45 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:29:11.421 03:29:45 -- host/auth.sh@44 -- # keyid=2 00:29:11.421 03:29:45 -- host/auth.sh@45 -- # key=DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:29:11.421 03:29:45 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:11.421 03:29:45 -- host/auth.sh@48 -- # echo ffdhe3072 00:29:11.421 03:29:45 -- host/auth.sh@49 -- # echo DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:29:11.421 03:29:45 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 2 00:29:11.421 03:29:45 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:11.421 03:29:45 -- host/auth.sh@68 -- # digest=sha512 00:29:11.421 03:29:45 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:29:11.421 03:29:45 -- host/auth.sh@68 -- # keyid=2 00:29:11.421 03:29:45 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:29:11.421 03:29:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:11.421 03:29:45 -- common/autotest_common.sh@10 -- # set +x 00:29:11.421 03:29:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:11.421 03:29:45 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:11.421 03:29:45 -- nvmf/common.sh@717 -- # local ip 00:29:11.421 03:29:45 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:11.421 03:29:45 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:11.421 03:29:45 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:11.421 03:29:45 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:11.421 03:29:45 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:11.421 03:29:45 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:11.421 03:29:45 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:11.421 03:29:45 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:11.421 03:29:45 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:11.421 03:29:45 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:29:11.421 03:29:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:11.421 03:29:45 -- common/autotest_common.sh@10 -- # set +x 00:29:11.681 nvme0n1 00:29:11.681 03:29:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:11.681 03:29:46 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:11.681 03:29:46 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:11.681 03:29:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:11.681 03:29:46 -- common/autotest_common.sh@10 -- # set +x 00:29:11.681 03:29:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:11.681 03:29:46 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:11.681 03:29:46 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:11.681 03:29:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:11.681 03:29:46 -- common/autotest_common.sh@10 -- # set +x 00:29:11.681 03:29:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:11.681 03:29:46 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:11.681 03:29:46 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 3 00:29:11.681 03:29:46 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:11.681 03:29:46 -- host/auth.sh@44 -- # digest=sha512 00:29:11.681 03:29:46 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:29:11.681 03:29:46 -- host/auth.sh@44 -- # keyid=3 00:29:11.681 03:29:46 -- host/auth.sh@45 -- # key=DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:29:11.681 03:29:46 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:11.681 03:29:46 -- host/auth.sh@48 -- # echo ffdhe3072 00:29:11.681 03:29:46 -- host/auth.sh@49 -- # echo DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:29:11.681 03:29:46 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 3 00:29:11.681 03:29:46 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:11.681 03:29:46 -- host/auth.sh@68 -- # digest=sha512 00:29:11.681 03:29:46 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:29:11.681 03:29:46 -- host/auth.sh@68 -- # keyid=3 00:29:11.681 03:29:46 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:29:11.681 03:29:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:11.681 03:29:46 -- common/autotest_common.sh@10 -- # set +x 00:29:11.681 03:29:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:11.681 03:29:46 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:11.681 03:29:46 -- nvmf/common.sh@717 -- # local ip 00:29:11.681 03:29:46 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:11.681 03:29:46 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:11.681 03:29:46 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:11.681 03:29:46 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:11.681 03:29:46 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:11.681 03:29:46 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:11.681 03:29:46 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:11.681 03:29:46 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:11.681 03:29:46 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:11.681 03:29:46 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:29:11.681 03:29:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:11.681 03:29:46 -- common/autotest_common.sh@10 -- # set +x 00:29:11.940 nvme0n1 00:29:11.940 03:29:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:11.940 03:29:46 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:11.940 03:29:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:11.940 03:29:46 -- common/autotest_common.sh@10 -- # set +x 00:29:11.940 03:29:46 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:11.940 03:29:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:11.940 03:29:46 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:11.940 03:29:46 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:11.940 03:29:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:11.940 03:29:46 -- common/autotest_common.sh@10 -- # set +x 00:29:11.940 03:29:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:11.940 03:29:46 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:11.940 03:29:46 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 4 00:29:11.940 03:29:46 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:11.940 03:29:46 -- host/auth.sh@44 -- # digest=sha512 00:29:11.940 03:29:46 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:29:11.940 03:29:46 -- host/auth.sh@44 -- # keyid=4 00:29:11.941 03:29:46 -- host/auth.sh@45 -- # key=DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:29:11.941 03:29:46 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:11.941 03:29:46 -- host/auth.sh@48 -- # echo ffdhe3072 00:29:11.941 03:29:46 -- host/auth.sh@49 -- # echo DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:29:11.941 03:29:46 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 4 00:29:11.941 03:29:46 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:11.941 03:29:46 -- host/auth.sh@68 -- # digest=sha512 00:29:11.941 03:29:46 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:29:11.941 03:29:46 -- host/auth.sh@68 -- # keyid=4 00:29:11.941 03:29:46 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:29:11.941 03:29:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:11.941 03:29:46 -- common/autotest_common.sh@10 -- # set +x 00:29:11.941 03:29:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:11.941 03:29:46 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:11.941 03:29:46 -- nvmf/common.sh@717 -- # local ip 00:29:11.941 03:29:46 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:11.941 03:29:46 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:11.941 03:29:46 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:11.941 03:29:46 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:11.941 03:29:46 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:11.941 03:29:46 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:11.941 03:29:46 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:11.941 03:29:46 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:11.941 03:29:46 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:11.941 03:29:46 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:29:11.941 03:29:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:11.941 03:29:46 -- common/autotest_common.sh@10 -- # set +x 00:29:12.200 nvme0n1 00:29:12.200 03:29:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:12.200 03:29:46 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:12.200 03:29:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:12.200 03:29:46 -- common/autotest_common.sh@10 -- # set +x 00:29:12.200 03:29:46 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:12.200 03:29:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:12.200 03:29:46 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:12.200 03:29:46 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:12.200 03:29:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:12.200 03:29:46 -- common/autotest_common.sh@10 -- # set +x 00:29:12.200 03:29:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:12.200 03:29:46 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:29:12.200 03:29:46 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:12.200 03:29:46 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 0 00:29:12.200 03:29:46 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:12.200 03:29:46 -- host/auth.sh@44 -- # digest=sha512 00:29:12.200 03:29:46 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:29:12.200 03:29:46 -- host/auth.sh@44 -- # keyid=0 00:29:12.200 03:29:46 -- host/auth.sh@45 -- # key=DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:29:12.200 03:29:46 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:12.200 03:29:46 -- host/auth.sh@48 -- # echo ffdhe4096 00:29:12.200 03:29:46 -- host/auth.sh@49 -- # echo DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:29:12.200 03:29:46 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 0 00:29:12.200 03:29:46 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:12.200 03:29:46 -- host/auth.sh@68 -- # digest=sha512 00:29:12.200 03:29:46 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:29:12.200 03:29:46 -- host/auth.sh@68 -- # keyid=0 00:29:12.200 03:29:46 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:29:12.200 03:29:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:12.200 03:29:46 -- common/autotest_common.sh@10 -- # set +x 00:29:12.200 03:29:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:12.200 03:29:46 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:12.200 03:29:46 -- nvmf/common.sh@717 -- # local ip 00:29:12.200 03:29:46 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:12.200 03:29:46 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:12.200 03:29:46 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:12.200 03:29:46 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:12.200 03:29:46 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:12.200 03:29:46 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:12.200 03:29:46 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:12.200 03:29:46 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:12.200 03:29:46 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:12.200 03:29:46 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:29:12.200 03:29:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:12.200 03:29:46 -- common/autotest_common.sh@10 -- # set +x 00:29:12.459 nvme0n1 00:29:12.459 03:29:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:12.459 03:29:46 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:12.460 03:29:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:12.460 03:29:46 -- common/autotest_common.sh@10 -- # set +x 00:29:12.460 03:29:46 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:12.460 03:29:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:12.460 03:29:46 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:12.460 03:29:46 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:12.460 03:29:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:12.460 03:29:46 -- common/autotest_common.sh@10 -- # set +x 00:29:12.460 03:29:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:12.460 03:29:46 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:12.460 03:29:46 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 1 00:29:12.460 03:29:46 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:12.460 03:29:46 -- host/auth.sh@44 -- # digest=sha512 00:29:12.460 03:29:46 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:29:12.460 03:29:46 -- host/auth.sh@44 -- # keyid=1 00:29:12.460 03:29:46 -- host/auth.sh@45 -- # key=DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:29:12.460 03:29:46 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:12.460 03:29:46 -- host/auth.sh@48 -- # echo ffdhe4096 00:29:12.460 03:29:46 -- host/auth.sh@49 -- # echo DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:29:12.460 03:29:46 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 1 00:29:12.460 03:29:46 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:12.460 03:29:46 -- host/auth.sh@68 -- # digest=sha512 00:29:12.460 03:29:46 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:29:12.460 03:29:46 -- host/auth.sh@68 -- # keyid=1 00:29:12.460 03:29:46 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:29:12.460 03:29:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:12.460 03:29:46 -- common/autotest_common.sh@10 -- # set +x 00:29:12.460 03:29:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:12.460 03:29:46 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:12.460 03:29:46 -- nvmf/common.sh@717 -- # local ip 00:29:12.460 03:29:46 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:12.460 03:29:46 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:12.460 03:29:46 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:12.460 03:29:46 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:12.460 03:29:46 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:12.460 03:29:46 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:12.460 03:29:46 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:12.460 03:29:46 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:12.460 03:29:46 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:12.460 03:29:46 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:29:12.460 03:29:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:12.460 03:29:46 -- common/autotest_common.sh@10 -- # set +x 00:29:12.719 nvme0n1 00:29:12.719 03:29:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:12.719 03:29:47 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:12.719 03:29:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:12.719 03:29:47 -- common/autotest_common.sh@10 -- # set +x 00:29:12.719 03:29:47 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:12.719 03:29:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:12.978 03:29:47 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:12.978 03:29:47 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:12.978 03:29:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:12.978 03:29:47 -- common/autotest_common.sh@10 -- # set +x 00:29:12.978 03:29:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:12.978 03:29:47 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:12.978 03:29:47 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 2 00:29:12.978 03:29:47 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:12.978 03:29:47 -- host/auth.sh@44 -- # digest=sha512 00:29:12.978 03:29:47 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:29:12.978 03:29:47 -- host/auth.sh@44 -- # keyid=2 00:29:12.978 03:29:47 -- host/auth.sh@45 -- # key=DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:29:12.978 03:29:47 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:12.978 03:29:47 -- host/auth.sh@48 -- # echo ffdhe4096 00:29:12.978 03:29:47 -- host/auth.sh@49 -- # echo DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:29:12.978 03:29:47 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 2 00:29:12.978 03:29:47 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:12.978 03:29:47 -- host/auth.sh@68 -- # digest=sha512 00:29:12.978 03:29:47 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:29:12.978 03:29:47 -- host/auth.sh@68 -- # keyid=2 00:29:12.978 03:29:47 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:29:12.978 03:29:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:12.978 03:29:47 -- common/autotest_common.sh@10 -- # set +x 00:29:12.978 03:29:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:12.978 03:29:47 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:12.978 03:29:47 -- nvmf/common.sh@717 -- # local ip 00:29:12.978 03:29:47 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:12.978 03:29:47 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:12.978 03:29:47 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:12.978 03:29:47 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:12.978 03:29:47 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:12.978 03:29:47 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:12.979 03:29:47 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:12.979 03:29:47 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:12.979 03:29:47 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:12.979 03:29:47 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:29:12.979 03:29:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:12.979 03:29:47 -- common/autotest_common.sh@10 -- # set +x 00:29:13.238 nvme0n1 00:29:13.238 03:29:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:13.238 03:29:47 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:13.238 03:29:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:13.238 03:29:47 -- common/autotest_common.sh@10 -- # set +x 00:29:13.238 03:29:47 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:13.238 03:29:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:13.238 03:29:47 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:13.238 03:29:47 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:13.238 03:29:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:13.238 03:29:47 -- common/autotest_common.sh@10 -- # set +x 00:29:13.238 03:29:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:13.238 03:29:47 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:13.238 03:29:47 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 3 00:29:13.238 03:29:47 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:13.238 03:29:47 -- host/auth.sh@44 -- # digest=sha512 00:29:13.238 03:29:47 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:29:13.238 03:29:47 -- host/auth.sh@44 -- # keyid=3 00:29:13.238 03:29:47 -- host/auth.sh@45 -- # key=DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:29:13.238 03:29:47 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:13.238 03:29:47 -- host/auth.sh@48 -- # echo ffdhe4096 00:29:13.238 03:29:47 -- host/auth.sh@49 -- # echo DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:29:13.238 03:29:47 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 3 00:29:13.238 03:29:47 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:13.238 03:29:47 -- host/auth.sh@68 -- # digest=sha512 00:29:13.238 03:29:47 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:29:13.238 03:29:47 -- host/auth.sh@68 -- # keyid=3 00:29:13.238 03:29:47 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:29:13.238 03:29:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:13.238 03:29:47 -- common/autotest_common.sh@10 -- # set +x 00:29:13.238 03:29:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:13.238 03:29:47 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:13.238 03:29:47 -- nvmf/common.sh@717 -- # local ip 00:29:13.238 03:29:47 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:13.238 03:29:47 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:13.238 03:29:47 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:13.238 03:29:47 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:13.238 03:29:47 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:13.238 03:29:47 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:13.238 03:29:47 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:13.238 03:29:47 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:13.239 03:29:47 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:13.239 03:29:47 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:29:13.239 03:29:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:13.239 03:29:47 -- common/autotest_common.sh@10 -- # set +x 00:29:13.497 nvme0n1 00:29:13.497 03:29:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:13.497 03:29:47 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:13.497 03:29:47 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:13.497 03:29:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:13.498 03:29:47 -- common/autotest_common.sh@10 -- # set +x 00:29:13.498 03:29:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:13.498 03:29:47 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:13.498 03:29:47 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:13.498 03:29:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:13.498 03:29:47 -- common/autotest_common.sh@10 -- # set +x 00:29:13.498 03:29:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:13.498 03:29:47 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:13.498 03:29:47 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 4 00:29:13.498 03:29:47 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:13.498 03:29:47 -- host/auth.sh@44 -- # digest=sha512 00:29:13.498 03:29:47 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:29:13.498 03:29:47 -- host/auth.sh@44 -- # keyid=4 00:29:13.498 03:29:47 -- host/auth.sh@45 -- # key=DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:29:13.498 03:29:47 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:13.498 03:29:47 -- host/auth.sh@48 -- # echo ffdhe4096 00:29:13.498 03:29:47 -- host/auth.sh@49 -- # echo DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:29:13.498 03:29:47 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 4 00:29:13.498 03:29:47 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:13.498 03:29:47 -- host/auth.sh@68 -- # digest=sha512 00:29:13.498 03:29:47 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:29:13.498 03:29:47 -- host/auth.sh@68 -- # keyid=4 00:29:13.498 03:29:47 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:29:13.498 03:29:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:13.498 03:29:47 -- common/autotest_common.sh@10 -- # set +x 00:29:13.498 03:29:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:13.498 03:29:47 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:13.498 03:29:47 -- nvmf/common.sh@717 -- # local ip 00:29:13.498 03:29:47 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:13.498 03:29:47 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:13.498 03:29:47 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:13.498 03:29:47 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:13.498 03:29:47 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:13.498 03:29:47 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:13.498 03:29:47 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:13.498 03:29:47 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:13.498 03:29:47 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:13.498 03:29:47 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:29:13.498 03:29:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:13.498 03:29:47 -- common/autotest_common.sh@10 -- # set +x 00:29:13.757 nvme0n1 00:29:13.757 03:29:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:13.757 03:29:48 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:13.757 03:29:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:13.757 03:29:48 -- common/autotest_common.sh@10 -- # set +x 00:29:13.757 03:29:48 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:13.757 03:29:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:13.757 03:29:48 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:13.757 03:29:48 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:13.757 03:29:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:13.757 03:29:48 -- common/autotest_common.sh@10 -- # set +x 00:29:13.757 03:29:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:13.757 03:29:48 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:29:13.757 03:29:48 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:13.757 03:29:48 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 0 00:29:13.757 03:29:48 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:13.757 03:29:48 -- host/auth.sh@44 -- # digest=sha512 00:29:13.757 03:29:48 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:29:13.757 03:29:48 -- host/auth.sh@44 -- # keyid=0 00:29:13.757 03:29:48 -- host/auth.sh@45 -- # key=DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:29:13.757 03:29:48 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:13.757 03:29:48 -- host/auth.sh@48 -- # echo ffdhe6144 00:29:13.757 03:29:48 -- host/auth.sh@49 -- # echo DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:29:13.757 03:29:48 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 0 00:29:13.757 03:29:48 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:13.757 03:29:48 -- host/auth.sh@68 -- # digest=sha512 00:29:13.757 03:29:48 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:29:13.757 03:29:48 -- host/auth.sh@68 -- # keyid=0 00:29:13.757 03:29:48 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:29:13.757 03:29:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:13.757 03:29:48 -- common/autotest_common.sh@10 -- # set +x 00:29:13.757 03:29:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:13.757 03:29:48 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:13.757 03:29:48 -- nvmf/common.sh@717 -- # local ip 00:29:13.757 03:29:48 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:13.757 03:29:48 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:13.757 03:29:48 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:13.757 03:29:48 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:13.757 03:29:48 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:13.757 03:29:48 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:13.757 03:29:48 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:13.757 03:29:48 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:13.757 03:29:48 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:13.757 03:29:48 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:29:13.757 03:29:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:13.757 03:29:48 -- common/autotest_common.sh@10 -- # set +x 00:29:14.325 nvme0n1 00:29:14.325 03:29:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:14.325 03:29:48 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:14.325 03:29:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:14.325 03:29:48 -- common/autotest_common.sh@10 -- # set +x 00:29:14.325 03:29:48 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:14.325 03:29:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:14.325 03:29:48 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:14.325 03:29:48 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:14.325 03:29:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:14.325 03:29:48 -- common/autotest_common.sh@10 -- # set +x 00:29:14.325 03:29:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:14.325 03:29:48 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:14.325 03:29:48 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 1 00:29:14.325 03:29:48 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:14.325 03:29:48 -- host/auth.sh@44 -- # digest=sha512 00:29:14.325 03:29:48 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:29:14.325 03:29:48 -- host/auth.sh@44 -- # keyid=1 00:29:14.325 03:29:48 -- host/auth.sh@45 -- # key=DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:29:14.325 03:29:48 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:14.325 03:29:48 -- host/auth.sh@48 -- # echo ffdhe6144 00:29:14.325 03:29:48 -- host/auth.sh@49 -- # echo DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:29:14.325 03:29:48 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 1 00:29:14.325 03:29:48 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:14.325 03:29:48 -- host/auth.sh@68 -- # digest=sha512 00:29:14.325 03:29:48 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:29:14.325 03:29:48 -- host/auth.sh@68 -- # keyid=1 00:29:14.325 03:29:48 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:29:14.325 03:29:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:14.325 03:29:48 -- common/autotest_common.sh@10 -- # set +x 00:29:14.325 03:29:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:14.325 03:29:48 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:14.325 03:29:48 -- nvmf/common.sh@717 -- # local ip 00:29:14.325 03:29:48 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:14.325 03:29:48 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:14.325 03:29:48 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:14.325 03:29:48 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:14.325 03:29:48 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:14.325 03:29:48 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:14.325 03:29:48 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:14.325 03:29:48 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:14.325 03:29:48 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:14.325 03:29:48 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:29:14.325 03:29:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:14.325 03:29:48 -- common/autotest_common.sh@10 -- # set +x 00:29:14.585 nvme0n1 00:29:14.585 03:29:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:14.585 03:29:49 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:14.585 03:29:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:14.585 03:29:49 -- common/autotest_common.sh@10 -- # set +x 00:29:14.585 03:29:49 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:14.585 03:29:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:14.585 03:29:49 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:14.585 03:29:49 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:14.585 03:29:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:14.585 03:29:49 -- common/autotest_common.sh@10 -- # set +x 00:29:14.585 03:29:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:14.585 03:29:49 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:14.585 03:29:49 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 2 00:29:14.585 03:29:49 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:14.585 03:29:49 -- host/auth.sh@44 -- # digest=sha512 00:29:14.585 03:29:49 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:29:14.585 03:29:49 -- host/auth.sh@44 -- # keyid=2 00:29:14.585 03:29:49 -- host/auth.sh@45 -- # key=DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:29:14.585 03:29:49 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:14.585 03:29:49 -- host/auth.sh@48 -- # echo ffdhe6144 00:29:14.585 03:29:49 -- host/auth.sh@49 -- # echo DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:29:14.585 03:29:49 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 2 00:29:14.585 03:29:49 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:14.585 03:29:49 -- host/auth.sh@68 -- # digest=sha512 00:29:14.585 03:29:49 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:29:14.585 03:29:49 -- host/auth.sh@68 -- # keyid=2 00:29:14.585 03:29:49 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:29:14.585 03:29:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:14.585 03:29:49 -- common/autotest_common.sh@10 -- # set +x 00:29:14.585 03:29:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:14.585 03:29:49 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:14.585 03:29:49 -- nvmf/common.sh@717 -- # local ip 00:29:14.585 03:29:49 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:14.844 03:29:49 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:14.844 03:29:49 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:14.844 03:29:49 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:14.844 03:29:49 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:14.844 03:29:49 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:14.844 03:29:49 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:14.844 03:29:49 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:14.844 03:29:49 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:14.844 03:29:49 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:29:14.844 03:29:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:14.844 03:29:49 -- common/autotest_common.sh@10 -- # set +x 00:29:15.103 nvme0n1 00:29:15.103 03:29:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:15.103 03:29:49 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:15.103 03:29:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:15.103 03:29:49 -- common/autotest_common.sh@10 -- # set +x 00:29:15.103 03:29:49 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:15.103 03:29:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:15.103 03:29:49 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:15.103 03:29:49 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:15.103 03:29:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:15.103 03:29:49 -- common/autotest_common.sh@10 -- # set +x 00:29:15.103 03:29:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:15.103 03:29:49 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:15.103 03:29:49 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 3 00:29:15.103 03:29:49 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:15.103 03:29:49 -- host/auth.sh@44 -- # digest=sha512 00:29:15.103 03:29:49 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:29:15.103 03:29:49 -- host/auth.sh@44 -- # keyid=3 00:29:15.103 03:29:49 -- host/auth.sh@45 -- # key=DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:29:15.103 03:29:49 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:15.103 03:29:49 -- host/auth.sh@48 -- # echo ffdhe6144 00:29:15.103 03:29:49 -- host/auth.sh@49 -- # echo DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:29:15.103 03:29:49 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 3 00:29:15.103 03:29:49 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:15.103 03:29:49 -- host/auth.sh@68 -- # digest=sha512 00:29:15.103 03:29:49 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:29:15.103 03:29:49 -- host/auth.sh@68 -- # keyid=3 00:29:15.103 03:29:49 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:29:15.103 03:29:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:15.103 03:29:49 -- common/autotest_common.sh@10 -- # set +x 00:29:15.103 03:29:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:15.103 03:29:49 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:15.103 03:29:49 -- nvmf/common.sh@717 -- # local ip 00:29:15.103 03:29:49 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:15.103 03:29:49 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:15.103 03:29:49 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:15.103 03:29:49 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:15.103 03:29:49 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:15.103 03:29:49 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:15.103 03:29:49 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:15.103 03:29:49 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:15.103 03:29:49 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:15.103 03:29:49 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:29:15.103 03:29:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:15.103 03:29:49 -- common/autotest_common.sh@10 -- # set +x 00:29:15.671 nvme0n1 00:29:15.671 03:29:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:15.671 03:29:49 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:15.671 03:29:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:15.671 03:29:49 -- common/autotest_common.sh@10 -- # set +x 00:29:15.671 03:29:49 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:15.671 03:29:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:15.671 03:29:49 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:15.671 03:29:49 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:15.671 03:29:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:15.671 03:29:49 -- common/autotest_common.sh@10 -- # set +x 00:29:15.671 03:29:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:15.671 03:29:49 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:15.671 03:29:49 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 4 00:29:15.671 03:29:49 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:15.671 03:29:49 -- host/auth.sh@44 -- # digest=sha512 00:29:15.671 03:29:49 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:29:15.671 03:29:49 -- host/auth.sh@44 -- # keyid=4 00:29:15.671 03:29:49 -- host/auth.sh@45 -- # key=DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:29:15.671 03:29:49 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:15.671 03:29:49 -- host/auth.sh@48 -- # echo ffdhe6144 00:29:15.671 03:29:49 -- host/auth.sh@49 -- # echo DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:29:15.671 03:29:49 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 4 00:29:15.671 03:29:49 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:15.671 03:29:49 -- host/auth.sh@68 -- # digest=sha512 00:29:15.671 03:29:49 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:29:15.671 03:29:49 -- host/auth.sh@68 -- # keyid=4 00:29:15.671 03:29:49 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:29:15.671 03:29:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:15.671 03:29:49 -- common/autotest_common.sh@10 -- # set +x 00:29:15.671 03:29:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:15.671 03:29:49 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:15.671 03:29:49 -- nvmf/common.sh@717 -- # local ip 00:29:15.671 03:29:49 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:15.671 03:29:49 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:15.671 03:29:49 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:15.672 03:29:49 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:15.672 03:29:49 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:15.672 03:29:49 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:15.672 03:29:49 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:15.672 03:29:49 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:15.672 03:29:49 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:15.672 03:29:49 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:29:15.672 03:29:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:15.672 03:29:49 -- common/autotest_common.sh@10 -- # set +x 00:29:15.931 nvme0n1 00:29:15.931 03:29:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:15.931 03:29:50 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:15.931 03:29:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:15.931 03:29:50 -- common/autotest_common.sh@10 -- # set +x 00:29:15.931 03:29:50 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:15.931 03:29:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:15.931 03:29:50 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:15.931 03:29:50 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:15.931 03:29:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:15.931 03:29:50 -- common/autotest_common.sh@10 -- # set +x 00:29:15.931 03:29:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:15.931 03:29:50 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:29:15.931 03:29:50 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:15.931 03:29:50 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 0 00:29:15.931 03:29:50 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:15.931 03:29:50 -- host/auth.sh@44 -- # digest=sha512 00:29:15.931 03:29:50 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:29:15.931 03:29:50 -- host/auth.sh@44 -- # keyid=0 00:29:15.931 03:29:50 -- host/auth.sh@45 -- # key=DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:29:15.931 03:29:50 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:15.931 03:29:50 -- host/auth.sh@48 -- # echo ffdhe8192 00:29:15.931 03:29:50 -- host/auth.sh@49 -- # echo DHHC-1:00:YTdmYjExOTY5YTAxNGVhY2JmMjcxNjBkNDA0NjM1ODDvrJwA: 00:29:15.931 03:29:50 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 0 00:29:15.931 03:29:50 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:15.931 03:29:50 -- host/auth.sh@68 -- # digest=sha512 00:29:15.931 03:29:50 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:29:15.931 03:29:50 -- host/auth.sh@68 -- # keyid=0 00:29:15.931 03:29:50 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:29:15.931 03:29:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:15.931 03:29:50 -- common/autotest_common.sh@10 -- # set +x 00:29:15.931 03:29:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:15.931 03:29:50 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:15.931 03:29:50 -- nvmf/common.sh@717 -- # local ip 00:29:15.931 03:29:50 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:15.931 03:29:50 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:15.931 03:29:50 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:15.931 03:29:50 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:15.931 03:29:50 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:15.931 03:29:50 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:15.931 03:29:50 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:15.931 03:29:50 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:15.931 03:29:50 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:15.931 03:29:50 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:29:15.931 03:29:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:15.931 03:29:50 -- common/autotest_common.sh@10 -- # set +x 00:29:16.499 nvme0n1 00:29:16.499 03:29:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:16.499 03:29:50 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:16.499 03:29:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:16.499 03:29:50 -- common/autotest_common.sh@10 -- # set +x 00:29:16.499 03:29:50 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:16.499 03:29:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:16.499 03:29:50 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:16.499 03:29:50 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:16.499 03:29:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:16.499 03:29:50 -- common/autotest_common.sh@10 -- # set +x 00:29:16.758 03:29:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:16.758 03:29:51 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:16.758 03:29:51 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 1 00:29:16.758 03:29:51 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:16.758 03:29:51 -- host/auth.sh@44 -- # digest=sha512 00:29:16.758 03:29:51 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:29:16.758 03:29:51 -- host/auth.sh@44 -- # keyid=1 00:29:16.758 03:29:51 -- host/auth.sh@45 -- # key=DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:29:16.758 03:29:51 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:16.758 03:29:51 -- host/auth.sh@48 -- # echo ffdhe8192 00:29:16.758 03:29:51 -- host/auth.sh@49 -- # echo DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:29:16.758 03:29:51 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 1 00:29:16.758 03:29:51 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:16.758 03:29:51 -- host/auth.sh@68 -- # digest=sha512 00:29:16.758 03:29:51 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:29:16.758 03:29:51 -- host/auth.sh@68 -- # keyid=1 00:29:16.758 03:29:51 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:29:16.758 03:29:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:16.758 03:29:51 -- common/autotest_common.sh@10 -- # set +x 00:29:16.758 03:29:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:16.758 03:29:51 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:16.758 03:29:51 -- nvmf/common.sh@717 -- # local ip 00:29:16.758 03:29:51 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:16.758 03:29:51 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:16.758 03:29:51 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:16.758 03:29:51 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:16.758 03:29:51 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:16.758 03:29:51 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:16.758 03:29:51 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:16.758 03:29:51 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:16.758 03:29:51 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:16.758 03:29:51 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:29:16.758 03:29:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:16.758 03:29:51 -- common/autotest_common.sh@10 -- # set +x 00:29:17.326 nvme0n1 00:29:17.326 03:29:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:17.326 03:29:51 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:17.326 03:29:51 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:17.326 03:29:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:17.326 03:29:51 -- common/autotest_common.sh@10 -- # set +x 00:29:17.326 03:29:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:17.326 03:29:51 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:17.326 03:29:51 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:17.326 03:29:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:17.326 03:29:51 -- common/autotest_common.sh@10 -- # set +x 00:29:17.326 03:29:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:17.326 03:29:51 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:17.326 03:29:51 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 2 00:29:17.326 03:29:51 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:17.326 03:29:51 -- host/auth.sh@44 -- # digest=sha512 00:29:17.326 03:29:51 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:29:17.326 03:29:51 -- host/auth.sh@44 -- # keyid=2 00:29:17.326 03:29:51 -- host/auth.sh@45 -- # key=DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:29:17.326 03:29:51 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:17.326 03:29:51 -- host/auth.sh@48 -- # echo ffdhe8192 00:29:17.326 03:29:51 -- host/auth.sh@49 -- # echo DHHC-1:01:OGM4Nzg3NjQ5MWFkNzk2YmM4YWU0ODkxYzVjMTMxNzlvktQX: 00:29:17.326 03:29:51 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 2 00:29:17.326 03:29:51 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:17.326 03:29:51 -- host/auth.sh@68 -- # digest=sha512 00:29:17.326 03:29:51 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:29:17.326 03:29:51 -- host/auth.sh@68 -- # keyid=2 00:29:17.326 03:29:51 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:29:17.326 03:29:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:17.326 03:29:51 -- common/autotest_common.sh@10 -- # set +x 00:29:17.326 03:29:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:17.326 03:29:51 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:17.326 03:29:51 -- nvmf/common.sh@717 -- # local ip 00:29:17.326 03:29:51 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:17.326 03:29:51 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:17.326 03:29:51 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:17.326 03:29:51 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:17.326 03:29:51 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:17.326 03:29:51 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:17.326 03:29:51 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:17.326 03:29:51 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:17.326 03:29:51 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:17.326 03:29:51 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:29:17.326 03:29:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:17.326 03:29:51 -- common/autotest_common.sh@10 -- # set +x 00:29:17.894 nvme0n1 00:29:17.894 03:29:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:17.894 03:29:52 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:17.894 03:29:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:17.894 03:29:52 -- common/autotest_common.sh@10 -- # set +x 00:29:17.894 03:29:52 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:17.894 03:29:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:17.894 03:29:52 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:17.894 03:29:52 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:17.894 03:29:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:17.894 03:29:52 -- common/autotest_common.sh@10 -- # set +x 00:29:17.894 03:29:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:17.894 03:29:52 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:17.894 03:29:52 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 3 00:29:17.894 03:29:52 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:17.894 03:29:52 -- host/auth.sh@44 -- # digest=sha512 00:29:17.894 03:29:52 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:29:17.894 03:29:52 -- host/auth.sh@44 -- # keyid=3 00:29:17.894 03:29:52 -- host/auth.sh@45 -- # key=DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:29:17.894 03:29:52 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:17.894 03:29:52 -- host/auth.sh@48 -- # echo ffdhe8192 00:29:17.894 03:29:52 -- host/auth.sh@49 -- # echo DHHC-1:02:ZjU1ODFjYTk5NmNiNThlMjQ2ZmI4N2QxNzE4MTQ3NzJhZmYwMzA5NjdlYWY1MGZmOosW1g==: 00:29:17.894 03:29:52 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 3 00:29:17.894 03:29:52 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:17.894 03:29:52 -- host/auth.sh@68 -- # digest=sha512 00:29:17.894 03:29:52 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:29:17.894 03:29:52 -- host/auth.sh@68 -- # keyid=3 00:29:17.894 03:29:52 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:29:17.894 03:29:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:17.894 03:29:52 -- common/autotest_common.sh@10 -- # set +x 00:29:17.894 03:29:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:17.894 03:29:52 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:17.894 03:29:52 -- nvmf/common.sh@717 -- # local ip 00:29:17.894 03:29:52 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:17.894 03:29:52 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:17.894 03:29:52 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:17.894 03:29:52 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:17.894 03:29:52 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:17.894 03:29:52 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:17.894 03:29:52 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:17.894 03:29:52 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:17.894 03:29:52 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:17.894 03:29:52 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:29:17.894 03:29:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:17.894 03:29:52 -- common/autotest_common.sh@10 -- # set +x 00:29:18.463 nvme0n1 00:29:18.463 03:29:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:18.463 03:29:52 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:18.463 03:29:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:18.463 03:29:52 -- common/autotest_common.sh@10 -- # set +x 00:29:18.463 03:29:52 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:18.463 03:29:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:18.463 03:29:52 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:18.463 03:29:52 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:18.463 03:29:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:18.463 03:29:52 -- common/autotest_common.sh@10 -- # set +x 00:29:18.463 03:29:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:18.463 03:29:52 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:29:18.463 03:29:52 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 4 00:29:18.463 03:29:52 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:18.463 03:29:52 -- host/auth.sh@44 -- # digest=sha512 00:29:18.463 03:29:52 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:29:18.463 03:29:52 -- host/auth.sh@44 -- # keyid=4 00:29:18.463 03:29:52 -- host/auth.sh@45 -- # key=DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:29:18.463 03:29:52 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:29:18.463 03:29:52 -- host/auth.sh@48 -- # echo ffdhe8192 00:29:18.463 03:29:52 -- host/auth.sh@49 -- # echo DHHC-1:03:MjczY2Y4Y2JlNWFmYzMwMmEzZDNmNmFmZGZiY2EyODgzMTU2ZmE0NDg2NjRmZTg4MTFjNTdlZjRiZGFiZGZiYwI88zY=: 00:29:18.463 03:29:52 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 4 00:29:18.463 03:29:52 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:29:18.463 03:29:52 -- host/auth.sh@68 -- # digest=sha512 00:29:18.463 03:29:52 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:29:18.463 03:29:52 -- host/auth.sh@68 -- # keyid=4 00:29:18.463 03:29:52 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:29:18.463 03:29:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:18.463 03:29:52 -- common/autotest_common.sh@10 -- # set +x 00:29:18.463 03:29:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:18.463 03:29:52 -- host/auth.sh@70 -- # get_main_ns_ip 00:29:18.463 03:29:52 -- nvmf/common.sh@717 -- # local ip 00:29:18.463 03:29:52 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:18.463 03:29:52 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:18.463 03:29:52 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:18.463 03:29:52 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:18.463 03:29:52 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:18.463 03:29:52 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:18.463 03:29:52 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:18.463 03:29:52 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:18.463 03:29:52 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:18.463 03:29:52 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:29:18.463 03:29:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:18.463 03:29:52 -- common/autotest_common.sh@10 -- # set +x 00:29:19.029 nvme0n1 00:29:19.029 03:29:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:19.029 03:29:53 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:29:19.029 03:29:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:19.029 03:29:53 -- common/autotest_common.sh@10 -- # set +x 00:29:19.029 03:29:53 -- host/auth.sh@73 -- # jq -r '.[].name' 00:29:19.029 03:29:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:19.288 03:29:53 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:19.288 03:29:53 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:29:19.288 03:29:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:19.288 03:29:53 -- common/autotest_common.sh@10 -- # set +x 00:29:19.288 03:29:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:19.288 03:29:53 -- host/auth.sh@117 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:29:19.288 03:29:53 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:29:19.288 03:29:53 -- host/auth.sh@44 -- # digest=sha256 00:29:19.288 03:29:53 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:29:19.288 03:29:53 -- host/auth.sh@44 -- # keyid=1 00:29:19.288 03:29:53 -- host/auth.sh@45 -- # key=DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:29:19.288 03:29:53 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:29:19.288 03:29:53 -- host/auth.sh@48 -- # echo ffdhe2048 00:29:19.288 03:29:53 -- host/auth.sh@49 -- # echo DHHC-1:00:YjEzNWVlNzE3OWM3ZmU4Zjg0OTIzYjdlYzBmMjQ1ZmMyZDExOWNiZjFkZTIxOTU5S0RTdw==: 00:29:19.288 03:29:53 -- host/auth.sh@118 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:29:19.288 03:29:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:19.288 03:29:53 -- common/autotest_common.sh@10 -- # set +x 00:29:19.288 03:29:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:19.288 03:29:53 -- host/auth.sh@119 -- # get_main_ns_ip 00:29:19.288 03:29:53 -- nvmf/common.sh@717 -- # local ip 00:29:19.288 03:29:53 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:19.288 03:29:53 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:19.288 03:29:53 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:19.288 03:29:53 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:19.288 03:29:53 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:19.288 03:29:53 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:19.288 03:29:53 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:19.288 03:29:53 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:19.288 03:29:53 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:19.288 03:29:53 -- host/auth.sh@119 -- # NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:29:19.288 03:29:53 -- common/autotest_common.sh@638 -- # local es=0 00:29:19.288 03:29:53 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:29:19.288 03:29:53 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:29:19.288 03:29:53 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:29:19.288 03:29:53 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:29:19.288 03:29:53 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:29:19.288 03:29:53 -- common/autotest_common.sh@641 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:29:19.288 03:29:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:19.288 03:29:53 -- common/autotest_common.sh@10 -- # set +x 00:29:19.288 request: 00:29:19.288 { 00:29:19.288 "name": "nvme0", 00:29:19.288 "trtype": "rdma", 00:29:19.288 "traddr": "192.168.100.8", 00:29:19.288 "hostnqn": "nqn.2024-02.io.spdk:host0", 00:29:19.288 "adrfam": "ipv4", 00:29:19.288 "trsvcid": "4420", 00:29:19.288 "subnqn": "nqn.2024-02.io.spdk:cnode0", 00:29:19.288 "method": "bdev_nvme_attach_controller", 00:29:19.288 "req_id": 1 00:29:19.288 } 00:29:19.288 Got JSON-RPC error response 00:29:19.288 response: 00:29:19.288 { 00:29:19.288 "code": -32602, 00:29:19.288 "message": "Invalid parameters" 00:29:19.288 } 00:29:19.288 03:29:53 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:29:19.288 03:29:53 -- common/autotest_common.sh@641 -- # es=1 00:29:19.288 03:29:53 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:29:19.288 03:29:53 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:29:19.288 03:29:53 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:29:19.288 03:29:53 -- host/auth.sh@121 -- # rpc_cmd bdev_nvme_get_controllers 00:29:19.288 03:29:53 -- host/auth.sh@121 -- # jq length 00:29:19.288 03:29:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:19.288 03:29:53 -- common/autotest_common.sh@10 -- # set +x 00:29:19.288 03:29:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:19.288 03:29:53 -- host/auth.sh@121 -- # (( 0 == 0 )) 00:29:19.288 03:29:53 -- host/auth.sh@124 -- # get_main_ns_ip 00:29:19.288 03:29:53 -- nvmf/common.sh@717 -- # local ip 00:29:19.288 03:29:53 -- nvmf/common.sh@718 -- # ip_candidates=() 00:29:19.288 03:29:53 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:29:19.288 03:29:53 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:29:19.288 03:29:53 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:29:19.288 03:29:53 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:29:19.288 03:29:53 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:29:19.288 03:29:53 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:29:19.288 03:29:53 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:29:19.289 03:29:53 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:29:19.289 03:29:53 -- host/auth.sh@124 -- # NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:29:19.289 03:29:53 -- common/autotest_common.sh@638 -- # local es=0 00:29:19.289 03:29:53 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:29:19.289 03:29:53 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:29:19.289 03:29:53 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:29:19.289 03:29:53 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:29:19.289 03:29:53 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:29:19.289 03:29:53 -- common/autotest_common.sh@641 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:29:19.289 03:29:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:19.289 03:29:53 -- common/autotest_common.sh@10 -- # set +x 00:29:19.549 request: 00:29:19.549 { 00:29:19.549 "name": "nvme0", 00:29:19.549 "trtype": "rdma", 00:29:19.549 "traddr": "192.168.100.8", 00:29:19.549 "hostnqn": "nqn.2024-02.io.spdk:host0", 00:29:19.549 "adrfam": "ipv4", 00:29:19.549 "trsvcid": "4420", 00:29:19.549 "subnqn": "nqn.2024-02.io.spdk:cnode0", 00:29:19.549 "dhchap_key": "key2", 00:29:19.549 "method": "bdev_nvme_attach_controller", 00:29:19.549 "req_id": 1 00:29:19.549 } 00:29:19.549 Got JSON-RPC error response 00:29:19.549 response: 00:29:19.549 { 00:29:19.549 "code": -32602, 00:29:19.549 "message": "Invalid parameters" 00:29:19.549 } 00:29:19.549 03:29:53 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:29:19.549 03:29:53 -- common/autotest_common.sh@641 -- # es=1 00:29:19.549 03:29:53 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:29:19.549 03:29:53 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:29:19.549 03:29:53 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:29:19.549 03:29:53 -- host/auth.sh@127 -- # rpc_cmd bdev_nvme_get_controllers 00:29:19.549 03:29:53 -- host/auth.sh@127 -- # jq length 00:29:19.549 03:29:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:19.549 03:29:53 -- common/autotest_common.sh@10 -- # set +x 00:29:19.549 03:29:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:19.549 03:29:53 -- host/auth.sh@127 -- # (( 0 == 0 )) 00:29:19.549 03:29:53 -- host/auth.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:29:19.549 03:29:53 -- host/auth.sh@130 -- # cleanup 00:29:19.549 03:29:53 -- host/auth.sh@24 -- # nvmftestfini 00:29:19.549 03:29:53 -- nvmf/common.sh@477 -- # nvmfcleanup 00:29:19.549 03:29:53 -- nvmf/common.sh@117 -- # sync 00:29:19.549 03:29:53 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:29:19.550 03:29:53 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:29:19.550 03:29:53 -- nvmf/common.sh@120 -- # set +e 00:29:19.550 03:29:53 -- nvmf/common.sh@121 -- # for i in {1..20} 00:29:19.550 03:29:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:29:19.550 rmmod nvme_rdma 00:29:19.550 rmmod nvme_fabrics 00:29:19.550 03:29:53 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:29:19.550 03:29:53 -- nvmf/common.sh@124 -- # set -e 00:29:19.550 03:29:53 -- nvmf/common.sh@125 -- # return 0 00:29:19.550 03:29:53 -- nvmf/common.sh@478 -- # '[' -n 55318 ']' 00:29:19.550 03:29:53 -- nvmf/common.sh@479 -- # killprocess 55318 00:29:19.550 03:29:53 -- common/autotest_common.sh@936 -- # '[' -z 55318 ']' 00:29:19.550 03:29:53 -- common/autotest_common.sh@940 -- # kill -0 55318 00:29:19.550 03:29:53 -- common/autotest_common.sh@941 -- # uname 00:29:19.550 03:29:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:19.550 03:29:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 55318 00:29:19.550 03:29:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:19.550 03:29:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:19.550 03:29:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 55318' 00:29:19.550 killing process with pid 55318 00:29:19.550 03:29:53 -- common/autotest_common.sh@955 -- # kill 55318 00:29:19.550 03:29:53 -- common/autotest_common.sh@960 -- # wait 55318 00:29:19.840 03:29:54 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:29:19.841 03:29:54 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:29:19.841 03:29:54 -- host/auth.sh@25 -- # rm /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/allowed_hosts/nqn.2024-02.io.spdk:host0 00:29:19.841 03:29:54 -- host/auth.sh@26 -- # rmdir /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:29:19.841 03:29:54 -- host/auth.sh@27 -- # clean_kernel_target 00:29:19.841 03:29:54 -- nvmf/common.sh@673 -- # [[ -e /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 ]] 00:29:19.841 03:29:54 -- nvmf/common.sh@675 -- # echo 0 00:29:19.841 03:29:54 -- nvmf/common.sh@677 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/nqn.2024-02.io.spdk:cnode0 00:29:19.841 03:29:54 -- nvmf/common.sh@678 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:29:19.841 03:29:54 -- nvmf/common.sh@679 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:29:19.841 03:29:54 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:29:19.841 03:29:54 -- nvmf/common.sh@682 -- # modules=(/sys/module/nvmet/holders/*) 00:29:19.841 03:29:54 -- nvmf/common.sh@684 -- # modprobe -r nvmet_rdma nvmet 00:29:19.841 03:29:54 -- nvmf/common.sh@687 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh 00:29:22.376 0000:5f:00.0 (1b96 2600): Skipping denied controller at 0000:5f:00.0 00:29:22.376 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:29:22.376 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:29:22.376 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:29:22.376 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:29:22.376 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:29:22.377 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:29:22.377 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:29:22.636 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:29:22.636 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:29:22.636 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:29:22.636 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:29:22.636 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:29:22.636 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:29:22.636 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:29:22.636 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:29:22.636 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:29:23.573 0000:5e:00.0 (8086 0a54): nvme -> vfio-pci 00:29:23.573 03:29:57 -- host/auth.sh@28 -- # rm -f /tmp/spdk.key-null.1JM /tmp/spdk.key-null.ef2 /tmp/spdk.key-sha256.GFB /tmp/spdk.key-sha384.Xoq /tmp/spdk.key-sha512.L6a /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/nvme-auth.log 00:29:23.573 03:29:57 -- host/auth.sh@31 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh 00:29:26.109 0000:5f:00.0 (1b96 2600): Skipping denied controller at 0000:5f:00.0 00:29:26.367 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:29:26.367 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:29:26.367 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:29:26.367 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:29:26.367 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:29:26.367 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:29:26.367 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:29:26.367 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:29:26.367 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:29:26.367 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:29:26.367 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:29:26.367 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:29:26.367 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:29:26.367 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:29:26.367 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:29:26.367 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:29:26.367 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:29:26.626 00:29:26.626 real 0m53.049s 00:29:26.626 user 0m48.273s 00:29:26.626 sys 0m12.655s 00:29:26.626 03:30:00 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:29:26.626 03:30:00 -- common/autotest_common.sh@10 -- # set +x 00:29:26.626 ************************************ 00:29:26.626 END TEST nvmf_auth 00:29:26.626 ************************************ 00:29:26.626 03:30:00 -- nvmf/nvmf.sh@104 -- # [[ rdma == \t\c\p ]] 00:29:26.626 03:30:00 -- nvmf/nvmf.sh@108 -- # [[ 0 -eq 1 ]] 00:29:26.626 03:30:00 -- nvmf/nvmf.sh@113 -- # [[ 0 -eq 1 ]] 00:29:26.626 03:30:00 -- nvmf/nvmf.sh@118 -- # [[ phy == phy ]] 00:29:26.626 03:30:00 -- nvmf/nvmf.sh@119 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=rdma 00:29:26.626 03:30:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:26.626 03:30:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:26.626 03:30:00 -- common/autotest_common.sh@10 -- # set +x 00:29:26.626 ************************************ 00:29:26.626 START TEST nvmf_bdevperf 00:29:26.626 ************************************ 00:29:26.626 03:30:01 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=rdma 00:29:26.884 * Looking for test storage... 00:29:26.884 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host 00:29:26.885 03:30:01 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:29:26.885 03:30:01 -- nvmf/common.sh@7 -- # uname -s 00:29:26.885 03:30:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:26.885 03:30:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:26.885 03:30:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:26.885 03:30:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:26.885 03:30:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:26.885 03:30:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:26.885 03:30:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:26.885 03:30:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:26.885 03:30:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:26.885 03:30:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:26.885 03:30:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:29:26.885 03:30:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:29:26.885 03:30:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:26.885 03:30:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:26.885 03:30:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:26.885 03:30:01 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:29:26.885 03:30:01 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:29:26.885 03:30:01 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:26.885 03:30:01 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:26.885 03:30:01 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:26.885 03:30:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:26.885 03:30:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:26.885 03:30:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:26.885 03:30:01 -- paths/export.sh@5 -- # export PATH 00:29:26.885 03:30:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:26.885 03:30:01 -- nvmf/common.sh@47 -- # : 0 00:29:26.885 03:30:01 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:29:26.885 03:30:01 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:29:26.885 03:30:01 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:29:26.885 03:30:01 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:26.885 03:30:01 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:26.885 03:30:01 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:29:26.885 03:30:01 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:29:26.885 03:30:01 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:29:26.885 03:30:01 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:29:26.885 03:30:01 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:29:26.885 03:30:01 -- host/bdevperf.sh@24 -- # nvmftestinit 00:29:26.885 03:30:01 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:29:26.885 03:30:01 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:26.885 03:30:01 -- nvmf/common.sh@437 -- # prepare_net_devs 00:29:26.885 03:30:01 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:29:26.885 03:30:01 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:29:26.885 03:30:01 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:26.885 03:30:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:26.885 03:30:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:26.885 03:30:01 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:29:26.885 03:30:01 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:29:26.885 03:30:01 -- nvmf/common.sh@285 -- # xtrace_disable 00:29:26.885 03:30:01 -- common/autotest_common.sh@10 -- # set +x 00:29:33.446 03:30:07 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:33.446 03:30:07 -- nvmf/common.sh@291 -- # pci_devs=() 00:29:33.446 03:30:07 -- nvmf/common.sh@291 -- # local -a pci_devs 00:29:33.446 03:30:07 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:29:33.446 03:30:07 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:29:33.446 03:30:07 -- nvmf/common.sh@293 -- # pci_drivers=() 00:29:33.446 03:30:07 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:29:33.446 03:30:07 -- nvmf/common.sh@295 -- # net_devs=() 00:29:33.446 03:30:07 -- nvmf/common.sh@295 -- # local -ga net_devs 00:29:33.446 03:30:07 -- nvmf/common.sh@296 -- # e810=() 00:29:33.446 03:30:07 -- nvmf/common.sh@296 -- # local -ga e810 00:29:33.446 03:30:07 -- nvmf/common.sh@297 -- # x722=() 00:29:33.446 03:30:07 -- nvmf/common.sh@297 -- # local -ga x722 00:29:33.446 03:30:07 -- nvmf/common.sh@298 -- # mlx=() 00:29:33.446 03:30:07 -- nvmf/common.sh@298 -- # local -ga mlx 00:29:33.446 03:30:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:33.446 03:30:07 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:33.446 03:30:07 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:33.446 03:30:07 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:33.446 03:30:07 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:33.446 03:30:07 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:33.446 03:30:07 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:33.446 03:30:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:33.446 03:30:07 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:33.446 03:30:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:33.446 03:30:07 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:33.446 03:30:07 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:29:33.446 03:30:07 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:29:33.446 03:30:07 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:29:33.446 03:30:07 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:29:33.446 03:30:07 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:29:33.446 03:30:07 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:29:33.446 03:30:07 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:29:33.446 03:30:07 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:29:33.446 03:30:07 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:29:33.446 03:30:07 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:29:33.446 Found 0000:af:00.0 (0x8086 - 0x159b) 00:29:33.446 03:30:07 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:29:33.446 03:30:07 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:29:33.446 03:30:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:33.446 03:30:07 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:33.446 03:30:07 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:29:33.446 03:30:07 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:29:33.446 03:30:07 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:29:33.446 03:30:07 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:29:33.446 Found 0000:af:00.1 (0x8086 - 0x159b) 00:29:33.446 03:30:07 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:29:33.446 03:30:07 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:29:33.446 03:30:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:33.446 03:30:07 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:33.446 03:30:07 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:29:33.446 03:30:07 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:29:33.446 03:30:07 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:29:33.446 03:30:07 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:29:33.446 03:30:07 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:29:33.446 03:30:07 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:29:33.446 03:30:07 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:29:33.446 03:30:07 -- nvmf/common.sh@377 -- # modinfo irdma 00:29:33.446 03:30:07 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:29:33.446 03:30:07 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:29:33.446 03:30:07 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:33.446 03:30:07 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:29:33.446 03:30:07 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:33.446 03:30:07 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:29:33.446 Found net devices under 0000:af:00.0: cvl_0_0 00:29:33.446 03:30:07 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:29:33.446 03:30:07 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:29:33.446 03:30:07 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:33.446 03:30:07 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:29:33.446 03:30:07 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:33.446 03:30:07 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:29:33.446 Found net devices under 0000:af:00.1: cvl_0_1 00:29:33.446 03:30:07 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:29:33.446 03:30:07 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:29:33.446 03:30:07 -- nvmf/common.sh@403 -- # is_hw=yes 00:29:33.446 03:30:07 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:29:33.446 03:30:07 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:29:33.446 03:30:07 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:29:33.446 03:30:07 -- nvmf/common.sh@409 -- # rdma_device_init 00:29:33.446 03:30:07 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:29:33.446 03:30:07 -- nvmf/common.sh@58 -- # uname 00:29:33.446 03:30:07 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:29:33.446 03:30:07 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:29:33.446 03:30:07 -- nvmf/common.sh@63 -- # modprobe ib_core 00:29:33.446 03:30:07 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:29:33.446 03:30:07 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:29:33.446 03:30:07 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:29:33.446 03:30:07 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:29:33.446 03:30:07 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:29:33.446 03:30:07 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:29:33.446 03:30:07 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:29:33.446 03:30:07 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:29:33.446 03:30:07 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:29:33.446 03:30:07 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:29:33.446 03:30:07 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:29:33.446 03:30:07 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:29:33.446 03:30:07 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:29:33.446 03:30:07 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:29:33.446 03:30:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:29:33.446 03:30:07 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:29:33.446 03:30:07 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:29:33.446 03:30:07 -- nvmf/common.sh@105 -- # continue 2 00:29:33.446 03:30:07 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:29:33.446 03:30:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:29:33.446 03:30:07 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:29:33.446 03:30:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:29:33.446 03:30:07 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:29:33.446 03:30:07 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:29:33.446 03:30:07 -- nvmf/common.sh@105 -- # continue 2 00:29:33.446 03:30:07 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:29:33.446 03:30:07 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:29:33.446 03:30:07 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:29:33.446 03:30:07 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:29:33.446 03:30:07 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:29:33.446 03:30:07 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:29:33.446 03:30:07 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:29:33.446 03:30:07 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:29:33.446 03:30:07 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:29:33.446 50: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:29:33.446 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:29:33.446 altname enp175s0f0np0 00:29:33.446 altname ens801f0np0 00:29:33.446 inet 192.168.100.8/24 scope global cvl_0_0 00:29:33.446 valid_lft forever preferred_lft forever 00:29:33.446 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:29:33.446 valid_lft forever preferred_lft forever 00:29:33.446 03:30:07 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:29:33.446 03:30:07 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:29:33.446 03:30:07 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:29:33.446 03:30:07 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:29:33.446 03:30:07 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:29:33.446 03:30:07 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:29:33.446 03:30:07 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:29:33.446 03:30:07 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:29:33.447 03:30:07 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:29:33.447 51: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:29:33.447 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:29:33.447 altname enp175s0f1np1 00:29:33.447 altname ens801f1np1 00:29:33.447 inet 192.168.100.9/24 scope global cvl_0_1 00:29:33.447 valid_lft forever preferred_lft forever 00:29:33.447 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:29:33.447 valid_lft forever preferred_lft forever 00:29:33.447 03:30:07 -- nvmf/common.sh@411 -- # return 0 00:29:33.447 03:30:07 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:29:33.447 03:30:07 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:29:33.447 03:30:07 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:29:33.447 03:30:07 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:29:33.447 03:30:07 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:29:33.447 03:30:07 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:29:33.447 03:30:07 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:29:33.447 03:30:07 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:29:33.447 03:30:07 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:29:33.447 03:30:07 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:29:33.447 03:30:07 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:29:33.447 03:30:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:29:33.447 03:30:07 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:29:33.447 03:30:07 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:29:33.447 03:30:07 -- nvmf/common.sh@105 -- # continue 2 00:29:33.447 03:30:07 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:29:33.447 03:30:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:29:33.447 03:30:07 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:29:33.447 03:30:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:29:33.447 03:30:07 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:29:33.447 03:30:07 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:29:33.447 03:30:07 -- nvmf/common.sh@105 -- # continue 2 00:29:33.447 03:30:07 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:29:33.447 03:30:07 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:29:33.447 03:30:07 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:29:33.447 03:30:07 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:29:33.447 03:30:07 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:29:33.447 03:30:07 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:29:33.447 03:30:07 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:29:33.447 03:30:07 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:29:33.447 03:30:07 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:29:33.447 03:30:07 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:29:33.447 03:30:07 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:29:33.447 03:30:07 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:29:33.447 03:30:07 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:29:33.447 192.168.100.9' 00:29:33.447 03:30:07 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:29:33.447 192.168.100.9' 00:29:33.447 03:30:07 -- nvmf/common.sh@446 -- # head -n 1 00:29:33.447 03:30:07 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:29:33.447 03:30:07 -- nvmf/common.sh@447 -- # head -n 1 00:29:33.447 03:30:07 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:29:33.447 192.168.100.9' 00:29:33.447 03:30:07 -- nvmf/common.sh@447 -- # tail -n +2 00:29:33.447 03:30:07 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:29:33.447 03:30:07 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:29:33.447 03:30:07 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:29:33.447 03:30:07 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:29:33.447 03:30:07 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:29:33.447 03:30:07 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:29:33.447 03:30:07 -- host/bdevperf.sh@25 -- # tgt_init 00:29:33.447 03:30:07 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:29:33.447 03:30:07 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:29:33.447 03:30:07 -- common/autotest_common.sh@710 -- # xtrace_disable 00:29:33.447 03:30:07 -- common/autotest_common.sh@10 -- # set +x 00:29:33.447 03:30:07 -- nvmf/common.sh@470 -- # nvmfpid=69660 00:29:33.447 03:30:07 -- nvmf/common.sh@471 -- # waitforlisten 69660 00:29:33.447 03:30:07 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:29:33.447 03:30:07 -- common/autotest_common.sh@817 -- # '[' -z 69660 ']' 00:29:33.447 03:30:07 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:33.447 03:30:07 -- common/autotest_common.sh@822 -- # local max_retries=100 00:29:33.447 03:30:07 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:33.447 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:33.447 03:30:07 -- common/autotest_common.sh@826 -- # xtrace_disable 00:29:33.447 03:30:07 -- common/autotest_common.sh@10 -- # set +x 00:29:33.447 [2024-04-25 03:30:07.269007] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:29:33.447 [2024-04-25 03:30:07.269050] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:33.447 EAL: No free 2048 kB hugepages reported on node 1 00:29:33.447 [2024-04-25 03:30:07.328459] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:29:33.447 [2024-04-25 03:30:07.405089] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:33.447 [2024-04-25 03:30:07.405122] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:33.447 [2024-04-25 03:30:07.405129] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:29:33.447 [2024-04-25 03:30:07.405135] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:29:33.447 [2024-04-25 03:30:07.405140] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:33.447 [2024-04-25 03:30:07.405178] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:33.447 [2024-04-25 03:30:07.405264] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:33.447 [2024-04-25 03:30:07.405265] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:33.705 03:30:08 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:29:33.705 03:30:08 -- common/autotest_common.sh@850 -- # return 0 00:29:33.705 03:30:08 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:29:33.705 03:30:08 -- common/autotest_common.sh@716 -- # xtrace_disable 00:29:33.705 03:30:08 -- common/autotest_common.sh@10 -- # set +x 00:29:33.705 03:30:08 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:33.705 03:30:08 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:29:33.705 03:30:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:33.705 03:30:08 -- common/autotest_common.sh@10 -- # set +x 00:29:33.705 [2024-04-25 03:30:08.149986] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x1fb05c0/0x1fafc00) succeed. 00:29:33.705 [2024-04-25 03:30:08.159888] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x1fb18f0/0x1fb0180) succeed. 00:29:33.705 [2024-04-25 03:30:08.159910] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:29:33.705 03:30:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:33.705 03:30:08 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:29:33.705 03:30:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:33.705 03:30:08 -- common/autotest_common.sh@10 -- # set +x 00:29:33.705 Malloc0 00:29:33.962 03:30:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:33.962 03:30:08 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:29:33.962 03:30:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:33.962 03:30:08 -- common/autotest_common.sh@10 -- # set +x 00:29:33.962 03:30:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:33.962 03:30:08 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:29:33.962 03:30:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:33.962 03:30:08 -- common/autotest_common.sh@10 -- # set +x 00:29:33.962 03:30:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:33.962 03:30:08 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:29:33.962 03:30:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:33.962 03:30:08 -- common/autotest_common.sh@10 -- # set +x 00:29:33.962 [2024-04-25 03:30:08.227468] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:29:33.962 03:30:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:33.962 03:30:08 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:29:33.962 03:30:08 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:29:33.962 03:30:08 -- nvmf/common.sh@521 -- # config=() 00:29:33.962 03:30:08 -- nvmf/common.sh@521 -- # local subsystem config 00:29:33.963 03:30:08 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:29:33.963 03:30:08 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:29:33.963 { 00:29:33.963 "params": { 00:29:33.963 "name": "Nvme$subsystem", 00:29:33.963 "trtype": "$TEST_TRANSPORT", 00:29:33.963 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:33.963 "adrfam": "ipv4", 00:29:33.963 "trsvcid": "$NVMF_PORT", 00:29:33.963 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:33.963 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:33.963 "hdgst": ${hdgst:-false}, 00:29:33.963 "ddgst": ${ddgst:-false} 00:29:33.963 }, 00:29:33.963 "method": "bdev_nvme_attach_controller" 00:29:33.963 } 00:29:33.963 EOF 00:29:33.963 )") 00:29:33.963 03:30:08 -- nvmf/common.sh@543 -- # cat 00:29:33.963 03:30:08 -- nvmf/common.sh@545 -- # jq . 00:29:33.963 03:30:08 -- nvmf/common.sh@546 -- # IFS=, 00:29:33.963 03:30:08 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:29:33.963 "params": { 00:29:33.963 "name": "Nvme1", 00:29:33.963 "trtype": "rdma", 00:29:33.963 "traddr": "192.168.100.8", 00:29:33.963 "adrfam": "ipv4", 00:29:33.963 "trsvcid": "4420", 00:29:33.963 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:33.963 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:33.963 "hdgst": false, 00:29:33.963 "ddgst": false 00:29:33.963 }, 00:29:33.963 "method": "bdev_nvme_attach_controller" 00:29:33.963 }' 00:29:33.963 [2024-04-25 03:30:08.276508] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:29:33.963 [2024-04-25 03:30:08.276548] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid70020 ] 00:29:33.963 EAL: No free 2048 kB hugepages reported on node 1 00:29:33.963 [2024-04-25 03:30:08.335614] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:33.963 [2024-04-25 03:30:08.405940] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:34.220 Running I/O for 1 seconds... 00:29:35.153 00:29:35.153 Latency(us) 00:29:35.153 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:35.153 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:29:35.153 Verification LBA range: start 0x0 length 0x4000 00:29:35.153 Nvme1n1 : 1.00 18372.24 71.77 0.00 0.00 6928.66 2278.16 12607.88 00:29:35.153 =================================================================================================================== 00:29:35.153 Total : 18372.24 71.77 0.00 0.00 6928.66 2278.16 12607.88 00:29:35.411 03:30:09 -- host/bdevperf.sh@30 -- # bdevperfpid=70496 00:29:35.411 03:30:09 -- host/bdevperf.sh@32 -- # sleep 3 00:29:35.411 03:30:09 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:29:35.411 03:30:09 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:29:35.411 03:30:09 -- nvmf/common.sh@521 -- # config=() 00:29:35.411 03:30:09 -- nvmf/common.sh@521 -- # local subsystem config 00:29:35.411 03:30:09 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:29:35.411 03:30:09 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:29:35.411 { 00:29:35.411 "params": { 00:29:35.411 "name": "Nvme$subsystem", 00:29:35.411 "trtype": "$TEST_TRANSPORT", 00:29:35.411 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:35.411 "adrfam": "ipv4", 00:29:35.411 "trsvcid": "$NVMF_PORT", 00:29:35.411 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:35.411 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:35.411 "hdgst": ${hdgst:-false}, 00:29:35.411 "ddgst": ${ddgst:-false} 00:29:35.411 }, 00:29:35.411 "method": "bdev_nvme_attach_controller" 00:29:35.411 } 00:29:35.411 EOF 00:29:35.411 )") 00:29:35.411 03:30:09 -- nvmf/common.sh@543 -- # cat 00:29:35.411 03:30:09 -- nvmf/common.sh@545 -- # jq . 00:29:35.411 03:30:09 -- nvmf/common.sh@546 -- # IFS=, 00:29:35.411 03:30:09 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:29:35.411 "params": { 00:29:35.411 "name": "Nvme1", 00:29:35.411 "trtype": "rdma", 00:29:35.411 "traddr": "192.168.100.8", 00:29:35.411 "adrfam": "ipv4", 00:29:35.411 "trsvcid": "4420", 00:29:35.411 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:35.411 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:35.411 "hdgst": false, 00:29:35.411 "ddgst": false 00:29:35.411 }, 00:29:35.411 "method": "bdev_nvme_attach_controller" 00:29:35.411 }' 00:29:35.411 [2024-04-25 03:30:09.843866] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:29:35.411 [2024-04-25 03:30:09.843917] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid70496 ] 00:29:35.411 EAL: No free 2048 kB hugepages reported on node 1 00:29:35.411 [2024-04-25 03:30:09.904248] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:35.669 [2024-04-25 03:30:09.970932] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:35.669 Running I/O for 15 seconds... 00:29:38.951 03:30:12 -- host/bdevperf.sh@33 -- # kill -9 69660 00:29:38.951 03:30:12 -- host/bdevperf.sh@35 -- # sleep 3 00:29:38.951 [2024-04-25 03:30:13.342878] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:29:38.951 [2024-04-25 03:30:13.342915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:3816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.342926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.342956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:3824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.342964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.342972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:3832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.342979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.342987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:3840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.342994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.343006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:3848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.343013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.343021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:3856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.343027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.343035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:3864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.343042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.343050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:3872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.343057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.343065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:3880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.343072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.343080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:3888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.343087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.343094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:3896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.343101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.343109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:3904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.343116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.343124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:3912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.343130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.343138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:3920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.343144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.343152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:3928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.343159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.343167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:3936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.343173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.343181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:3944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.343190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.343198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:3952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.343204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.343213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:3960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.343219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.343228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:3968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.343234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.343242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:3976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.343248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.343256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:3984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.343263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.343272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.343279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.343287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:4000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.343294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.343302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:4008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.343308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.343317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:4016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.343323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.343331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:4024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.343337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.343345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:4032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.343351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.343359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:4040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.343366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.343375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:4048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.343382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.343389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:4056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.951 [2024-04-25 03:30:13.343396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.951 [2024-04-25 03:30:13.343403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:4064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.952 [2024-04-25 03:30:13.343410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:4072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.952 [2024-04-25 03:30:13.343424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:4080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.952 [2024-04-25 03:30:13.343438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:4088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.952 [2024-04-25 03:30:13.343453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:3072 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fe000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:3080 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fc000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:3088 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fa000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:3096 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f8000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3104 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f6000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:3112 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f4000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:3120 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f2000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:3128 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f0000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:3136 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ee000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:3144 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ec000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:3152 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ea000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:3160 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e8000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:3168 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e6000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3176 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e4000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:3184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e2000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:3192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e0000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:3200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075de000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:3208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075dc000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:3216 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075da000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:3224 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d8000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:3232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d6000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:3240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d4000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:3248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d2000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:3256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d0000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:3264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ce000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:3272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075cc000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:3280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ca000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:3288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c8000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.952 [2024-04-25 03:30:13.343875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:3296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c6000 len:0x1000 key:0x8e3e6db4 00:29:38.952 [2024-04-25 03:30:13.343881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.343890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:3304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c4000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.343897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.343906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:3312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c2000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.343913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.343921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:3320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c0000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.343927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.343935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:3328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075be000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.343942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.343950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:3336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075bc000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.343957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.343965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ba000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.343972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.343980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:3352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b8000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.343986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.343994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:3360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b6000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:3368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b4000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:3376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b2000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:3384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b0000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:3392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ae000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:3400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ac000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:3408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075aa000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:3416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a8000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:3424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a6000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:3432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a4000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:3440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a2000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:3448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a0000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:3456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759e000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:3464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759c000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759a000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:3480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007598000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:3488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007596000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:3496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007594000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:3504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007592000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:3512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007590000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:3520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758e000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:3528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758c000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:3536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758a000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007588000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:3552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007586000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:3560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007584000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007582000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:3576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007580000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:3584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757e000 len:0x1000 key:0x8e3e6db4 00:29:38.953 [2024-04-25 03:30:13.344411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.953 [2024-04-25 03:30:13.344419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:3592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757c000 len:0x1000 key:0x8e3e6db4 00:29:38.954 [2024-04-25 03:30:13.344426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.344434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:3600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757a000 len:0x1000 key:0x8e3e6db4 00:29:38.954 [2024-04-25 03:30:13.344441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.344449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:3608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007578000 len:0x1000 key:0x8e3e6db4 00:29:38.954 [2024-04-25 03:30:13.344455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.344463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:3616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007576000 len:0x1000 key:0x8e3e6db4 00:29:38.954 [2024-04-25 03:30:13.344469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.344478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:3624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007574000 len:0x1000 key:0x8e3e6db4 00:29:38.954 [2024-04-25 03:30:13.344484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.344492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:3632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007572000 len:0x1000 key:0x8e3e6db4 00:29:38.954 [2024-04-25 03:30:13.344499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.344507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007570000 len:0x1000 key:0x8e3e6db4 00:29:38.954 [2024-04-25 03:30:13.344513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.344521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:3648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756e000 len:0x1000 key:0x8e3e6db4 00:29:38.954 [2024-04-25 03:30:13.344527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.344536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:3656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756c000 len:0x1000 key:0x8e3e6db4 00:29:38.954 [2024-04-25 03:30:13.344543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.344551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:3664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756a000 len:0x1000 key:0x8e3e6db4 00:29:38.954 [2024-04-25 03:30:13.344557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.344565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:3672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007568000 len:0x1000 key:0x8e3e6db4 00:29:38.954 [2024-04-25 03:30:13.344572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.344579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:3680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007566000 len:0x1000 key:0x8e3e6db4 00:29:38.954 [2024-04-25 03:30:13.344586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.344594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:3688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007564000 len:0x1000 key:0x8e3e6db4 00:29:38.954 [2024-04-25 03:30:13.344600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.344608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:3696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007562000 len:0x1000 key:0x8e3e6db4 00:29:38.954 [2024-04-25 03:30:13.344614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.344622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:3704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007560000 len:0x1000 key:0x8e3e6db4 00:29:38.954 [2024-04-25 03:30:13.344628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.344637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:3712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755e000 len:0x1000 key:0x8e3e6db4 00:29:38.954 [2024-04-25 03:30:13.344643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.344651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:3720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755c000 len:0x1000 key:0x8e3e6db4 00:29:38.954 [2024-04-25 03:30:13.344658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.344665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:3728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755a000 len:0x1000 key:0x8e3e6db4 00:29:38.954 [2024-04-25 03:30:13.344672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.344679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:3736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007558000 len:0x1000 key:0x8e3e6db4 00:29:38.954 [2024-04-25 03:30:13.344686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.344694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:3744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007556000 len:0x1000 key:0x8e3e6db4 00:29:38.954 [2024-04-25 03:30:13.344702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.344710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:3752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007554000 len:0x1000 key:0x8e3e6db4 00:29:38.954 [2024-04-25 03:30:13.344716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.353773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:3760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007552000 len:0x1000 key:0x8e3e6db4 00:29:38.954 [2024-04-25 03:30:13.353783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.353792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:3768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007550000 len:0x1000 key:0x8e3e6db4 00:29:38.954 [2024-04-25 03:30:13.353799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.353806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:3776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754e000 len:0x1000 key:0x8e3e6db4 00:29:38.954 [2024-04-25 03:30:13.353813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.353821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:3784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754c000 len:0x1000 key:0x8e3e6db4 00:29:38.954 [2024-04-25 03:30:13.353827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.353834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:3792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754a000 len:0x1000 key:0x8e3e6db4 00:29:38.954 [2024-04-25 03:30:13.353840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.353848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:3800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007548000 len:0x1000 key:0x8e3e6db4 00:29:38.954 [2024-04-25 03:30:13.353864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:1050610 sqhd:4a00 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.354145] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:29:38.954 [2024-04-25 03:30:13.354155] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:29:38.954 [2024-04-25 03:30:13.354162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3808 len:8 PRP1 0x0 PRP2 0x0 00:29:38.954 [2024-04-25 03:30:13.354168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.354204] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4a00 was disconnected and freed. reset controller. 00:29:38.954 [2024-04-25 03:30:13.354230] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:29:38.954 [2024-04-25 03:30:13.354240] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:38.954 [2024-04-25 03:30:13.354247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:10166f0 sqhd:d080 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.354255] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:38.954 [2024-04-25 03:30:13.354263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:10166f0 sqhd:d080 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.354270] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:38.954 [2024-04-25 03:30:13.354277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:10166f0 sqhd:d080 p:0 m:0 dnr:0 00:29:38.954 [2024-04-25 03:30:13.354284] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:38.954 [2024-04-25 03:30:13.354290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:10166f0 sqhd:d080 p:0 m:0 dnr:0 00:29:38.955 [2024-04-25 03:30:13.369477] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:29:38.955 [2024-04-25 03:30:13.369494] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.955 [2024-04-25 03:30:13.369501] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:29:38.955 [2024-04-25 03:30:13.372145] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.955 [2024-04-25 03:30:13.375512] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:29:38.955 [2024-04-25 03:30:13.375532] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:29:38.955 [2024-04-25 03:30:13.375538] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:29:39.890 [2024-04-25 03:30:14.378305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:29:39.890 [2024-04-25 03:30:14.378328] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.890 [2024-04-25 03:30:14.378511] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.890 [2024-04-25 03:30:14.378519] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.890 [2024-04-25 03:30:14.378527] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:29:39.890 [2024-04-25 03:30:14.381192] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.890 [2024-04-25 03:30:14.386432] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:40.148 [2024-04-25 03:30:14.389523] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:29:40.148 [2024-04-25 03:30:14.389541] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:29:40.148 [2024-04-25 03:30:14.389547] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:29:41.084 [2024-04-25 03:30:15.392374] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:29:41.084 [2024-04-25 03:30:15.392391] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:41.084 [2024-04-25 03:30:15.392552] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:41.084 [2024-04-25 03:30:15.392559] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:41.085 [2024-04-25 03:30:15.392566] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:29:41.085 [2024-04-25 03:30:15.395306] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:41.085 [2024-04-25 03:30:15.398997] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:41.085 [2024-04-25 03:30:15.402123] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:29:41.085 [2024-04-25 03:30:15.402141] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:29:41.085 [2024-04-25 03:30:15.402146] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:29:41.345 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 69660 Killed "${NVMF_APP[@]}" "$@" 00:29:41.345 03:30:15 -- host/bdevperf.sh@36 -- # tgt_init 00:29:41.345 03:30:15 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:29:41.345 03:30:15 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:29:41.345 03:30:15 -- common/autotest_common.sh@710 -- # xtrace_disable 00:29:41.345 03:30:15 -- common/autotest_common.sh@10 -- # set +x 00:29:41.345 03:30:15 -- nvmf/common.sh@470 -- # nvmfpid=71433 00:29:41.345 03:30:15 -- nvmf/common.sh@471 -- # waitforlisten 71433 00:29:41.345 03:30:15 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:29:41.345 03:30:15 -- common/autotest_common.sh@817 -- # '[' -z 71433 ']' 00:29:41.345 03:30:15 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:41.345 03:30:15 -- common/autotest_common.sh@822 -- # local max_retries=100 00:29:41.345 03:30:15 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:41.345 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:41.345 03:30:15 -- common/autotest_common.sh@826 -- # xtrace_disable 00:29:41.345 03:30:15 -- common/autotest_common.sh@10 -- # set +x 00:29:41.621 [2024-04-25 03:30:15.861285] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:29:41.621 [2024-04-25 03:30:15.861326] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:41.621 EAL: No free 2048 kB hugepages reported on node 1 00:29:41.621 [2024-04-25 03:30:15.921013] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:29:41.621 [2024-04-25 03:30:15.996687] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:41.621 [2024-04-25 03:30:15.996722] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:41.621 [2024-04-25 03:30:15.996729] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:29:41.621 [2024-04-25 03:30:15.996735] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:29:41.621 [2024-04-25 03:30:15.996740] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:41.621 [2024-04-25 03:30:15.996781] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:41.621 [2024-04-25 03:30:15.996843] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:41.621 [2024-04-25 03:30:15.996844] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:42.200 [2024-04-25 03:30:16.404964] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:29:42.200 [2024-04-25 03:30:16.404997] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:42.200 [2024-04-25 03:30:16.405174] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:42.200 [2024-04-25 03:30:16.405184] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:42.200 [2024-04-25 03:30:16.405192] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:29:42.200 [2024-04-25 03:30:16.407930] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:42.200 [2024-04-25 03:30:16.412608] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:42.200 [2024-04-25 03:30:16.415690] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:29:42.200 [2024-04-25 03:30:16.415711] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:29:42.200 [2024-04-25 03:30:16.415717] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:29:42.200 03:30:16 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:29:42.200 03:30:16 -- common/autotest_common.sh@850 -- # return 0 00:29:42.200 03:30:16 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:29:42.200 03:30:16 -- common/autotest_common.sh@716 -- # xtrace_disable 00:29:42.200 03:30:16 -- common/autotest_common.sh@10 -- # set +x 00:29:42.458 03:30:16 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:42.458 03:30:16 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:29:42.458 03:30:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:42.458 03:30:16 -- common/autotest_common.sh@10 -- # set +x 00:29:42.458 [2024-04-25 03:30:16.726480] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x20435c0/0x2042c00) succeed. 00:29:42.458 [2024-04-25 03:30:16.736311] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x20448f0/0x2043180) succeed. 00:29:42.458 [2024-04-25 03:30:16.736332] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:29:42.458 03:30:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:42.458 03:30:16 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:29:42.458 03:30:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:42.458 03:30:16 -- common/autotest_common.sh@10 -- # set +x 00:29:42.458 Malloc0 00:29:42.458 03:30:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:42.458 03:30:16 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:29:42.458 03:30:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:42.458 03:30:16 -- common/autotest_common.sh@10 -- # set +x 00:29:42.458 03:30:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:42.458 03:30:16 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:29:42.458 03:30:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:42.458 03:30:16 -- common/autotest_common.sh@10 -- # set +x 00:29:42.458 03:30:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:42.458 03:30:16 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:29:42.458 03:30:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:42.459 03:30:16 -- common/autotest_common.sh@10 -- # set +x 00:29:42.459 [2024-04-25 03:30:16.799555] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:29:42.459 03:30:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:42.459 03:30:16 -- host/bdevperf.sh@38 -- # wait 70496 00:29:43.038 [2024-04-25 03:30:17.418551] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:29:43.038 [2024-04-25 03:30:17.418575] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:43.038 [2024-04-25 03:30:17.418750] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:43.038 [2024-04-25 03:30:17.418759] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:43.038 [2024-04-25 03:30:17.418766] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:29:43.038 [2024-04-25 03:30:17.421504] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:43.038 [2024-04-25 03:30:17.424731] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:43.038 [2024-04-25 03:30:17.465940] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:29:51.143 00:29:51.143 Latency(us) 00:29:51.143 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:51.143 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:29:51.143 Verification LBA range: start 0x0 length 0x4000 00:29:51.143 Nvme1n1 : 15.00 12769.75 49.88 13721.20 0.00 4812.55 347.18 567229.68 00:29:51.143 =================================================================================================================== 00:29:51.143 Total : 12769.75 49.88 13721.20 0.00 4812.55 347.18 567229.68 00:29:51.143 03:30:25 -- host/bdevperf.sh@39 -- # sync 00:29:51.143 03:30:25 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:51.143 03:30:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:51.143 03:30:25 -- common/autotest_common.sh@10 -- # set +x 00:29:51.143 03:30:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:51.143 03:30:25 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:29:51.143 03:30:25 -- host/bdevperf.sh@44 -- # nvmftestfini 00:29:51.143 03:30:25 -- nvmf/common.sh@477 -- # nvmfcleanup 00:29:51.143 03:30:25 -- nvmf/common.sh@117 -- # sync 00:29:51.143 03:30:25 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:29:51.143 03:30:25 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:29:51.143 03:30:25 -- nvmf/common.sh@120 -- # set +e 00:29:51.143 03:30:25 -- nvmf/common.sh@121 -- # for i in {1..20} 00:29:51.143 03:30:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:29:51.143 rmmod nvme_rdma 00:29:51.143 rmmod nvme_fabrics 00:29:51.143 03:30:25 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:29:51.143 03:30:25 -- nvmf/common.sh@124 -- # set -e 00:29:51.143 03:30:25 -- nvmf/common.sh@125 -- # return 0 00:29:51.143 03:30:25 -- nvmf/common.sh@478 -- # '[' -n 71433 ']' 00:29:51.143 03:30:25 -- nvmf/common.sh@479 -- # killprocess 71433 00:29:51.143 03:30:25 -- common/autotest_common.sh@936 -- # '[' -z 71433 ']' 00:29:51.143 03:30:25 -- common/autotest_common.sh@940 -- # kill -0 71433 00:29:51.143 03:30:25 -- common/autotest_common.sh@941 -- # uname 00:29:51.143 03:30:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:51.143 03:30:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 71433 00:29:51.143 03:30:25 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:51.143 03:30:25 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:51.143 03:30:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 71433' 00:29:51.143 killing process with pid 71433 00:29:51.143 03:30:25 -- common/autotest_common.sh@955 -- # kill 71433 00:29:51.143 03:30:25 -- common/autotest_common.sh@960 -- # wait 71433 00:29:51.143 [2024-04-25 03:30:25.545838] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:29:51.401 03:30:25 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:29:51.401 03:30:25 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:29:51.401 00:29:51.401 real 0m24.716s 00:29:51.401 user 1m4.318s 00:29:51.401 sys 0m5.545s 00:29:51.401 03:30:25 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:29:51.401 03:30:25 -- common/autotest_common.sh@10 -- # set +x 00:29:51.401 ************************************ 00:29:51.401 END TEST nvmf_bdevperf 00:29:51.401 ************************************ 00:29:51.401 03:30:25 -- nvmf/nvmf.sh@120 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=rdma 00:29:51.401 03:30:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:51.401 03:30:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:51.401 03:30:25 -- common/autotest_common.sh@10 -- # set +x 00:29:51.658 ************************************ 00:29:51.658 START TEST nvmf_target_disconnect 00:29:51.658 ************************************ 00:29:51.658 03:30:25 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=rdma 00:29:51.658 * Looking for test storage... 00:29:51.658 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host 00:29:51.658 03:30:26 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:29:51.658 03:30:26 -- nvmf/common.sh@7 -- # uname -s 00:29:51.658 03:30:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:51.658 03:30:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:51.658 03:30:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:51.658 03:30:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:51.658 03:30:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:51.658 03:30:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:51.658 03:30:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:51.658 03:30:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:51.658 03:30:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:51.658 03:30:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:51.658 03:30:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:29:51.658 03:30:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:29:51.658 03:30:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:51.658 03:30:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:51.658 03:30:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:51.658 03:30:26 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:29:51.658 03:30:26 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:29:51.658 03:30:26 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:51.658 03:30:26 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:51.658 03:30:26 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:51.658 03:30:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:51.658 03:30:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:51.658 03:30:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:51.658 03:30:26 -- paths/export.sh@5 -- # export PATH 00:29:51.658 03:30:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:51.658 03:30:26 -- nvmf/common.sh@47 -- # : 0 00:29:51.658 03:30:26 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:29:51.658 03:30:26 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:29:51.658 03:30:26 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:29:51.658 03:30:26 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:51.658 03:30:26 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:51.658 03:30:26 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:29:51.658 03:30:26 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:29:51.658 03:30:26 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:29:51.658 03:30:26 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/app/fio/nvme 00:29:51.658 03:30:26 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:29:51.658 03:30:26 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:29:51.658 03:30:26 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:29:51.658 03:30:26 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:29:51.658 03:30:26 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:51.658 03:30:26 -- nvmf/common.sh@437 -- # prepare_net_devs 00:29:51.658 03:30:26 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:29:51.658 03:30:26 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:29:51.658 03:30:26 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:51.658 03:30:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:51.658 03:30:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:51.658 03:30:26 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:29:51.658 03:30:26 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:29:51.658 03:30:26 -- nvmf/common.sh@285 -- # xtrace_disable 00:29:51.658 03:30:26 -- common/autotest_common.sh@10 -- # set +x 00:29:56.937 03:30:31 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:56.937 03:30:31 -- nvmf/common.sh@291 -- # pci_devs=() 00:29:56.937 03:30:31 -- nvmf/common.sh@291 -- # local -a pci_devs 00:29:56.937 03:30:31 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:29:56.937 03:30:31 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:29:56.937 03:30:31 -- nvmf/common.sh@293 -- # pci_drivers=() 00:29:56.937 03:30:31 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:29:56.937 03:30:31 -- nvmf/common.sh@295 -- # net_devs=() 00:29:56.937 03:30:31 -- nvmf/common.sh@295 -- # local -ga net_devs 00:29:56.937 03:30:31 -- nvmf/common.sh@296 -- # e810=() 00:29:56.937 03:30:31 -- nvmf/common.sh@296 -- # local -ga e810 00:29:56.937 03:30:31 -- nvmf/common.sh@297 -- # x722=() 00:29:56.937 03:30:31 -- nvmf/common.sh@297 -- # local -ga x722 00:29:56.937 03:30:31 -- nvmf/common.sh@298 -- # mlx=() 00:29:56.937 03:30:31 -- nvmf/common.sh@298 -- # local -ga mlx 00:29:56.937 03:30:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:56.937 03:30:31 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:56.937 03:30:31 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:56.937 03:30:31 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:56.937 03:30:31 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:56.937 03:30:31 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:56.937 03:30:31 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:56.937 03:30:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:56.937 03:30:31 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:56.937 03:30:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:56.937 03:30:31 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:56.937 03:30:31 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:29:56.937 03:30:31 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:29:56.937 03:30:31 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:29:56.937 03:30:31 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:29:56.937 03:30:31 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:29:56.937 03:30:31 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:29:56.937 03:30:31 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:29:56.937 03:30:31 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:29:56.937 03:30:31 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:29:56.937 03:30:31 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:29:56.937 Found 0000:af:00.0 (0x8086 - 0x159b) 00:29:56.937 03:30:31 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:29:56.937 03:30:31 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:29:56.937 03:30:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:56.937 03:30:31 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:56.937 03:30:31 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:29:56.937 03:30:31 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:29:56.937 03:30:31 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:29:56.937 03:30:31 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:29:56.937 Found 0000:af:00.1 (0x8086 - 0x159b) 00:29:56.937 03:30:31 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:29:56.937 03:30:31 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:29:56.937 03:30:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:56.937 03:30:31 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:56.937 03:30:31 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:29:56.937 03:30:31 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:29:56.937 03:30:31 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:29:56.937 03:30:31 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:29:56.937 03:30:31 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:29:56.937 03:30:31 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:29:56.937 03:30:31 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:29:56.937 03:30:31 -- nvmf/common.sh@377 -- # modinfo irdma 00:29:56.937 03:30:31 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:29:56.937 03:30:31 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:29:56.937 03:30:31 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:56.937 03:30:31 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:29:56.937 03:30:31 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:56.937 03:30:31 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:29:56.937 Found net devices under 0000:af:00.0: cvl_0_0 00:29:56.937 03:30:31 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:29:56.937 03:30:31 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:29:56.937 03:30:31 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:56.937 03:30:31 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:29:56.937 03:30:31 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:56.937 03:30:31 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:29:56.937 Found net devices under 0000:af:00.1: cvl_0_1 00:29:56.937 03:30:31 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:29:56.937 03:30:31 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:29:56.937 03:30:31 -- nvmf/common.sh@403 -- # is_hw=yes 00:29:56.937 03:30:31 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:29:56.937 03:30:31 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:29:56.937 03:30:31 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:29:56.937 03:30:31 -- nvmf/common.sh@409 -- # rdma_device_init 00:29:56.937 03:30:31 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:29:56.937 03:30:31 -- nvmf/common.sh@58 -- # uname 00:29:56.937 03:30:31 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:29:56.937 03:30:31 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:29:56.937 03:30:31 -- nvmf/common.sh@63 -- # modprobe ib_core 00:29:56.937 03:30:31 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:29:56.937 03:30:31 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:29:56.937 03:30:31 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:29:56.937 03:30:31 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:29:56.937 03:30:31 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:29:56.937 03:30:31 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:29:56.937 03:30:31 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:29:56.937 03:30:31 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:29:56.937 03:30:31 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:29:56.937 03:30:31 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:29:56.937 03:30:31 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:29:56.937 03:30:31 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:29:56.937 03:30:31 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:29:56.937 03:30:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:29:56.937 03:30:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:29:56.937 03:30:31 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:29:56.937 03:30:31 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:29:56.937 03:30:31 -- nvmf/common.sh@105 -- # continue 2 00:29:56.937 03:30:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:29:56.937 03:30:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:29:56.937 03:30:31 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:29:56.937 03:30:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:29:56.937 03:30:31 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:29:56.937 03:30:31 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:29:56.938 03:30:31 -- nvmf/common.sh@105 -- # continue 2 00:29:56.938 03:30:31 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:29:56.938 03:30:31 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:29:56.938 03:30:31 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:29:56.938 03:30:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:29:56.938 03:30:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:29:56.938 03:30:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:29:56.938 03:30:31 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:29:56.938 03:30:31 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:29:56.938 03:30:31 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:29:56.938 50: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:29:56.938 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:29:56.938 altname enp175s0f0np0 00:29:56.938 altname ens801f0np0 00:29:56.938 inet 192.168.100.8/24 scope global cvl_0_0 00:29:56.938 valid_lft forever preferred_lft forever 00:29:56.938 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:29:56.938 valid_lft forever preferred_lft forever 00:29:56.938 03:30:31 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:29:56.938 03:30:31 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:29:56.938 03:30:31 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:29:56.938 03:30:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:29:56.938 03:30:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:29:56.938 03:30:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:29:56.938 03:30:31 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:29:56.938 03:30:31 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:29:56.938 03:30:31 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:29:56.938 51: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:29:56.938 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:29:56.938 altname enp175s0f1np1 00:29:56.938 altname ens801f1np1 00:29:56.938 inet 192.168.100.9/24 scope global cvl_0_1 00:29:56.938 valid_lft forever preferred_lft forever 00:29:56.938 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:29:56.938 valid_lft forever preferred_lft forever 00:29:56.938 03:30:31 -- nvmf/common.sh@411 -- # return 0 00:29:56.938 03:30:31 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:29:56.938 03:30:31 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:29:56.938 03:30:31 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:29:56.938 03:30:31 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:29:56.938 03:30:31 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:29:56.938 03:30:31 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:29:56.938 03:30:31 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:29:56.938 03:30:31 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:29:56.938 03:30:31 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:29:56.938 03:30:31 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:29:56.938 03:30:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:29:56.938 03:30:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:29:56.938 03:30:31 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:29:56.938 03:30:31 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:29:56.938 03:30:31 -- nvmf/common.sh@105 -- # continue 2 00:29:56.938 03:30:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:29:56.938 03:30:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:29:56.938 03:30:31 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:29:56.938 03:30:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:29:56.938 03:30:31 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:29:56.938 03:30:31 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:29:56.938 03:30:31 -- nvmf/common.sh@105 -- # continue 2 00:29:56.938 03:30:31 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:29:56.938 03:30:31 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:29:56.938 03:30:31 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:29:56.938 03:30:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:29:56.938 03:30:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:29:56.938 03:30:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:29:56.938 03:30:31 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:29:56.938 03:30:31 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:29:56.938 03:30:31 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:29:56.938 03:30:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:29:56.938 03:30:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:29:56.938 03:30:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:29:56.938 03:30:31 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:29:56.938 192.168.100.9' 00:29:56.938 03:30:31 -- nvmf/common.sh@446 -- # head -n 1 00:29:56.938 03:30:31 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:29:56.938 192.168.100.9' 00:29:56.938 03:30:31 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:29:56.938 03:30:31 -- nvmf/common.sh@447 -- # head -n 1 00:29:56.938 03:30:31 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:29:56.938 192.168.100.9' 00:29:56.938 03:30:31 -- nvmf/common.sh@447 -- # tail -n +2 00:29:56.938 03:30:31 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:29:56.938 03:30:31 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:29:56.938 03:30:31 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:29:56.938 03:30:31 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:29:56.938 03:30:31 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:29:56.938 03:30:31 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:29:57.197 03:30:31 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:29:57.197 03:30:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:57.197 03:30:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:57.197 03:30:31 -- common/autotest_common.sh@10 -- # set +x 00:29:57.197 ************************************ 00:29:57.197 START TEST nvmf_target_disconnect_tc1 00:29:57.197 ************************************ 00:29:57.197 03:30:31 -- common/autotest_common.sh@1111 -- # nvmf_target_disconnect_tc1 00:29:57.197 03:30:31 -- host/target_disconnect.sh@32 -- # set +e 00:29:57.197 03:30:31 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:29:57.197 EAL: No free 2048 kB hugepages reported on node 1 00:29:57.197 [2024-04-25 03:30:31.676484] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:29:57.197 [2024-04-25 03:30:31.676514] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:29:57.197 [2024-04-25 03:30:31.676521] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d7080 00:29:58.575 [2024-04-25 03:30:32.679272] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:29:58.575 [2024-04-25 03:30:32.679294] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:29:58.575 [2024-04-25 03:30:32.679302] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr is in error state 00:29:58.575 [2024-04-25 03:30:32.679322] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:58.575 [2024-04-25 03:30:32.679329] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:29:58.575 spdk_nvme_probe() failed for transport address '192.168.100.8' 00:29:58.575 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:29:58.575 Initializing NVMe Controllers 00:29:58.575 03:30:32 -- host/target_disconnect.sh@33 -- # trap - ERR 00:29:58.575 03:30:32 -- host/target_disconnect.sh@33 -- # print_backtrace 00:29:58.575 03:30:32 -- common/autotest_common.sh@1139 -- # [[ hxBET =~ e ]] 00:29:58.575 03:30:32 -- common/autotest_common.sh@1139 -- # return 0 00:29:58.575 03:30:32 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:29:58.575 03:30:32 -- host/target_disconnect.sh@41 -- # set -e 00:29:58.575 00:29:58.575 real 0m1.102s 00:29:58.575 user 0m0.940s 00:29:58.575 sys 0m0.157s 00:29:58.575 03:30:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:29:58.575 03:30:32 -- common/autotest_common.sh@10 -- # set +x 00:29:58.575 ************************************ 00:29:58.575 END TEST nvmf_target_disconnect_tc1 00:29:58.575 ************************************ 00:29:58.575 03:30:32 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:29:58.575 03:30:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:58.575 03:30:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:58.575 03:30:32 -- common/autotest_common.sh@10 -- # set +x 00:29:58.575 ************************************ 00:29:58.575 START TEST nvmf_target_disconnect_tc2 00:29:58.575 ************************************ 00:29:58.575 03:30:32 -- common/autotest_common.sh@1111 -- # nvmf_target_disconnect_tc2 00:29:58.575 03:30:32 -- host/target_disconnect.sh@45 -- # disconnect_init 192.168.100.8 00:29:58.575 03:30:32 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:29:58.575 03:30:32 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:29:58.575 03:30:32 -- common/autotest_common.sh@710 -- # xtrace_disable 00:29:58.575 03:30:32 -- common/autotest_common.sh@10 -- # set +x 00:29:58.575 03:30:32 -- nvmf/common.sh@470 -- # nvmfpid=76616 00:29:58.575 03:30:32 -- nvmf/common.sh@471 -- # waitforlisten 76616 00:29:58.575 03:30:32 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:29:58.575 03:30:32 -- common/autotest_common.sh@817 -- # '[' -z 76616 ']' 00:29:58.575 03:30:32 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:58.575 03:30:32 -- common/autotest_common.sh@822 -- # local max_retries=100 00:29:58.575 03:30:32 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:58.575 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:58.575 03:30:32 -- common/autotest_common.sh@826 -- # xtrace_disable 00:29:58.575 03:30:32 -- common/autotest_common.sh@10 -- # set +x 00:29:58.575 [2024-04-25 03:30:32.900626] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:29:58.575 [2024-04-25 03:30:32.900665] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:58.575 EAL: No free 2048 kB hugepages reported on node 1 00:29:58.575 [2024-04-25 03:30:32.972257] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:29:58.575 [2024-04-25 03:30:33.045962] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:58.575 [2024-04-25 03:30:33.045997] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:58.575 [2024-04-25 03:30:33.046004] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:29:58.575 [2024-04-25 03:30:33.046010] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:29:58.575 [2024-04-25 03:30:33.046016] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:58.575 [2024-04-25 03:30:33.046125] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:29:58.575 [2024-04-25 03:30:33.046231] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:29:58.575 [2024-04-25 03:30:33.046313] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:29:58.575 [2024-04-25 03:30:33.046315] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:29:59.509 03:30:33 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:29:59.509 03:30:33 -- common/autotest_common.sh@850 -- # return 0 00:29:59.509 03:30:33 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:29:59.509 03:30:33 -- common/autotest_common.sh@716 -- # xtrace_disable 00:29:59.509 03:30:33 -- common/autotest_common.sh@10 -- # set +x 00:29:59.509 03:30:33 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:59.509 03:30:33 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:29:59.509 03:30:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:59.509 03:30:33 -- common/autotest_common.sh@10 -- # set +x 00:29:59.509 Malloc0 00:29:59.509 03:30:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:59.509 03:30:33 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:29:59.509 03:30:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:59.509 03:30:33 -- common/autotest_common.sh@10 -- # set +x 00:29:59.509 [2024-04-25 03:30:33.782775] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x2431f40/0x2431580) succeed. 00:29:59.509 [2024-04-25 03:30:33.793149] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x24332f0/0x2431b00) succeed. 00:29:59.509 [2024-04-25 03:30:33.793169] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:29:59.509 03:30:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:59.509 03:30:33 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:29:59.509 03:30:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:59.509 03:30:33 -- common/autotest_common.sh@10 -- # set +x 00:29:59.509 03:30:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:59.509 03:30:33 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:29:59.509 03:30:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:59.509 03:30:33 -- common/autotest_common.sh@10 -- # set +x 00:29:59.509 03:30:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:59.509 03:30:33 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:29:59.509 03:30:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:59.509 03:30:33 -- common/autotest_common.sh@10 -- # set +x 00:29:59.509 [2024-04-25 03:30:33.821435] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:29:59.509 03:30:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:59.509 03:30:33 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:29:59.509 03:30:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:59.509 03:30:33 -- common/autotest_common.sh@10 -- # set +x 00:29:59.509 03:30:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:59.509 03:30:33 -- host/target_disconnect.sh@50 -- # reconnectpid=76858 00:29:59.509 03:30:33 -- host/target_disconnect.sh@52 -- # sleep 2 00:29:59.509 03:30:33 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:29:59.509 EAL: No free 2048 kB hugepages reported on node 1 00:30:01.411 03:30:35 -- host/target_disconnect.sh@53 -- # kill -9 76616 00:30:01.411 03:30:35 -- host/target_disconnect.sh@55 -- # sleep 2 00:30:02.346 [2024-04-25 03:30:36.510871] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:30:02.346 Read completed with error (sct=0, sc=8) 00:30:02.346 starting I/O failed 00:30:02.346 Write completed with error (sct=0, sc=8) 00:30:02.346 starting I/O failed 00:30:02.346 Write completed with error (sct=0, sc=8) 00:30:02.346 starting I/O failed 00:30:02.346 Write completed with error (sct=0, sc=8) 00:30:02.346 starting I/O failed 00:30:02.346 Write completed with error (sct=0, sc=8) 00:30:02.346 starting I/O failed 00:30:02.346 Read completed with error (sct=0, sc=8) 00:30:02.346 starting I/O failed 00:30:02.346 Write completed with error (sct=0, sc=8) 00:30:02.346 starting I/O failed 00:30:02.346 Read completed with error (sct=0, sc=8) 00:30:02.346 starting I/O failed 00:30:02.346 Write completed with error (sct=0, sc=8) 00:30:02.346 starting I/O failed 00:30:02.346 Write completed with error (sct=0, sc=8) 00:30:02.346 starting I/O failed 00:30:02.346 Read completed with error (sct=0, sc=8) 00:30:02.346 starting I/O failed 00:30:02.346 Read completed with error (sct=0, sc=8) 00:30:02.346 starting I/O failed 00:30:02.346 Read completed with error (sct=0, sc=8) 00:30:02.346 starting I/O failed 00:30:02.346 Read completed with error (sct=0, sc=8) 00:30:02.346 starting I/O failed 00:30:02.346 Read completed with error (sct=0, sc=8) 00:30:02.346 starting I/O failed 00:30:02.346 Write completed with error (sct=0, sc=8) 00:30:02.346 starting I/O failed 00:30:02.346 Read completed with error (sct=0, sc=8) 00:30:02.346 starting I/O failed 00:30:02.346 Write completed with error (sct=0, sc=8) 00:30:02.346 starting I/O failed 00:30:02.346 Write completed with error (sct=0, sc=8) 00:30:02.346 starting I/O failed 00:30:02.346 Read completed with error (sct=0, sc=8) 00:30:02.346 starting I/O failed 00:30:02.346 Read completed with error (sct=0, sc=8) 00:30:02.346 starting I/O failed 00:30:02.346 Read completed with error (sct=0, sc=8) 00:30:02.346 starting I/O failed 00:30:02.346 Write completed with error (sct=0, sc=8) 00:30:02.346 starting I/O failed 00:30:02.346 Read completed with error (sct=0, sc=8) 00:30:02.346 starting I/O failed 00:30:02.346 Write completed with error (sct=0, sc=8) 00:30:02.346 starting I/O failed 00:30:02.346 Read completed with error (sct=0, sc=8) 00:30:02.346 starting I/O failed 00:30:02.346 Write completed with error (sct=0, sc=8) 00:30:02.346 starting I/O failed 00:30:02.346 Read completed with error (sct=0, sc=8) 00:30:02.346 starting I/O failed 00:30:02.346 Write completed with error (sct=0, sc=8) 00:30:02.347 starting I/O failed 00:30:02.347 Read completed with error (sct=0, sc=8) 00:30:02.347 starting I/O failed 00:30:02.347 Write completed with error (sct=0, sc=8) 00:30:02.347 starting I/O failed 00:30:02.347 Read completed with error (sct=0, sc=8) 00:30:02.347 starting I/O failed 00:30:02.347 [2024-04-25 03:30:36.511395] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:02.347 [2024-04-25 03:30:36.513140] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:30:02.347 [2024-04-25 03:30:36.513157] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:30:02.347 [2024-04-25 03:30:36.513163] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:03.284 [2024-04-25 03:30:37.515816] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:03.284 qpair failed and we were unable to recover it. 00:30:03.284 [2024-04-25 03:30:37.517543] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:30:03.284 [2024-04-25 03:30:37.517557] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:30:03.284 [2024-04-25 03:30:37.517563] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:03.543 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 76616 Killed "${NVMF_APP[@]}" "$@" 00:30:03.543 03:30:37 -- host/target_disconnect.sh@56 -- # disconnect_init 192.168.100.8 00:30:03.543 03:30:37 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:03.543 03:30:37 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:30:03.543 03:30:37 -- common/autotest_common.sh@710 -- # xtrace_disable 00:30:03.543 03:30:37 -- common/autotest_common.sh@10 -- # set +x 00:30:03.543 03:30:37 -- nvmf/common.sh@470 -- # nvmfpid=77480 00:30:03.543 03:30:37 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:03.543 03:30:37 -- nvmf/common.sh@471 -- # waitforlisten 77480 00:30:03.543 03:30:37 -- common/autotest_common.sh@817 -- # '[' -z 77480 ']' 00:30:03.543 03:30:37 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:03.543 03:30:37 -- common/autotest_common.sh@822 -- # local max_retries=100 00:30:03.543 03:30:37 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:03.543 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:03.543 03:30:37 -- common/autotest_common.sh@826 -- # xtrace_disable 00:30:03.543 03:30:37 -- common/autotest_common.sh@10 -- # set +x 00:30:03.543 [2024-04-25 03:30:37.879961] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:30:03.543 [2024-04-25 03:30:37.880003] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:03.543 EAL: No free 2048 kB hugepages reported on node 1 00:30:03.543 [2024-04-25 03:30:37.952828] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:03.543 [2024-04-25 03:30:38.020727] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:03.543 [2024-04-25 03:30:38.020769] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:03.543 [2024-04-25 03:30:38.020776] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:30:03.543 [2024-04-25 03:30:38.020782] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:30:03.543 [2024-04-25 03:30:38.020787] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:03.543 [2024-04-25 03:30:38.020897] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:03.543 [2024-04-25 03:30:38.021006] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:03.543 [2024-04-25 03:30:38.021111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:03.543 [2024-04-25 03:30:38.021113] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:04.112 [2024-04-25 03:30:38.520278] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:04.112 qpair failed and we were unable to recover it. 00:30:04.112 [2024-04-25 03:30:38.522110] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:30:04.112 [2024-04-25 03:30:38.522128] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:30:04.112 [2024-04-25 03:30:38.522134] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:04.371 03:30:38 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:30:04.371 03:30:38 -- common/autotest_common.sh@850 -- # return 0 00:30:04.371 03:30:38 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:30:04.371 03:30:38 -- common/autotest_common.sh@716 -- # xtrace_disable 00:30:04.371 03:30:38 -- common/autotest_common.sh@10 -- # set +x 00:30:04.372 03:30:38 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:04.372 03:30:38 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:04.372 03:30:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:04.372 03:30:38 -- common/autotest_common.sh@10 -- # set +x 00:30:04.372 Malloc0 00:30:04.372 03:30:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:04.372 03:30:38 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:30:04.372 03:30:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:04.372 03:30:38 -- common/autotest_common.sh@10 -- # set +x 00:30:04.372 [2024-04-25 03:30:38.767865] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x79cf40/0x79c580) succeed. 00:30:04.372 [2024-04-25 03:30:38.778090] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x79e2f0/0x79cb00) succeed. 00:30:04.372 [2024-04-25 03:30:38.778109] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:30:04.372 03:30:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:04.372 03:30:38 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:04.372 03:30:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:04.372 03:30:38 -- common/autotest_common.sh@10 -- # set +x 00:30:04.372 03:30:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:04.372 03:30:38 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:04.372 03:30:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:04.372 03:30:38 -- common/autotest_common.sh@10 -- # set +x 00:30:04.372 03:30:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:04.372 03:30:38 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:30:04.372 03:30:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:04.372 03:30:38 -- common/autotest_common.sh@10 -- # set +x 00:30:04.372 [2024-04-25 03:30:38.806381] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:30:04.372 03:30:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:04.372 03:30:38 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:30:04.372 03:30:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:04.372 03:30:38 -- common/autotest_common.sh@10 -- # set +x 00:30:04.372 03:30:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:04.372 03:30:38 -- host/target_disconnect.sh@58 -- # wait 76858 00:30:05.344 [2024-04-25 03:30:39.524824] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.344 qpair failed and we were unable to recover it. 00:30:05.344 [2024-04-25 03:30:39.533544] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.344 [2024-04-25 03:30:39.533609] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.344 [2024-04-25 03:30:39.533626] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.344 [2024-04-25 03:30:39.533634] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.344 [2024-04-25 03:30:39.533641] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.344 [2024-04-25 03:30:39.541866] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.344 qpair failed and we were unable to recover it. 00:30:05.344 [2024-04-25 03:30:39.553725] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.344 [2024-04-25 03:30:39.553770] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.344 [2024-04-25 03:30:39.553784] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.344 [2024-04-25 03:30:39.553794] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.344 [2024-04-25 03:30:39.553800] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.344 [2024-04-25 03:30:39.561926] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.344 qpair failed and we were unable to recover it. 00:30:05.344 [2024-04-25 03:30:39.573675] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.344 [2024-04-25 03:30:39.573717] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.344 [2024-04-25 03:30:39.573731] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.344 [2024-04-25 03:30:39.573738] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.344 [2024-04-25 03:30:39.573743] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.344 [2024-04-25 03:30:39.581985] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.344 qpair failed and we were unable to recover it. 00:30:05.344 [2024-04-25 03:30:39.593592] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.344 [2024-04-25 03:30:39.593638] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.344 [2024-04-25 03:30:39.593652] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.344 [2024-04-25 03:30:39.593659] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.344 [2024-04-25 03:30:39.593665] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.344 [2024-04-25 03:30:39.602070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.344 qpair failed and we were unable to recover it. 00:30:05.344 [2024-04-25 03:30:39.613581] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.344 [2024-04-25 03:30:39.613626] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.344 [2024-04-25 03:30:39.613641] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.344 [2024-04-25 03:30:39.613647] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.344 [2024-04-25 03:30:39.613653] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.344 [2024-04-25 03:30:39.622100] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.344 qpair failed and we were unable to recover it. 00:30:05.344 [2024-04-25 03:30:39.633726] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.344 [2024-04-25 03:30:39.633761] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.344 [2024-04-25 03:30:39.633775] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.344 [2024-04-25 03:30:39.633782] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.344 [2024-04-25 03:30:39.633788] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.344 [2024-04-25 03:30:39.642130] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.345 qpair failed and we were unable to recover it. 00:30:05.345 [2024-04-25 03:30:39.653677] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.345 [2024-04-25 03:30:39.653716] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.345 [2024-04-25 03:30:39.653730] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.345 [2024-04-25 03:30:39.653736] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.345 [2024-04-25 03:30:39.653742] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.345 [2024-04-25 03:30:39.662117] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.345 qpair failed and we were unable to recover it. 00:30:05.345 [2024-04-25 03:30:39.673743] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.345 [2024-04-25 03:30:39.673785] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.345 [2024-04-25 03:30:39.673799] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.345 [2024-04-25 03:30:39.673806] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.345 [2024-04-25 03:30:39.673812] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.345 [2024-04-25 03:30:39.682175] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.345 qpair failed and we were unable to recover it. 00:30:05.345 [2024-04-25 03:30:39.693792] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.345 [2024-04-25 03:30:39.693838] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.345 [2024-04-25 03:30:39.693851] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.345 [2024-04-25 03:30:39.693861] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.345 [2024-04-25 03:30:39.693867] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.345 [2024-04-25 03:30:39.702304] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.345 qpair failed and we were unable to recover it. 00:30:05.345 [2024-04-25 03:30:39.713848] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.345 [2024-04-25 03:30:39.713895] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.345 [2024-04-25 03:30:39.713909] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.345 [2024-04-25 03:30:39.713915] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.345 [2024-04-25 03:30:39.713921] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.345 [2024-04-25 03:30:39.722359] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.345 qpair failed and we were unable to recover it. 00:30:05.345 [2024-04-25 03:30:39.733902] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.345 [2024-04-25 03:30:39.733939] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.345 [2024-04-25 03:30:39.733955] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.345 [2024-04-25 03:30:39.733962] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.345 [2024-04-25 03:30:39.733967] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.345 [2024-04-25 03:30:39.742417] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.345 qpair failed and we were unable to recover it. 00:30:05.345 [2024-04-25 03:30:39.753985] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.345 [2024-04-25 03:30:39.754028] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.345 [2024-04-25 03:30:39.754043] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.345 [2024-04-25 03:30:39.754049] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.345 [2024-04-25 03:30:39.754055] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.345 [2024-04-25 03:30:39.762452] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.345 qpair failed and we were unable to recover it. 00:30:05.345 [2024-04-25 03:30:39.774015] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.345 [2024-04-25 03:30:39.774059] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.345 [2024-04-25 03:30:39.774073] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.345 [2024-04-25 03:30:39.774080] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.345 [2024-04-25 03:30:39.774085] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.345 [2024-04-25 03:30:39.782557] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.345 qpair failed and we were unable to recover it. 00:30:05.345 [2024-04-25 03:30:39.794102] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.345 [2024-04-25 03:30:39.794148] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.345 [2024-04-25 03:30:39.794161] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.345 [2024-04-25 03:30:39.794167] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.345 [2024-04-25 03:30:39.794173] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.345 [2024-04-25 03:30:39.802569] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.345 qpair failed and we were unable to recover it. 00:30:05.345 [2024-04-25 03:30:39.814024] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.345 [2024-04-25 03:30:39.814064] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.345 [2024-04-25 03:30:39.814078] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.345 [2024-04-25 03:30:39.814085] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.345 [2024-04-25 03:30:39.814094] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.345 [2024-04-25 03:30:39.822608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.345 qpair failed and we were unable to recover it. 00:30:05.345 [2024-04-25 03:30:39.834208] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.345 [2024-04-25 03:30:39.834254] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.345 [2024-04-25 03:30:39.834267] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.345 [2024-04-25 03:30:39.834274] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.345 [2024-04-25 03:30:39.834279] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.628 [2024-04-25 03:30:39.842694] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.628 qpair failed and we were unable to recover it. 00:30:05.628 [2024-04-25 03:30:39.854242] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.628 [2024-04-25 03:30:39.854288] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.628 [2024-04-25 03:30:39.854302] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.628 [2024-04-25 03:30:39.854308] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.628 [2024-04-25 03:30:39.854314] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.628 [2024-04-25 03:30:39.862764] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.628 qpair failed and we were unable to recover it. 00:30:05.628 [2024-04-25 03:30:39.874314] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.628 [2024-04-25 03:30:39.874353] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.628 [2024-04-25 03:30:39.874367] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.628 [2024-04-25 03:30:39.874373] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.628 [2024-04-25 03:30:39.874379] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.628 [2024-04-25 03:30:39.882799] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.628 qpair failed and we were unable to recover it. 00:30:05.628 [2024-04-25 03:30:39.894371] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.628 [2024-04-25 03:30:39.894415] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.628 [2024-04-25 03:30:39.894429] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.628 [2024-04-25 03:30:39.894435] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.628 [2024-04-25 03:30:39.894441] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.628 [2024-04-25 03:30:39.902847] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.628 qpair failed and we were unable to recover it. 00:30:05.628 [2024-04-25 03:30:39.914352] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.628 [2024-04-25 03:30:39.914397] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.628 [2024-04-25 03:30:39.914411] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.628 [2024-04-25 03:30:39.914417] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.628 [2024-04-25 03:30:39.914423] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.628 [2024-04-25 03:30:39.922895] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.628 qpair failed and we were unable to recover it. 00:30:05.628 [2024-04-25 03:30:39.934462] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.628 [2024-04-25 03:30:39.934502] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.628 [2024-04-25 03:30:39.934516] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.628 [2024-04-25 03:30:39.934522] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.628 [2024-04-25 03:30:39.934528] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.628 [2024-04-25 03:30:39.942987] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.628 qpair failed and we were unable to recover it. 00:30:05.628 [2024-04-25 03:30:39.954532] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.628 [2024-04-25 03:30:39.954577] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.628 [2024-04-25 03:30:39.954591] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.628 [2024-04-25 03:30:39.954598] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.628 [2024-04-25 03:30:39.954603] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.628 [2024-04-25 03:30:39.963035] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.628 qpair failed and we were unable to recover it. 00:30:05.628 [2024-04-25 03:30:39.974585] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.628 [2024-04-25 03:30:39.974628] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.628 [2024-04-25 03:30:39.974642] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.628 [2024-04-25 03:30:39.974648] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.628 [2024-04-25 03:30:39.974654] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.628 [2024-04-25 03:30:39.983068] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.628 qpair failed and we were unable to recover it. 00:30:05.628 [2024-04-25 03:30:39.994667] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.628 [2024-04-25 03:30:39.994709] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.628 [2024-04-25 03:30:39.994722] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.628 [2024-04-25 03:30:39.994731] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.628 [2024-04-25 03:30:39.994737] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.628 [2024-04-25 03:30:40.003226] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.628 qpair failed and we were unable to recover it. 00:30:05.628 [2024-04-25 03:30:40.014816] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.628 [2024-04-25 03:30:40.014884] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.628 [2024-04-25 03:30:40.014903] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.628 [2024-04-25 03:30:40.014911] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.628 [2024-04-25 03:30:40.014918] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.628 [2024-04-25 03:30:40.023264] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.628 qpair failed and we were unable to recover it. 00:30:05.628 [2024-04-25 03:30:40.034806] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.628 [2024-04-25 03:30:40.034850] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.628 [2024-04-25 03:30:40.034869] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.628 [2024-04-25 03:30:40.034876] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.628 [2024-04-25 03:30:40.034882] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.628 [2024-04-25 03:30:40.043261] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.628 qpair failed and we were unable to recover it. 00:30:05.628 [2024-04-25 03:30:40.054851] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.629 [2024-04-25 03:30:40.054901] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.629 [2024-04-25 03:30:40.054915] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.629 [2024-04-25 03:30:40.054922] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.629 [2024-04-25 03:30:40.054927] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.629 [2024-04-25 03:30:40.063293] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.629 qpair failed and we were unable to recover it. 00:30:05.629 [2024-04-25 03:30:40.074796] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.629 [2024-04-25 03:30:40.074841] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.629 [2024-04-25 03:30:40.074859] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.629 [2024-04-25 03:30:40.074866] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.629 [2024-04-25 03:30:40.074872] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.629 [2024-04-25 03:30:40.083400] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.629 qpair failed and we were unable to recover it. 00:30:05.629 [2024-04-25 03:30:40.094956] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.629 [2024-04-25 03:30:40.095000] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.629 [2024-04-25 03:30:40.095014] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.629 [2024-04-25 03:30:40.095021] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.629 [2024-04-25 03:30:40.095027] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.629 [2024-04-25 03:30:40.103455] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.629 qpair failed and we were unable to recover it. 00:30:05.629 [2024-04-25 03:30:40.115021] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.629 [2024-04-25 03:30:40.115066] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.629 [2024-04-25 03:30:40.115079] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.629 [2024-04-25 03:30:40.115086] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.629 [2024-04-25 03:30:40.115091] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.629 [2024-04-25 03:30:40.123551] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.629 qpair failed and we were unable to recover it. 00:30:05.888 [2024-04-25 03:30:40.135073] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.888 [2024-04-25 03:30:40.135117] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.888 [2024-04-25 03:30:40.135131] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.888 [2024-04-25 03:30:40.135137] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.888 [2024-04-25 03:30:40.135143] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.888 [2024-04-25 03:30:40.143516] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.888 qpair failed and we were unable to recover it. 00:30:05.888 [2024-04-25 03:30:40.155146] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.888 [2024-04-25 03:30:40.155189] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.888 [2024-04-25 03:30:40.155203] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.888 [2024-04-25 03:30:40.155209] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.888 [2024-04-25 03:30:40.155215] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.888 [2024-04-25 03:30:40.163647] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.888 qpair failed and we were unable to recover it. 00:30:05.888 [2024-04-25 03:30:40.175179] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.888 [2024-04-25 03:30:40.175227] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.888 [2024-04-25 03:30:40.175243] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.888 [2024-04-25 03:30:40.175250] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.888 [2024-04-25 03:30:40.175256] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.888 [2024-04-25 03:30:40.183646] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.888 qpair failed and we were unable to recover it. 00:30:05.888 [2024-04-25 03:30:40.195269] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.888 [2024-04-25 03:30:40.195310] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.888 [2024-04-25 03:30:40.195323] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.888 [2024-04-25 03:30:40.195330] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.888 [2024-04-25 03:30:40.195336] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.888 [2024-04-25 03:30:40.203731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.888 qpair failed and we were unable to recover it. 00:30:05.888 [2024-04-25 03:30:40.215297] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.888 [2024-04-25 03:30:40.215332] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.888 [2024-04-25 03:30:40.215346] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.888 [2024-04-25 03:30:40.215352] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.888 [2024-04-25 03:30:40.215358] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.888 [2024-04-25 03:30:40.223772] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.888 qpair failed and we were unable to recover it. 00:30:05.888 [2024-04-25 03:30:40.235346] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.888 [2024-04-25 03:30:40.235391] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.888 [2024-04-25 03:30:40.235404] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.888 [2024-04-25 03:30:40.235411] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.888 [2024-04-25 03:30:40.235417] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.888 [2024-04-25 03:30:40.243865] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.888 qpair failed and we were unable to recover it. 00:30:05.888 [2024-04-25 03:30:40.255420] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.888 [2024-04-25 03:30:40.255466] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.888 [2024-04-25 03:30:40.255480] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.888 [2024-04-25 03:30:40.255487] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.888 [2024-04-25 03:30:40.255495] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.888 [2024-04-25 03:30:40.263892] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.888 qpair failed and we were unable to recover it. 00:30:05.888 [2024-04-25 03:30:40.275515] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.888 [2024-04-25 03:30:40.275550] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.888 [2024-04-25 03:30:40.275563] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.888 [2024-04-25 03:30:40.275570] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.888 [2024-04-25 03:30:40.275576] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.888 [2024-04-25 03:30:40.283972] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.888 qpair failed and we were unable to recover it. 00:30:05.888 [2024-04-25 03:30:40.295531] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.888 [2024-04-25 03:30:40.295569] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.888 [2024-04-25 03:30:40.295582] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.888 [2024-04-25 03:30:40.295588] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.888 [2024-04-25 03:30:40.295594] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.888 [2024-04-25 03:30:40.304053] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.888 qpair failed and we were unable to recover it. 00:30:05.888 [2024-04-25 03:30:40.315635] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.888 [2024-04-25 03:30:40.315676] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.888 [2024-04-25 03:30:40.315690] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.888 [2024-04-25 03:30:40.315696] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.888 [2024-04-25 03:30:40.315702] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.888 [2024-04-25 03:30:40.324089] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.888 qpair failed and we were unable to recover it. 00:30:05.888 [2024-04-25 03:30:40.335635] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.888 [2024-04-25 03:30:40.335680] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.888 [2024-04-25 03:30:40.335693] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.888 [2024-04-25 03:30:40.335700] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.888 [2024-04-25 03:30:40.335705] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.888 [2024-04-25 03:30:40.344129] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.888 qpair failed and we were unable to recover it. 00:30:05.888 [2024-04-25 03:30:40.355733] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.888 [2024-04-25 03:30:40.355774] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.888 [2024-04-25 03:30:40.355788] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.888 [2024-04-25 03:30:40.355794] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.888 [2024-04-25 03:30:40.355800] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.888 [2024-04-25 03:30:40.364232] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.888 qpair failed and we were unable to recover it. 00:30:05.888 [2024-04-25 03:30:40.375753] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:05.888 [2024-04-25 03:30:40.375786] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:05.888 [2024-04-25 03:30:40.375799] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:05.889 [2024-04-25 03:30:40.375806] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:05.889 [2024-04-25 03:30:40.375812] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:05.889 [2024-04-25 03:30:40.384241] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:05.889 qpair failed and we were unable to recover it. 00:30:06.147 [2024-04-25 03:30:40.395720] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.147 [2024-04-25 03:30:40.395760] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.147 [2024-04-25 03:30:40.395773] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.147 [2024-04-25 03:30:40.395779] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.147 [2024-04-25 03:30:40.395785] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.147 [2024-04-25 03:30:40.404338] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.147 qpair failed and we were unable to recover it. 00:30:06.148 [2024-04-25 03:30:40.415870] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.148 [2024-04-25 03:30:40.415912] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.148 [2024-04-25 03:30:40.415925] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.148 [2024-04-25 03:30:40.415932] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.148 [2024-04-25 03:30:40.415937] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.148 [2024-04-25 03:30:40.424340] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.148 qpair failed and we were unable to recover it. 00:30:06.148 [2024-04-25 03:30:40.435810] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.148 [2024-04-25 03:30:40.435849] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.148 [2024-04-25 03:30:40.435866] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.148 [2024-04-25 03:30:40.435875] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.148 [2024-04-25 03:30:40.435881] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.148 [2024-04-25 03:30:40.444358] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.148 qpair failed and we were unable to recover it. 00:30:06.148 [2024-04-25 03:30:40.455864] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.148 [2024-04-25 03:30:40.455906] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.148 [2024-04-25 03:30:40.455921] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.148 [2024-04-25 03:30:40.455927] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.148 [2024-04-25 03:30:40.455933] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.148 [2024-04-25 03:30:40.464544] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.148 qpair failed and we were unable to recover it. 00:30:06.148 [2024-04-25 03:30:40.476085] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.148 [2024-04-25 03:30:40.476126] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.148 [2024-04-25 03:30:40.476140] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.148 [2024-04-25 03:30:40.476146] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.148 [2024-04-25 03:30:40.476152] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.148 [2024-04-25 03:30:40.484561] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.148 qpair failed and we were unable to recover it. 00:30:06.148 [2024-04-25 03:30:40.496123] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.148 [2024-04-25 03:30:40.496165] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.148 [2024-04-25 03:30:40.496179] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.148 [2024-04-25 03:30:40.496185] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.148 [2024-04-25 03:30:40.496190] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.148 [2024-04-25 03:30:40.504625] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.148 qpair failed and we were unable to recover it. 00:30:06.148 [2024-04-25 03:30:40.516173] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.148 [2024-04-25 03:30:40.516213] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.148 [2024-04-25 03:30:40.516227] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.148 [2024-04-25 03:30:40.516234] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.148 [2024-04-25 03:30:40.516239] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.148 [2024-04-25 03:30:40.524709] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.148 qpair failed and we were unable to recover it. 00:30:06.148 [2024-04-25 03:30:40.536112] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.148 [2024-04-25 03:30:40.536154] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.148 [2024-04-25 03:30:40.536168] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.148 [2024-04-25 03:30:40.536174] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.148 [2024-04-25 03:30:40.536180] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.148 [2024-04-25 03:30:40.544690] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.148 qpair failed and we were unable to recover it. 00:30:06.148 [2024-04-25 03:30:40.556162] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.148 [2024-04-25 03:30:40.556206] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.148 [2024-04-25 03:30:40.556220] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.148 [2024-04-25 03:30:40.556226] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.148 [2024-04-25 03:30:40.556232] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.148 [2024-04-25 03:30:40.564778] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.148 qpair failed and we were unable to recover it. 00:30:06.148 [2024-04-25 03:30:40.576283] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.148 [2024-04-25 03:30:40.576331] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.148 [2024-04-25 03:30:40.576345] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.148 [2024-04-25 03:30:40.576352] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.148 [2024-04-25 03:30:40.576357] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.148 [2024-04-25 03:30:40.584725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.148 qpair failed and we were unable to recover it. 00:30:06.148 [2024-04-25 03:30:40.596262] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.148 [2024-04-25 03:30:40.596298] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.148 [2024-04-25 03:30:40.596313] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.148 [2024-04-25 03:30:40.596319] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.148 [2024-04-25 03:30:40.596324] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.148 [2024-04-25 03:30:40.604944] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.148 qpair failed and we were unable to recover it. 00:30:06.148 [2024-04-25 03:30:40.616469] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.148 [2024-04-25 03:30:40.616512] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.148 [2024-04-25 03:30:40.616529] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.148 [2024-04-25 03:30:40.616535] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.148 [2024-04-25 03:30:40.616540] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.148 [2024-04-25 03:30:40.624943] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.148 qpair failed and we were unable to recover it. 00:30:06.148 [2024-04-25 03:30:40.636429] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.148 [2024-04-25 03:30:40.636473] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.148 [2024-04-25 03:30:40.636487] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.148 [2024-04-25 03:30:40.636493] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.148 [2024-04-25 03:30:40.636499] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.148 [2024-04-25 03:30:40.645007] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.148 qpair failed and we were unable to recover it. 00:30:06.407 [2024-04-25 03:30:40.656444] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.407 [2024-04-25 03:30:40.656488] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.407 [2024-04-25 03:30:40.656502] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.407 [2024-04-25 03:30:40.656509] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.407 [2024-04-25 03:30:40.656514] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.407 [2024-04-25 03:30:40.665113] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.407 qpair failed and we were unable to recover it. 00:30:06.407 [2024-04-25 03:30:40.676721] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.407 [2024-04-25 03:30:40.676765] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.407 [2024-04-25 03:30:40.676779] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.407 [2024-04-25 03:30:40.676786] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.407 [2024-04-25 03:30:40.676792] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.407 [2024-04-25 03:30:40.685118] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.407 qpair failed and we were unable to recover it. 00:30:06.407 [2024-04-25 03:30:40.696773] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.407 [2024-04-25 03:30:40.696815] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.407 [2024-04-25 03:30:40.696828] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.407 [2024-04-25 03:30:40.696835] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.407 [2024-04-25 03:30:40.696844] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.408 [2024-04-25 03:30:40.705237] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.408 qpair failed and we were unable to recover it. 00:30:06.408 [2024-04-25 03:30:40.716617] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.408 [2024-04-25 03:30:40.716661] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.408 [2024-04-25 03:30:40.716675] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.408 [2024-04-25 03:30:40.716681] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.408 [2024-04-25 03:30:40.716687] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.408 [2024-04-25 03:30:40.725211] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.408 qpair failed and we were unable to recover it. 00:30:06.408 [2024-04-25 03:30:40.736850] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.408 [2024-04-25 03:30:40.736893] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.408 [2024-04-25 03:30:40.736907] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.408 [2024-04-25 03:30:40.736913] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.408 [2024-04-25 03:30:40.736919] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.408 [2024-04-25 03:30:40.745345] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.408 qpair failed and we were unable to recover it. 00:30:06.408 [2024-04-25 03:30:40.756953] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.408 [2024-04-25 03:30:40.756995] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.408 [2024-04-25 03:30:40.757008] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.408 [2024-04-25 03:30:40.757015] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.408 [2024-04-25 03:30:40.757020] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.408 [2024-04-25 03:30:40.765433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.408 qpair failed and we were unable to recover it. 00:30:06.408 [2024-04-25 03:30:40.777049] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.408 [2024-04-25 03:30:40.777091] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.408 [2024-04-25 03:30:40.777105] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.408 [2024-04-25 03:30:40.777111] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.408 [2024-04-25 03:30:40.777117] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.408 [2024-04-25 03:30:40.785530] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.408 qpair failed and we were unable to recover it. 00:30:06.408 [2024-04-25 03:30:40.797024] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.408 [2024-04-25 03:30:40.797065] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.408 [2024-04-25 03:30:40.797079] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.408 [2024-04-25 03:30:40.797086] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.408 [2024-04-25 03:30:40.797092] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.408 [2024-04-25 03:30:40.805524] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.408 qpair failed and we were unable to recover it. 00:30:06.408 [2024-04-25 03:30:40.816905] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.408 [2024-04-25 03:30:40.816947] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.408 [2024-04-25 03:30:40.816961] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.408 [2024-04-25 03:30:40.816967] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.408 [2024-04-25 03:30:40.816973] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.408 [2024-04-25 03:30:40.825558] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.408 qpair failed and we were unable to recover it. 00:30:06.408 [2024-04-25 03:30:40.837171] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.408 [2024-04-25 03:30:40.837210] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.408 [2024-04-25 03:30:40.837224] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.408 [2024-04-25 03:30:40.837230] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.408 [2024-04-25 03:30:40.837236] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.408 [2024-04-25 03:30:40.845653] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.408 qpair failed and we were unable to recover it. 00:30:06.408 [2024-04-25 03:30:40.857258] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.408 [2024-04-25 03:30:40.857302] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.408 [2024-04-25 03:30:40.857315] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.408 [2024-04-25 03:30:40.857322] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.408 [2024-04-25 03:30:40.857327] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.408 [2024-04-25 03:30:40.865767] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.408 qpair failed and we were unable to recover it. 00:30:06.408 [2024-04-25 03:30:40.877320] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.408 [2024-04-25 03:30:40.877363] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.408 [2024-04-25 03:30:40.877377] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.408 [2024-04-25 03:30:40.877386] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.408 [2024-04-25 03:30:40.877391] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.408 [2024-04-25 03:30:40.885802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.408 qpair failed and we were unable to recover it. 00:30:06.408 [2024-04-25 03:30:40.897336] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.408 [2024-04-25 03:30:40.897378] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.408 [2024-04-25 03:30:40.897391] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.408 [2024-04-25 03:30:40.897398] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.408 [2024-04-25 03:30:40.897404] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.408 [2024-04-25 03:30:40.905905] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.408 qpair failed and we were unable to recover it. 00:30:06.667 [2024-04-25 03:30:40.917437] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.667 [2024-04-25 03:30:40.917482] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.667 [2024-04-25 03:30:40.917496] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.667 [2024-04-25 03:30:40.917502] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.667 [2024-04-25 03:30:40.917508] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.667 [2024-04-25 03:30:40.925892] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.667 qpair failed and we were unable to recover it. 00:30:06.667 [2024-04-25 03:30:40.937529] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.667 [2024-04-25 03:30:40.937567] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.667 [2024-04-25 03:30:40.937581] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.667 [2024-04-25 03:30:40.937588] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.667 [2024-04-25 03:30:40.937593] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.667 [2024-04-25 03:30:40.946009] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.667 qpair failed and we were unable to recover it. 00:30:06.667 [2024-04-25 03:30:40.957505] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.668 [2024-04-25 03:30:40.957548] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.668 [2024-04-25 03:30:40.957561] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.668 [2024-04-25 03:30:40.957567] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.668 [2024-04-25 03:30:40.957573] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.668 [2024-04-25 03:30:40.966021] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.668 qpair failed and we were unable to recover it. 00:30:06.668 [2024-04-25 03:30:40.977630] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.668 [2024-04-25 03:30:40.977674] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.668 [2024-04-25 03:30:40.977688] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.668 [2024-04-25 03:30:40.977694] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.668 [2024-04-25 03:30:40.977700] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.668 [2024-04-25 03:30:40.986028] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.668 qpair failed and we were unable to recover it. 00:30:06.668 [2024-04-25 03:30:40.997610] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.668 [2024-04-25 03:30:40.997648] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.668 [2024-04-25 03:30:40.997661] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.668 [2024-04-25 03:30:40.997667] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.668 [2024-04-25 03:30:40.997673] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.668 [2024-04-25 03:30:41.006173] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.668 qpair failed and we were unable to recover it. 00:30:06.668 [2024-04-25 03:30:41.017555] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.668 [2024-04-25 03:30:41.017590] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.668 [2024-04-25 03:30:41.017603] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.668 [2024-04-25 03:30:41.017610] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.668 [2024-04-25 03:30:41.017615] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.668 [2024-04-25 03:30:41.026219] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.668 qpair failed and we were unable to recover it. 00:30:06.668 [2024-04-25 03:30:41.037755] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.668 [2024-04-25 03:30:41.037798] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.668 [2024-04-25 03:30:41.037810] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.668 [2024-04-25 03:30:41.037817] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.668 [2024-04-25 03:30:41.037822] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.668 [2024-04-25 03:30:41.046235] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.668 qpair failed and we were unable to recover it. 00:30:06.668 [2024-04-25 03:30:41.057837] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.668 [2024-04-25 03:30:41.057886] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.668 [2024-04-25 03:30:41.057901] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.668 [2024-04-25 03:30:41.057908] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.668 [2024-04-25 03:30:41.057913] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.668 [2024-04-25 03:30:41.066323] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.668 qpair failed and we were unable to recover it. 00:30:06.668 [2024-04-25 03:30:41.077943] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.668 [2024-04-25 03:30:41.077983] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.668 [2024-04-25 03:30:41.077997] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.668 [2024-04-25 03:30:41.078003] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.668 [2024-04-25 03:30:41.078008] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.668 [2024-04-25 03:30:41.086370] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.668 qpair failed and we were unable to recover it. 00:30:06.668 [2024-04-25 03:30:41.098018] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.668 [2024-04-25 03:30:41.098061] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.668 [2024-04-25 03:30:41.098075] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.668 [2024-04-25 03:30:41.098082] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.668 [2024-04-25 03:30:41.098087] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.668 [2024-04-25 03:30:41.106383] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.668 qpair failed and we were unable to recover it. 00:30:06.668 [2024-04-25 03:30:41.118044] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.668 [2024-04-25 03:30:41.118086] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.668 [2024-04-25 03:30:41.118099] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.668 [2024-04-25 03:30:41.118105] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.668 [2024-04-25 03:30:41.118112] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.668 [2024-04-25 03:30:41.126512] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.668 qpair failed and we were unable to recover it. 00:30:06.668 [2024-04-25 03:30:41.138082] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.668 [2024-04-25 03:30:41.138127] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.668 [2024-04-25 03:30:41.138140] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.668 [2024-04-25 03:30:41.138146] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.668 [2024-04-25 03:30:41.138154] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.668 [2024-04-25 03:30:41.146584] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.668 qpair failed and we were unable to recover it. 00:30:06.668 [2024-04-25 03:30:41.158126] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.668 [2024-04-25 03:30:41.158164] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.668 [2024-04-25 03:30:41.158177] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.668 [2024-04-25 03:30:41.158184] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.668 [2024-04-25 03:30:41.158190] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.927 [2024-04-25 03:30:41.166656] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.927 qpair failed and we were unable to recover it. 00:30:06.927 [2024-04-25 03:30:41.178010] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.927 [2024-04-25 03:30:41.178048] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.927 [2024-04-25 03:30:41.178062] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.927 [2024-04-25 03:30:41.178068] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.927 [2024-04-25 03:30:41.178074] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.927 [2024-04-25 03:30:41.186699] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.927 qpair failed and we were unable to recover it. 00:30:06.927 [2024-04-25 03:30:41.198244] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.927 [2024-04-25 03:30:41.198285] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.927 [2024-04-25 03:30:41.198298] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.927 [2024-04-25 03:30:41.198304] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.927 [2024-04-25 03:30:41.198310] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.927 [2024-04-25 03:30:41.206653] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.927 qpair failed and we were unable to recover it. 00:30:06.927 [2024-04-25 03:30:41.218344] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.927 [2024-04-25 03:30:41.218388] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.927 [2024-04-25 03:30:41.218402] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.927 [2024-04-25 03:30:41.218408] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.927 [2024-04-25 03:30:41.218414] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.927 [2024-04-25 03:30:41.226797] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.927 qpair failed and we were unable to recover it. 00:30:06.927 [2024-04-25 03:30:41.238403] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.927 [2024-04-25 03:30:41.238445] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.927 [2024-04-25 03:30:41.238458] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.927 [2024-04-25 03:30:41.238464] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.928 [2024-04-25 03:30:41.238470] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.928 [2024-04-25 03:30:41.246742] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.928 qpair failed and we were unable to recover it. 00:30:06.928 [2024-04-25 03:30:41.258406] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.928 [2024-04-25 03:30:41.258447] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.928 [2024-04-25 03:30:41.258460] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.928 [2024-04-25 03:30:41.258467] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.928 [2024-04-25 03:30:41.258473] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.928 [2024-04-25 03:30:41.266888] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.928 qpair failed and we were unable to recover it. 00:30:06.928 [2024-04-25 03:30:41.278428] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.928 [2024-04-25 03:30:41.278468] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.928 [2024-04-25 03:30:41.278481] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.928 [2024-04-25 03:30:41.278487] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.928 [2024-04-25 03:30:41.278493] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.928 [2024-04-25 03:30:41.287008] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.928 qpair failed and we were unable to recover it. 00:30:06.928 [2024-04-25 03:30:41.298564] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.928 [2024-04-25 03:30:41.298602] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.928 [2024-04-25 03:30:41.298616] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.928 [2024-04-25 03:30:41.298623] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.928 [2024-04-25 03:30:41.298628] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.928 [2024-04-25 03:30:41.307058] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.928 qpair failed and we were unable to recover it. 00:30:06.928 [2024-04-25 03:30:41.318613] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.928 [2024-04-25 03:30:41.318657] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.928 [2024-04-25 03:30:41.318670] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.928 [2024-04-25 03:30:41.318679] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.928 [2024-04-25 03:30:41.318685] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.928 [2024-04-25 03:30:41.327126] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.928 qpair failed and we were unable to recover it. 00:30:06.928 [2024-04-25 03:30:41.338680] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.928 [2024-04-25 03:30:41.338713] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.928 [2024-04-25 03:30:41.338726] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.928 [2024-04-25 03:30:41.338732] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.928 [2024-04-25 03:30:41.338738] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.928 [2024-04-25 03:30:41.347166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.928 qpair failed and we were unable to recover it. 00:30:06.928 [2024-04-25 03:30:41.358726] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.928 [2024-04-25 03:30:41.358767] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.928 [2024-04-25 03:30:41.358780] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.928 [2024-04-25 03:30:41.358787] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.928 [2024-04-25 03:30:41.358793] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.928 [2024-04-25 03:30:41.367105] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.928 qpair failed and we were unable to recover it. 00:30:06.928 [2024-04-25 03:30:41.378845] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.928 [2024-04-25 03:30:41.378895] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.928 [2024-04-25 03:30:41.378908] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.928 [2024-04-25 03:30:41.378914] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.928 [2024-04-25 03:30:41.378920] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.928 [2024-04-25 03:30:41.387280] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.928 qpair failed and we were unable to recover it. 00:30:06.928 [2024-04-25 03:30:41.398831] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.928 [2024-04-25 03:30:41.398872] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.928 [2024-04-25 03:30:41.398886] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.928 [2024-04-25 03:30:41.398892] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.928 [2024-04-25 03:30:41.398898] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:06.928 [2024-04-25 03:30:41.407372] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:06.928 qpair failed and we were unable to recover it. 00:30:06.928 [2024-04-25 03:30:41.418991] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:06.928 [2024-04-25 03:30:41.419033] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:06.928 [2024-04-25 03:30:41.419046] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:06.928 [2024-04-25 03:30:41.419053] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:06.928 [2024-04-25 03:30:41.419059] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.187 [2024-04-25 03:30:41.427380] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.187 qpair failed and we were unable to recover it. 00:30:07.187 [2024-04-25 03:30:41.438919] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.187 [2024-04-25 03:30:41.438960] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.187 [2024-04-25 03:30:41.438974] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.187 [2024-04-25 03:30:41.438980] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.187 [2024-04-25 03:30:41.438986] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.187 [2024-04-25 03:30:41.447343] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.187 qpair failed and we were unable to recover it. 00:30:07.187 [2024-04-25 03:30:41.459033] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.187 [2024-04-25 03:30:41.459076] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.187 [2024-04-25 03:30:41.459090] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.187 [2024-04-25 03:30:41.459096] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.187 [2024-04-25 03:30:41.459102] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.187 [2024-04-25 03:30:41.467426] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.187 qpair failed and we were unable to recover it. 00:30:07.187 [2024-04-25 03:30:41.479026] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.187 [2024-04-25 03:30:41.479069] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.187 [2024-04-25 03:30:41.479082] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.187 [2024-04-25 03:30:41.479089] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.187 [2024-04-25 03:30:41.479095] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.187 [2024-04-25 03:30:41.487576] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.187 qpair failed and we were unable to recover it. 00:30:07.187 [2024-04-25 03:30:41.499154] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.187 [2024-04-25 03:30:41.499195] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.187 [2024-04-25 03:30:41.499213] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.187 [2024-04-25 03:30:41.499220] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.187 [2024-04-25 03:30:41.499225] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.187 [2024-04-25 03:30:41.507601] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.187 qpair failed and we were unable to recover it. 00:30:07.187 [2024-04-25 03:30:41.519208] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.187 [2024-04-25 03:30:41.519250] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.187 [2024-04-25 03:30:41.519264] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.187 [2024-04-25 03:30:41.519270] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.187 [2024-04-25 03:30:41.519276] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.187 [2024-04-25 03:30:41.527671] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.187 qpair failed and we were unable to recover it. 00:30:07.187 [2024-04-25 03:30:41.539294] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.188 [2024-04-25 03:30:41.539338] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.188 [2024-04-25 03:30:41.539352] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.188 [2024-04-25 03:30:41.539359] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.188 [2024-04-25 03:30:41.539364] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.188 [2024-04-25 03:30:41.547739] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.188 qpair failed and we were unable to recover it. 00:30:07.188 [2024-04-25 03:30:41.559346] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.188 [2024-04-25 03:30:41.559389] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.188 [2024-04-25 03:30:41.559403] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.188 [2024-04-25 03:30:41.559410] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.188 [2024-04-25 03:30:41.559415] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.188 [2024-04-25 03:30:41.567789] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.188 qpair failed and we were unable to recover it. 00:30:07.188 [2024-04-25 03:30:41.579385] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.188 [2024-04-25 03:30:41.579426] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.188 [2024-04-25 03:30:41.579440] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.188 [2024-04-25 03:30:41.579446] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.188 [2024-04-25 03:30:41.579454] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.188 [2024-04-25 03:30:41.587911] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.188 qpair failed and we were unable to recover it. 00:30:07.188 [2024-04-25 03:30:41.599410] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.188 [2024-04-25 03:30:41.599454] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.188 [2024-04-25 03:30:41.599467] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.188 [2024-04-25 03:30:41.599474] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.188 [2024-04-25 03:30:41.599480] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.188 [2024-04-25 03:30:41.608013] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.188 qpair failed and we were unable to recover it. 00:30:07.188 [2024-04-25 03:30:41.619545] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.188 [2024-04-25 03:30:41.619594] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.188 [2024-04-25 03:30:41.619606] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.188 [2024-04-25 03:30:41.619613] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.188 [2024-04-25 03:30:41.619619] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.188 [2024-04-25 03:30:41.627954] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.188 qpair failed and we were unable to recover it. 00:30:07.188 [2024-04-25 03:30:41.639621] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.188 [2024-04-25 03:30:41.639662] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.188 [2024-04-25 03:30:41.639675] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.188 [2024-04-25 03:30:41.639682] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.188 [2024-04-25 03:30:41.639688] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.188 [2024-04-25 03:30:41.648024] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.188 qpair failed and we were unable to recover it. 00:30:07.188 [2024-04-25 03:30:41.659696] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.188 [2024-04-25 03:30:41.659738] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.188 [2024-04-25 03:30:41.659751] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.188 [2024-04-25 03:30:41.659758] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.188 [2024-04-25 03:30:41.659764] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.188 [2024-04-25 03:30:41.668135] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.188 qpair failed and we were unable to recover it. 00:30:07.188 [2024-04-25 03:30:41.679763] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.188 [2024-04-25 03:30:41.679804] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.188 [2024-04-25 03:30:41.679818] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.188 [2024-04-25 03:30:41.679824] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.188 [2024-04-25 03:30:41.679830] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.447 [2024-04-25 03:30:41.688133] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.447 qpair failed and we were unable to recover it. 00:30:07.447 [2024-04-25 03:30:41.699825] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.447 [2024-04-25 03:30:41.699871] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.447 [2024-04-25 03:30:41.699885] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.447 [2024-04-25 03:30:41.699891] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.447 [2024-04-25 03:30:41.699897] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.447 [2024-04-25 03:30:41.708238] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.447 qpair failed and we were unable to recover it. 00:30:07.447 [2024-04-25 03:30:41.719743] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.448 [2024-04-25 03:30:41.719786] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.448 [2024-04-25 03:30:41.719800] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.448 [2024-04-25 03:30:41.719806] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.448 [2024-04-25 03:30:41.719812] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.448 [2024-04-25 03:30:41.728323] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.448 qpair failed and we were unable to recover it. 00:30:07.448 [2024-04-25 03:30:41.739941] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.448 [2024-04-25 03:30:41.739982] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.448 [2024-04-25 03:30:41.739995] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.448 [2024-04-25 03:30:41.740002] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.448 [2024-04-25 03:30:41.740007] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.448 [2024-04-25 03:30:41.748311] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.448 qpair failed and we were unable to recover it. 00:30:07.448 [2024-04-25 03:30:41.759919] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.448 [2024-04-25 03:30:41.759959] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.448 [2024-04-25 03:30:41.759972] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.448 [2024-04-25 03:30:41.759981] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.448 [2024-04-25 03:30:41.759986] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.448 [2024-04-25 03:30:41.768388] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.448 qpair failed and we were unable to recover it. 00:30:07.448 [2024-04-25 03:30:41.779999] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.448 [2024-04-25 03:30:41.780039] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.448 [2024-04-25 03:30:41.780052] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.448 [2024-04-25 03:30:41.780058] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.448 [2024-04-25 03:30:41.780064] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.448 [2024-04-25 03:30:41.788479] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.448 qpair failed and we were unable to recover it. 00:30:07.448 [2024-04-25 03:30:41.800050] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.448 [2024-04-25 03:30:41.800086] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.448 [2024-04-25 03:30:41.800100] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.448 [2024-04-25 03:30:41.800106] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.448 [2024-04-25 03:30:41.800112] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.448 [2024-04-25 03:30:41.808561] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.448 qpair failed and we were unable to recover it. 00:30:07.448 [2024-04-25 03:30:41.820147] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.448 [2024-04-25 03:30:41.820187] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.448 [2024-04-25 03:30:41.820200] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.448 [2024-04-25 03:30:41.820207] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.448 [2024-04-25 03:30:41.820212] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.448 [2024-04-25 03:30:41.828581] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.448 qpair failed and we were unable to recover it. 00:30:07.448 [2024-04-25 03:30:41.840206] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.448 [2024-04-25 03:30:41.840246] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.448 [2024-04-25 03:30:41.840260] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.448 [2024-04-25 03:30:41.840266] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.448 [2024-04-25 03:30:41.840272] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.448 [2024-04-25 03:30:41.848725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.448 qpair failed and we were unable to recover it. 00:30:07.448 [2024-04-25 03:30:41.860210] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.448 [2024-04-25 03:30:41.860251] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.448 [2024-04-25 03:30:41.860265] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.448 [2024-04-25 03:30:41.860271] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.448 [2024-04-25 03:30:41.860277] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.448 [2024-04-25 03:30:41.868775] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.448 qpair failed and we were unable to recover it. 00:30:07.448 [2024-04-25 03:30:41.880351] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.448 [2024-04-25 03:30:41.880390] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.448 [2024-04-25 03:30:41.880404] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.448 [2024-04-25 03:30:41.880410] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.448 [2024-04-25 03:30:41.880416] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.448 [2024-04-25 03:30:41.888787] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.448 qpair failed and we were unable to recover it. 00:30:07.448 [2024-04-25 03:30:41.900358] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.448 [2024-04-25 03:30:41.900405] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.448 [2024-04-25 03:30:41.900419] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.448 [2024-04-25 03:30:41.900426] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.448 [2024-04-25 03:30:41.900431] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.448 [2024-04-25 03:30:41.908909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.448 qpair failed and we were unable to recover it. 00:30:07.448 [2024-04-25 03:30:41.920217] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.448 [2024-04-25 03:30:41.920258] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.448 [2024-04-25 03:30:41.920271] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.449 [2024-04-25 03:30:41.920277] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.449 [2024-04-25 03:30:41.920283] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.449 [2024-04-25 03:30:41.928816] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.449 qpair failed and we were unable to recover it. 00:30:07.449 [2024-04-25 03:30:41.940512] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.449 [2024-04-25 03:30:41.940558] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.449 [2024-04-25 03:30:41.940574] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.449 [2024-04-25 03:30:41.940580] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.449 [2024-04-25 03:30:41.940586] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.709 [2024-04-25 03:30:41.948924] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.709 qpair failed and we were unable to recover it. 00:30:07.709 [2024-04-25 03:30:41.960573] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.709 [2024-04-25 03:30:41.960610] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.709 [2024-04-25 03:30:41.960624] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.709 [2024-04-25 03:30:41.960630] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.709 [2024-04-25 03:30:41.960636] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.709 [2024-04-25 03:30:41.969011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.709 qpair failed and we were unable to recover it. 00:30:07.709 [2024-04-25 03:30:41.980394] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.709 [2024-04-25 03:30:41.980432] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.709 [2024-04-25 03:30:41.980445] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.709 [2024-04-25 03:30:41.980452] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.709 [2024-04-25 03:30:41.980457] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.709 [2024-04-25 03:30:41.988992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.709 qpair failed and we were unable to recover it. 00:30:07.709 [2024-04-25 03:30:42.000611] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.709 [2024-04-25 03:30:42.000653] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.709 [2024-04-25 03:30:42.000667] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.709 [2024-04-25 03:30:42.000674] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.709 [2024-04-25 03:30:42.000679] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.709 [2024-04-25 03:30:42.009072] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.709 qpair failed and we were unable to recover it. 00:30:07.709 [2024-04-25 03:30:42.020622] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.709 [2024-04-25 03:30:42.020670] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.709 [2024-04-25 03:30:42.020683] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.709 [2024-04-25 03:30:42.020690] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.709 [2024-04-25 03:30:42.020698] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.709 [2024-04-25 03:30:42.029076] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.709 qpair failed and we were unable to recover it. 00:30:07.709 [2024-04-25 03:30:42.040569] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.709 [2024-04-25 03:30:42.040612] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.709 [2024-04-25 03:30:42.040625] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.709 [2024-04-25 03:30:42.040631] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.709 [2024-04-25 03:30:42.040637] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.709 [2024-04-25 03:30:42.049198] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.709 qpair failed and we were unable to recover it. 00:30:07.709 [2024-04-25 03:30:42.060768] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.709 [2024-04-25 03:30:42.060817] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.709 [2024-04-25 03:30:42.060831] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.709 [2024-04-25 03:30:42.060837] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.709 [2024-04-25 03:30:42.060843] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.709 [2024-04-25 03:30:42.069295] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.709 qpair failed and we were unable to recover it. 00:30:07.709 [2024-04-25 03:30:42.080797] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.709 [2024-04-25 03:30:42.080839] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.709 [2024-04-25 03:30:42.080858] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.709 [2024-04-25 03:30:42.080865] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.709 [2024-04-25 03:30:42.080871] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.709 [2024-04-25 03:30:42.089252] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.709 qpair failed and we were unable to recover it. 00:30:07.709 [2024-04-25 03:30:42.100661] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.709 [2024-04-25 03:30:42.100705] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.709 [2024-04-25 03:30:42.100719] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.709 [2024-04-25 03:30:42.100725] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.709 [2024-04-25 03:30:42.100731] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.709 [2024-04-25 03:30:42.109312] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.709 qpair failed and we were unable to recover it. 00:30:07.709 [2024-04-25 03:30:42.120780] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.709 [2024-04-25 03:30:42.120820] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.709 [2024-04-25 03:30:42.120834] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.709 [2024-04-25 03:30:42.120840] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.709 [2024-04-25 03:30:42.120846] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.709 [2024-04-25 03:30:42.129325] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.709 qpair failed and we were unable to recover it. 00:30:07.709 [2024-04-25 03:30:42.141016] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.709 [2024-04-25 03:30:42.141057] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.709 [2024-04-25 03:30:42.141070] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.709 [2024-04-25 03:30:42.141077] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.709 [2024-04-25 03:30:42.141082] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.709 [2024-04-25 03:30:42.149549] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.709 qpair failed and we were unable to recover it. 00:30:07.709 [2024-04-25 03:30:42.160953] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.709 [2024-04-25 03:30:42.160996] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.709 [2024-04-25 03:30:42.161010] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.709 [2024-04-25 03:30:42.161016] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.709 [2024-04-25 03:30:42.161022] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.709 [2024-04-25 03:30:42.169560] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.709 qpair failed and we were unable to recover it. 00:30:07.709 [2024-04-25 03:30:42.180940] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.709 [2024-04-25 03:30:42.180985] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.709 [2024-04-25 03:30:42.180999] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.709 [2024-04-25 03:30:42.181005] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.709 [2024-04-25 03:30:42.181011] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.709 [2024-04-25 03:30:42.189619] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.709 qpair failed and we were unable to recover it. 00:30:07.709 [2024-04-25 03:30:42.201156] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.709 [2024-04-25 03:30:42.201195] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.709 [2024-04-25 03:30:42.201209] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.709 [2024-04-25 03:30:42.201218] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.709 [2024-04-25 03:30:42.201224] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.971 [2024-04-25 03:30:42.209633] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.971 qpair failed and we were unable to recover it. 00:30:07.971 [2024-04-25 03:30:42.221224] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.971 [2024-04-25 03:30:42.221262] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.971 [2024-04-25 03:30:42.221276] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.971 [2024-04-25 03:30:42.221282] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.971 [2024-04-25 03:30:42.221288] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.971 [2024-04-25 03:30:42.229617] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.971 qpair failed and we were unable to recover it. 00:30:07.971 [2024-04-25 03:30:42.241276] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.971 [2024-04-25 03:30:42.241318] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.971 [2024-04-25 03:30:42.241331] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.971 [2024-04-25 03:30:42.241337] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.971 [2024-04-25 03:30:42.241343] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.971 [2024-04-25 03:30:42.249717] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.971 qpair failed and we were unable to recover it. 00:30:07.971 [2024-04-25 03:30:42.261243] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.971 [2024-04-25 03:30:42.261287] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.971 [2024-04-25 03:30:42.261301] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.971 [2024-04-25 03:30:42.261308] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.971 [2024-04-25 03:30:42.261313] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.971 [2024-04-25 03:30:42.269740] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.971 qpair failed and we were unable to recover it. 00:30:07.971 [2024-04-25 03:30:42.281414] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.971 [2024-04-25 03:30:42.281456] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.971 [2024-04-25 03:30:42.281470] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.971 [2024-04-25 03:30:42.281476] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.971 [2024-04-25 03:30:42.281482] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.971 [2024-04-25 03:30:42.289909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.971 qpair failed and we were unable to recover it. 00:30:07.971 [2024-04-25 03:30:42.301460] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.971 [2024-04-25 03:30:42.301501] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.971 [2024-04-25 03:30:42.301515] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.971 [2024-04-25 03:30:42.301521] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.971 [2024-04-25 03:30:42.301527] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.971 [2024-04-25 03:30:42.309927] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.971 qpair failed and we were unable to recover it. 00:30:07.971 [2024-04-25 03:30:42.321539] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.971 [2024-04-25 03:30:42.321581] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.971 [2024-04-25 03:30:42.321594] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.971 [2024-04-25 03:30:42.321601] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.971 [2024-04-25 03:30:42.321606] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.971 [2024-04-25 03:30:42.329996] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.971 qpair failed and we were unable to recover it. 00:30:07.971 [2024-04-25 03:30:42.341586] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.971 [2024-04-25 03:30:42.341632] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.971 [2024-04-25 03:30:42.341645] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.971 [2024-04-25 03:30:42.341651] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.971 [2024-04-25 03:30:42.341657] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.971 [2024-04-25 03:30:42.350022] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.971 qpair failed and we were unable to recover it. 00:30:07.971 [2024-04-25 03:30:42.361652] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.972 [2024-04-25 03:30:42.361692] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.972 [2024-04-25 03:30:42.361706] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.972 [2024-04-25 03:30:42.361712] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.972 [2024-04-25 03:30:42.361718] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.972 [2024-04-25 03:30:42.370085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.972 qpair failed and we were unable to recover it. 00:30:07.972 [2024-04-25 03:30:42.381731] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.972 [2024-04-25 03:30:42.381771] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.972 [2024-04-25 03:30:42.381790] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.972 [2024-04-25 03:30:42.381796] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.972 [2024-04-25 03:30:42.381802] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.972 [2024-04-25 03:30:42.390145] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.972 qpair failed and we were unable to recover it. 00:30:07.972 [2024-04-25 03:30:42.401785] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.972 [2024-04-25 03:30:42.401829] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.972 [2024-04-25 03:30:42.401842] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.972 [2024-04-25 03:30:42.401848] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.972 [2024-04-25 03:30:42.401857] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.972 [2024-04-25 03:30:42.410263] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.972 qpair failed and we were unable to recover it. 00:30:07.972 [2024-04-25 03:30:42.421839] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.972 [2024-04-25 03:30:42.421882] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.972 [2024-04-25 03:30:42.421895] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.972 [2024-04-25 03:30:42.421902] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.972 [2024-04-25 03:30:42.421907] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.972 [2024-04-25 03:30:42.430310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.972 qpair failed and we were unable to recover it. 00:30:07.972 [2024-04-25 03:30:42.441887] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.972 [2024-04-25 03:30:42.441924] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.972 [2024-04-25 03:30:42.441937] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.972 [2024-04-25 03:30:42.441944] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.972 [2024-04-25 03:30:42.441949] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:07.972 [2024-04-25 03:30:42.450358] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.972 qpair failed and we were unable to recover it. 00:30:07.972 [2024-04-25 03:30:42.461908] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:07.972 [2024-04-25 03:30:42.461952] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:07.972 [2024-04-25 03:30:42.461965] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:07.972 [2024-04-25 03:30:42.461972] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:07.972 [2024-04-25 03:30:42.461981] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.235 [2024-04-25 03:30:42.470469] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.235 qpair failed and we were unable to recover it. 00:30:08.235 [2024-04-25 03:30:42.482001] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.235 [2024-04-25 03:30:42.482047] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.235 [2024-04-25 03:30:42.482060] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.235 [2024-04-25 03:30:42.482066] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.235 [2024-04-25 03:30:42.482072] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.235 [2024-04-25 03:30:42.490474] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.235 qpair failed and we were unable to recover it. 00:30:08.235 [2024-04-25 03:30:42.502085] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.235 [2024-04-25 03:30:42.502129] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.235 [2024-04-25 03:30:42.502143] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.235 [2024-04-25 03:30:42.502149] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.235 [2024-04-25 03:30:42.502154] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.235 [2024-04-25 03:30:42.510557] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.235 qpair failed and we were unable to recover it. 00:30:08.235 [2024-04-25 03:30:42.522153] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.235 [2024-04-25 03:30:42.522193] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.235 [2024-04-25 03:30:42.522207] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.235 [2024-04-25 03:30:42.522213] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.235 [2024-04-25 03:30:42.522218] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.235 [2024-04-25 03:30:42.530569] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.235 qpair failed and we were unable to recover it. 00:30:08.235 [2024-04-25 03:30:42.542220] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.235 [2024-04-25 03:30:42.542262] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.235 [2024-04-25 03:30:42.542276] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.235 [2024-04-25 03:30:42.542282] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.235 [2024-04-25 03:30:42.542288] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.235 [2024-04-25 03:30:42.550644] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.235 qpair failed and we were unable to recover it. 00:30:08.235 [2024-04-25 03:30:42.562232] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.235 [2024-04-25 03:30:42.562275] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.235 [2024-04-25 03:30:42.562288] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.235 [2024-04-25 03:30:42.562295] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.235 [2024-04-25 03:30:42.562301] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.235 [2024-04-25 03:30:42.570763] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.235 qpair failed and we were unable to recover it. 00:30:08.235 [2024-04-25 03:30:42.582284] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.235 [2024-04-25 03:30:42.582327] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.235 [2024-04-25 03:30:42.582340] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.235 [2024-04-25 03:30:42.582347] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.235 [2024-04-25 03:30:42.582353] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.235 [2024-04-25 03:30:42.590747] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.235 qpair failed and we were unable to recover it. 00:30:08.235 [2024-04-25 03:30:42.602336] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.235 [2024-04-25 03:30:42.602379] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.235 [2024-04-25 03:30:42.602392] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.235 [2024-04-25 03:30:42.602399] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.235 [2024-04-25 03:30:42.602405] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.235 [2024-04-25 03:30:42.610841] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.235 qpair failed and we were unable to recover it. 00:30:08.235 [2024-04-25 03:30:42.622412] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.235 [2024-04-25 03:30:42.622454] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.235 [2024-04-25 03:30:42.622467] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.235 [2024-04-25 03:30:42.622474] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.235 [2024-04-25 03:30:42.622479] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.235 [2024-04-25 03:30:42.630945] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.235 qpair failed and we were unable to recover it. 00:30:08.235 [2024-04-25 03:30:42.642320] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.235 [2024-04-25 03:30:42.642364] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.235 [2024-04-25 03:30:42.642377] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.235 [2024-04-25 03:30:42.642386] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.235 [2024-04-25 03:30:42.642392] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.235 [2024-04-25 03:30:42.650969] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.235 qpair failed and we were unable to recover it. 00:30:08.235 [2024-04-25 03:30:42.662518] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.235 [2024-04-25 03:30:42.662561] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.235 [2024-04-25 03:30:42.662575] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.235 [2024-04-25 03:30:42.662581] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.235 [2024-04-25 03:30:42.662586] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.235 [2024-04-25 03:30:42.671053] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.235 qpair failed and we were unable to recover it. 00:30:08.235 [2024-04-25 03:30:42.682549] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.235 [2024-04-25 03:30:42.682593] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.235 [2024-04-25 03:30:42.682606] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.235 [2024-04-25 03:30:42.682613] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.235 [2024-04-25 03:30:42.682618] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.235 [2024-04-25 03:30:42.691092] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.235 qpair failed and we were unable to recover it. 00:30:08.235 [2024-04-25 03:30:42.702672] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.235 [2024-04-25 03:30:42.702711] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.235 [2024-04-25 03:30:42.702725] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.235 [2024-04-25 03:30:42.702731] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.235 [2024-04-25 03:30:42.702737] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.235 [2024-04-25 03:30:42.711098] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.235 qpair failed and we were unable to recover it. 00:30:08.235 [2024-04-25 03:30:42.722745] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.236 [2024-04-25 03:30:42.722787] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.236 [2024-04-25 03:30:42.722800] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.236 [2024-04-25 03:30:42.722807] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.236 [2024-04-25 03:30:42.722812] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.236 [2024-04-25 03:30:42.731151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.236 qpair failed and we were unable to recover it. 00:30:08.495 [2024-04-25 03:30:42.742743] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.495 [2024-04-25 03:30:42.742790] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.495 [2024-04-25 03:30:42.742803] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.495 [2024-04-25 03:30:42.742809] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.495 [2024-04-25 03:30:42.742815] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.495 [2024-04-25 03:30:42.751311] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.495 qpair failed and we were unable to recover it. 00:30:08.495 [2024-04-25 03:30:42.762793] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.496 [2024-04-25 03:30:42.762835] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.496 [2024-04-25 03:30:42.762848] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.496 [2024-04-25 03:30:42.762859] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.496 [2024-04-25 03:30:42.762865] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.496 [2024-04-25 03:30:42.771294] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-04-25 03:30:42.782891] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.496 [2024-04-25 03:30:42.782932] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.496 [2024-04-25 03:30:42.782945] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.496 [2024-04-25 03:30:42.782951] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.496 [2024-04-25 03:30:42.782957] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.496 [2024-04-25 03:30:42.791398] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-04-25 03:30:42.802948] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.496 [2024-04-25 03:30:42.802990] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.496 [2024-04-25 03:30:42.803003] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.496 [2024-04-25 03:30:42.803009] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.496 [2024-04-25 03:30:42.803015] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.496 [2024-04-25 03:30:42.811427] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-04-25 03:30:42.823016] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.496 [2024-04-25 03:30:42.823056] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.496 [2024-04-25 03:30:42.823072] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.496 [2024-04-25 03:30:42.823078] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.496 [2024-04-25 03:30:42.823084] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.496 [2024-04-25 03:30:42.831465] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-04-25 03:30:42.843022] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.496 [2024-04-25 03:30:42.843066] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.496 [2024-04-25 03:30:42.843080] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.496 [2024-04-25 03:30:42.843086] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.496 [2024-04-25 03:30:42.843092] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.496 [2024-04-25 03:30:42.851567] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-04-25 03:30:42.862997] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.496 [2024-04-25 03:30:42.863037] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.496 [2024-04-25 03:30:42.863051] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.496 [2024-04-25 03:30:42.863057] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.496 [2024-04-25 03:30:42.863063] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.496 [2024-04-25 03:30:42.871628] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-04-25 03:30:42.883204] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.496 [2024-04-25 03:30:42.883244] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.496 [2024-04-25 03:30:42.883258] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.496 [2024-04-25 03:30:42.883265] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.496 [2024-04-25 03:30:42.883270] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.496 [2024-04-25 03:30:42.891649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-04-25 03:30:42.903145] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.496 [2024-04-25 03:30:42.903187] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.496 [2024-04-25 03:30:42.903201] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.496 [2024-04-25 03:30:42.903207] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.496 [2024-04-25 03:30:42.903215] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.496 [2024-04-25 03:30:42.911661] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-04-25 03:30:42.923259] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.496 [2024-04-25 03:30:42.923296] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.496 [2024-04-25 03:30:42.923310] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.496 [2024-04-25 03:30:42.923316] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.496 [2024-04-25 03:30:42.923322] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.496 [2024-04-25 03:30:42.931809] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-04-25 03:30:42.943325] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.496 [2024-04-25 03:30:42.943359] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.496 [2024-04-25 03:30:42.943373] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.496 [2024-04-25 03:30:42.943379] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.496 [2024-04-25 03:30:42.943385] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.496 [2024-04-25 03:30:42.951886] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-04-25 03:30:42.963372] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.496 [2024-04-25 03:30:42.963412] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.496 [2024-04-25 03:30:42.963425] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.496 [2024-04-25 03:30:42.963432] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.496 [2024-04-25 03:30:42.963437] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.496 [2024-04-25 03:30:42.971913] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.496 [2024-04-25 03:30:42.983496] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.496 [2024-04-25 03:30:42.983540] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.496 [2024-04-25 03:30:42.983553] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.496 [2024-04-25 03:30:42.983560] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.496 [2024-04-25 03:30:42.983565] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.496 [2024-04-25 03:30:42.991960] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.496 qpair failed and we were unable to recover it. 00:30:08.755 [2024-04-25 03:30:43.003403] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.755 [2024-04-25 03:30:43.003442] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.755 [2024-04-25 03:30:43.003456] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.755 [2024-04-25 03:30:43.003462] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.755 [2024-04-25 03:30:43.003468] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.755 [2024-04-25 03:30:43.012039] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.755 qpair failed and we were unable to recover it. 00:30:08.755 [2024-04-25 03:30:43.023556] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.755 [2024-04-25 03:30:43.023595] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.755 [2024-04-25 03:30:43.023608] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.755 [2024-04-25 03:30:43.023614] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.755 [2024-04-25 03:30:43.023620] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.755 [2024-04-25 03:30:43.032102] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.755 qpair failed and we were unable to recover it. 00:30:08.755 [2024-04-25 03:30:43.043651] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.755 [2024-04-25 03:30:43.043692] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.755 [2024-04-25 03:30:43.043706] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.755 [2024-04-25 03:30:43.043712] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.755 [2024-04-25 03:30:43.043718] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.755 [2024-04-25 03:30:43.052128] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.755 qpair failed and we were unable to recover it. 00:30:08.755 [2024-04-25 03:30:43.063690] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.755 [2024-04-25 03:30:43.063738] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.755 [2024-04-25 03:30:43.063752] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.755 [2024-04-25 03:30:43.063759] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.755 [2024-04-25 03:30:43.063765] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.755 [2024-04-25 03:30:43.072240] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.755 qpair failed and we were unable to recover it. 00:30:08.755 [2024-04-25 03:30:43.083841] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.755 [2024-04-25 03:30:43.083882] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.755 [2024-04-25 03:30:43.083899] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.755 [2024-04-25 03:30:43.083906] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.755 [2024-04-25 03:30:43.083912] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.756 [2024-04-25 03:30:43.092317] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.756 qpair failed and we were unable to recover it. 00:30:08.756 [2024-04-25 03:30:43.103925] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.756 [2024-04-25 03:30:43.103968] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.756 [2024-04-25 03:30:43.103982] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.756 [2024-04-25 03:30:43.103988] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.756 [2024-04-25 03:30:43.103994] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.756 [2024-04-25 03:30:43.112422] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.756 qpair failed and we were unable to recover it. 00:30:08.756 [2024-04-25 03:30:43.124028] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.756 [2024-04-25 03:30:43.124071] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.756 [2024-04-25 03:30:43.124085] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.756 [2024-04-25 03:30:43.124092] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.756 [2024-04-25 03:30:43.124098] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.756 [2024-04-25 03:30:43.132405] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.756 qpair failed and we were unable to recover it. 00:30:08.756 [2024-04-25 03:30:43.144028] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.756 [2024-04-25 03:30:43.144073] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.756 [2024-04-25 03:30:43.144087] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.756 [2024-04-25 03:30:43.144093] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.756 [2024-04-25 03:30:43.144099] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.756 [2024-04-25 03:30:43.152510] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.756 qpair failed and we were unable to recover it. 00:30:08.756 [2024-04-25 03:30:43.164140] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.756 [2024-04-25 03:30:43.164182] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.756 [2024-04-25 03:30:43.164195] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.756 [2024-04-25 03:30:43.164201] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.756 [2024-04-25 03:30:43.164206] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.756 [2024-04-25 03:30:43.172552] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.756 qpair failed and we were unable to recover it. 00:30:08.756 [2024-04-25 03:30:43.184151] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.756 [2024-04-25 03:30:43.184195] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.756 [2024-04-25 03:30:43.184209] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.756 [2024-04-25 03:30:43.184215] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.756 [2024-04-25 03:30:43.184221] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.756 [2024-04-25 03:30:43.192565] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.756 qpair failed and we were unable to recover it. 00:30:08.756 [2024-04-25 03:30:43.204243] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.756 [2024-04-25 03:30:43.204285] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.756 [2024-04-25 03:30:43.204299] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.756 [2024-04-25 03:30:43.204305] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.756 [2024-04-25 03:30:43.204311] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.756 [2024-04-25 03:30:43.212701] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.756 qpair failed and we were unable to recover it. 00:30:08.756 [2024-04-25 03:30:43.224213] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.756 [2024-04-25 03:30:43.224259] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.756 [2024-04-25 03:30:43.224273] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.756 [2024-04-25 03:30:43.224279] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.756 [2024-04-25 03:30:43.224284] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.756 [2024-04-25 03:30:43.232729] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.756 qpair failed and we were unable to recover it. 00:30:08.756 [2024-04-25 03:30:43.244354] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:08.756 [2024-04-25 03:30:43.244398] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:08.756 [2024-04-25 03:30:43.244411] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:08.756 [2024-04-25 03:30:43.244418] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:08.756 [2024-04-25 03:30:43.244423] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:08.756 [2024-04-25 03:30:43.252740] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:08.756 qpair failed and we were unable to recover it. 00:30:09.015 [2024-04-25 03:30:43.264291] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.015 [2024-04-25 03:30:43.264337] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.015 [2024-04-25 03:30:43.264354] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.015 [2024-04-25 03:30:43.264360] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.015 [2024-04-25 03:30:43.264366] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.015 [2024-04-25 03:30:43.272827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.015 qpair failed and we were unable to recover it. 00:30:09.015 [2024-04-25 03:30:43.284379] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.015 [2024-04-25 03:30:43.284421] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.015 [2024-04-25 03:30:43.284435] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.015 [2024-04-25 03:30:43.284442] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.015 [2024-04-25 03:30:43.284448] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.015 [2024-04-25 03:30:43.292830] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.015 qpair failed and we were unable to recover it. 00:30:09.015 [2024-04-25 03:30:43.304385] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.015 [2024-04-25 03:30:43.304432] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.015 [2024-04-25 03:30:43.304446] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.015 [2024-04-25 03:30:43.304453] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.015 [2024-04-25 03:30:43.304458] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.015 [2024-04-25 03:30:43.313008] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.015 qpair failed and we were unable to recover it. 00:30:09.015 [2024-04-25 03:30:43.324532] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.015 [2024-04-25 03:30:43.324571] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.015 [2024-04-25 03:30:43.324584] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.015 [2024-04-25 03:30:43.324590] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.015 [2024-04-25 03:30:43.324596] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.015 [2024-04-25 03:30:43.333002] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.015 qpair failed and we were unable to recover it. 00:30:09.015 [2024-04-25 03:30:43.344557] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.015 [2024-04-25 03:30:43.344599] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.015 [2024-04-25 03:30:43.344613] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.015 [2024-04-25 03:30:43.344619] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.015 [2024-04-25 03:30:43.344628] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.015 [2024-04-25 03:30:43.353070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.015 qpair failed and we were unable to recover it. 00:30:09.015 [2024-04-25 03:30:43.364604] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.015 [2024-04-25 03:30:43.364647] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.015 [2024-04-25 03:30:43.364661] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.015 [2024-04-25 03:30:43.364668] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.015 [2024-04-25 03:30:43.364674] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.015 [2024-04-25 03:30:43.373153] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.015 qpair failed and we were unable to recover it. 00:30:09.015 [2024-04-25 03:30:43.384650] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.015 [2024-04-25 03:30:43.384689] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.015 [2024-04-25 03:30:43.384702] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.015 [2024-04-25 03:30:43.384708] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.015 [2024-04-25 03:30:43.384714] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.015 [2024-04-25 03:30:43.393107] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.015 qpair failed and we were unable to recover it. 00:30:09.015 [2024-04-25 03:30:43.404662] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.015 [2024-04-25 03:30:43.404701] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.015 [2024-04-25 03:30:43.404715] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.015 [2024-04-25 03:30:43.404721] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.015 [2024-04-25 03:30:43.404727] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.015 [2024-04-25 03:30:43.413238] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.015 qpair failed and we were unable to recover it. 00:30:09.015 [2024-04-25 03:30:43.424775] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.015 [2024-04-25 03:30:43.424816] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.015 [2024-04-25 03:30:43.424830] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.015 [2024-04-25 03:30:43.424836] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.015 [2024-04-25 03:30:43.424842] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.015 [2024-04-25 03:30:43.433266] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.015 qpair failed and we were unable to recover it. 00:30:09.016 [2024-04-25 03:30:43.444792] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.016 [2024-04-25 03:30:43.444837] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.016 [2024-04-25 03:30:43.444851] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.016 [2024-04-25 03:30:43.444862] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.016 [2024-04-25 03:30:43.444868] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.016 [2024-04-25 03:30:43.453399] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.016 qpair failed and we were unable to recover it. 00:30:09.016 [2024-04-25 03:30:43.464983] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.016 [2024-04-25 03:30:43.465024] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.016 [2024-04-25 03:30:43.465037] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.016 [2024-04-25 03:30:43.465043] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.016 [2024-04-25 03:30:43.465049] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.016 [2024-04-25 03:30:43.473388] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.016 qpair failed and we were unable to recover it. 00:30:09.016 [2024-04-25 03:30:43.485021] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.016 [2024-04-25 03:30:43.485060] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.016 [2024-04-25 03:30:43.485073] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.016 [2024-04-25 03:30:43.485080] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.016 [2024-04-25 03:30:43.485086] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.016 [2024-04-25 03:30:43.493382] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.016 qpair failed and we were unable to recover it. 00:30:09.016 [2024-04-25 03:30:43.505047] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.016 [2024-04-25 03:30:43.505091] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.016 [2024-04-25 03:30:43.505106] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.016 [2024-04-25 03:30:43.505112] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.016 [2024-04-25 03:30:43.505118] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.275 [2024-04-25 03:30:43.513547] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.275 qpair failed and we were unable to recover it. 00:30:09.275 [2024-04-25 03:30:43.525166] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.275 [2024-04-25 03:30:43.525205] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.275 [2024-04-25 03:30:43.525222] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.275 [2024-04-25 03:30:43.525228] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.275 [2024-04-25 03:30:43.525234] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.275 [2024-04-25 03:30:43.533485] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.275 qpair failed and we were unable to recover it. 00:30:09.275 [2024-04-25 03:30:43.545161] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.275 [2024-04-25 03:30:43.545208] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.275 [2024-04-25 03:30:43.545221] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.275 [2024-04-25 03:30:43.545228] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.275 [2024-04-25 03:30:43.545234] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.275 [2024-04-25 03:30:43.553510] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.275 qpair failed and we were unable to recover it. 00:30:09.275 [2024-04-25 03:30:43.565185] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.275 [2024-04-25 03:30:43.565226] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.275 [2024-04-25 03:30:43.565240] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.275 [2024-04-25 03:30:43.565246] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.275 [2024-04-25 03:30:43.565251] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.275 [2024-04-25 03:30:43.573766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.275 qpair failed and we were unable to recover it. 00:30:09.275 [2024-04-25 03:30:43.585292] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.275 [2024-04-25 03:30:43.585336] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.275 [2024-04-25 03:30:43.585349] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.275 [2024-04-25 03:30:43.585356] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.275 [2024-04-25 03:30:43.585361] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.275 [2024-04-25 03:30:43.593787] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.275 qpair failed and we were unable to recover it. 00:30:09.275 [2024-04-25 03:30:43.605344] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.275 [2024-04-25 03:30:43.605386] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.275 [2024-04-25 03:30:43.605399] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.275 [2024-04-25 03:30:43.605406] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.275 [2024-04-25 03:30:43.605412] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.275 [2024-04-25 03:30:43.613721] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.275 qpair failed and we were unable to recover it. 00:30:09.275 [2024-04-25 03:30:43.625282] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.275 [2024-04-25 03:30:43.625325] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.275 [2024-04-25 03:30:43.625339] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.275 [2024-04-25 03:30:43.625345] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.275 [2024-04-25 03:30:43.625351] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.275 [2024-04-25 03:30:43.633826] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.275 qpair failed and we were unable to recover it. 00:30:09.275 [2024-04-25 03:30:43.645334] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.275 [2024-04-25 03:30:43.645376] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.275 [2024-04-25 03:30:43.645389] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.275 [2024-04-25 03:30:43.645396] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.275 [2024-04-25 03:30:43.645401] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.275 [2024-04-25 03:30:43.653871] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.275 qpair failed and we were unable to recover it. 00:30:09.275 [2024-04-25 03:30:43.665361] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.275 [2024-04-25 03:30:43.665397] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.275 [2024-04-25 03:30:43.665410] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.275 [2024-04-25 03:30:43.665416] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.275 [2024-04-25 03:30:43.665422] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.275 [2024-04-25 03:30:43.673782] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.275 qpair failed and we were unable to recover it. 00:30:09.275 [2024-04-25 03:30:43.685369] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.275 [2024-04-25 03:30:43.685417] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.275 [2024-04-25 03:30:43.685431] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.275 [2024-04-25 03:30:43.685438] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.275 [2024-04-25 03:30:43.685443] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.275 [2024-04-25 03:30:43.694064] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.275 qpair failed and we were unable to recover it. 00:30:09.275 [2024-04-25 03:30:43.705676] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.275 [2024-04-25 03:30:43.705717] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.275 [2024-04-25 03:30:43.705736] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.276 [2024-04-25 03:30:43.705742] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.276 [2024-04-25 03:30:43.705748] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.276 [2024-04-25 03:30:43.714089] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.276 qpair failed and we were unable to recover it. 00:30:09.276 [2024-04-25 03:30:43.725680] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.276 [2024-04-25 03:30:43.725717] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.276 [2024-04-25 03:30:43.725730] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.276 [2024-04-25 03:30:43.725736] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.276 [2024-04-25 03:30:43.725742] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.276 [2024-04-25 03:30:43.734200] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.276 qpair failed and we were unable to recover it. 00:30:09.276 [2024-04-25 03:30:43.745809] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.276 [2024-04-25 03:30:43.745844] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.276 [2024-04-25 03:30:43.745862] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.276 [2024-04-25 03:30:43.745869] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.276 [2024-04-25 03:30:43.745875] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.276 [2024-04-25 03:30:43.754221] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.276 qpair failed and we were unable to recover it. 00:30:09.276 [2024-04-25 03:30:43.765848] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.276 [2024-04-25 03:30:43.765894] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.276 [2024-04-25 03:30:43.765907] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.276 [2024-04-25 03:30:43.765913] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.276 [2024-04-25 03:30:43.765919] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.534 [2024-04-25 03:30:43.774249] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-04-25 03:30:43.785889] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.534 [2024-04-25 03:30:43.785932] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.534 [2024-04-25 03:30:43.785945] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.534 [2024-04-25 03:30:43.785951] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.534 [2024-04-25 03:30:43.785960] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.534 [2024-04-25 03:30:43.794324] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-04-25 03:30:43.806062] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.534 [2024-04-25 03:30:43.806103] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.534 [2024-04-25 03:30:43.806117] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.534 [2024-04-25 03:30:43.806123] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.534 [2024-04-25 03:30:43.806129] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.534 [2024-04-25 03:30:43.814471] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.534 qpair failed and we were unable to recover it. 00:30:09.534 [2024-04-25 03:30:43.825939] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.534 [2024-04-25 03:30:43.825981] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.534 [2024-04-25 03:30:43.825995] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.534 [2024-04-25 03:30:43.826001] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.534 [2024-04-25 03:30:43.826007] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.535 [2024-04-25 03:30:43.834463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-04-25 03:30:43.846042] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.535 [2024-04-25 03:30:43.846082] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.535 [2024-04-25 03:30:43.846096] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.535 [2024-04-25 03:30:43.846102] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.535 [2024-04-25 03:30:43.846108] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.535 [2024-04-25 03:30:43.854568] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-04-25 03:30:43.866069] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.535 [2024-04-25 03:30:43.866116] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.535 [2024-04-25 03:30:43.866129] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.535 [2024-04-25 03:30:43.866135] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.535 [2024-04-25 03:30:43.866141] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.535 [2024-04-25 03:30:43.874576] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-04-25 03:30:43.886109] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.535 [2024-04-25 03:30:43.886148] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.535 [2024-04-25 03:30:43.886162] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.535 [2024-04-25 03:30:43.886168] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.535 [2024-04-25 03:30:43.886174] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.535 [2024-04-25 03:30:43.894678] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-04-25 03:30:43.906367] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.535 [2024-04-25 03:30:43.906411] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.535 [2024-04-25 03:30:43.906426] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.535 [2024-04-25 03:30:43.906433] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.535 [2024-04-25 03:30:43.906438] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.535 [2024-04-25 03:30:43.914674] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-04-25 03:30:43.926373] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.535 [2024-04-25 03:30:43.926413] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.535 [2024-04-25 03:30:43.926427] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.535 [2024-04-25 03:30:43.926434] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.535 [2024-04-25 03:30:43.926440] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.535 [2024-04-25 03:30:43.934720] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-04-25 03:30:43.946373] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.535 [2024-04-25 03:30:43.946411] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.535 [2024-04-25 03:30:43.946424] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.535 [2024-04-25 03:30:43.946431] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.535 [2024-04-25 03:30:43.946437] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.535 [2024-04-25 03:30:43.954809] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-04-25 03:30:43.966534] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.535 [2024-04-25 03:30:43.966569] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.535 [2024-04-25 03:30:43.966585] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.535 [2024-04-25 03:30:43.966592] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.535 [2024-04-25 03:30:43.966597] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.535 [2024-04-25 03:30:43.974889] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-04-25 03:30:43.986449] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.535 [2024-04-25 03:30:43.986486] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.535 [2024-04-25 03:30:43.986499] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.535 [2024-04-25 03:30:43.986506] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.535 [2024-04-25 03:30:43.986511] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.535 [2024-04-25 03:30:43.994928] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-04-25 03:30:44.006588] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.535 [2024-04-25 03:30:44.006631] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.535 [2024-04-25 03:30:44.006644] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.535 [2024-04-25 03:30:44.006650] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.535 [2024-04-25 03:30:44.006656] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.535 [2024-04-25 03:30:44.014970] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.535 qpair failed and we were unable to recover it. 00:30:09.535 [2024-04-25 03:30:44.026550] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.535 [2024-04-25 03:30:44.026592] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.535 [2024-04-25 03:30:44.026606] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.535 [2024-04-25 03:30:44.026612] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.535 [2024-04-25 03:30:44.026618] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.793 [2024-04-25 03:30:44.035010] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.793 qpair failed and we were unable to recover it. 00:30:09.793 [2024-04-25 03:30:44.046657] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:09.793 [2024-04-25 03:30:44.046699] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:09.793 [2024-04-25 03:30:44.046712] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:09.793 [2024-04-25 03:30:44.046718] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:09.793 [2024-04-25 03:30:44.046724] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:09.793 [2024-04-25 03:30:44.055078] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:09.793 qpair failed and we were unable to recover it. 00:30:10.361 [2024-04-25 03:30:44.574871] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:30:10.361 Write completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Read completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Read completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Read completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Write completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Write completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Write completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Write completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Read completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Write completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Write completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Read completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Read completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Read completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Write completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Read completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Write completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Read completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Write completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Read completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Write completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Write completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Read completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Write completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Write completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Read completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Read completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Read completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Read completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Read completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Read completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 Write completed with error (sct=0, sc=8) 00:30:10.361 starting I/O failed 00:30:10.361 [2024-04-25 03:30:44.575324] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:10.361 [2024-04-25 03:30:44.588149] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.361 [2024-04-25 03:30:44.588188] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.361 [2024-04-25 03:30:44.588203] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.361 [2024-04-25 03:30:44.588210] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.361 [2024-04-25 03:30:44.588216] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000002d03c0 00:30:10.361 [2024-04-25 03:30:44.596692] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:10.361 qpair failed and we were unable to recover it. 00:30:10.361 [2024-04-25 03:30:44.608258] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.361 [2024-04-25 03:30:44.608303] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.361 [2024-04-25 03:30:44.608317] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.361 [2024-04-25 03:30:44.608324] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.361 [2024-04-25 03:30:44.608330] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000002d03c0 00:30:10.361 [2024-04-25 03:30:44.616678] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:10.361 qpair failed and we were unable to recover it. 00:30:10.930 [2024-04-25 03:30:45.152865] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:30:10.930 Read completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Read completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Read completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Read completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Read completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Write completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Read completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Write completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Read completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Write completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Write completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Write completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Read completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Write completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Read completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Write completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Write completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Write completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Read completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Write completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Read completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Write completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Read completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Write completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Write completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Write completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Read completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Write completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Read completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Read completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Write completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 Write completed with error (sct=0, sc=8) 00:30:10.930 starting I/O failed 00:30:10.930 [2024-04-25 03:30:45.153358] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:10.930 [2024-04-25 03:30:45.159837] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.930 [2024-04-25 03:30:45.159893] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.930 [2024-04-25 03:30:45.159908] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.930 [2024-04-25 03:30:45.159916] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.930 [2024-04-25 03:30:45.159922] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:30:10.930 [2024-04-25 03:30:45.168327] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:10.930 qpair failed and we were unable to recover it. 00:30:10.930 [2024-04-25 03:30:45.179967] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.930 [2024-04-25 03:30:45.180003] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.930 [2024-04-25 03:30:45.180018] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.930 [2024-04-25 03:30:45.180025] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.930 [2024-04-25 03:30:45.180033] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:30:10.930 [2024-04-25 03:30:45.188425] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:10.930 qpair failed and we were unable to recover it. 00:30:10.930 [2024-04-25 03:30:45.188540] nvme_ctrlr.c:4340:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:30:10.930 A controller has encountered a failure and is being reset. 00:30:10.930 [2024-04-25 03:30:45.188649] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:30:10.930 [2024-04-25 03:30:45.188982] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:30:10.930 Controller properly reset. 00:30:11.498 [2024-04-25 03:30:45.727870] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:30:11.498 Read completed with error (sct=0, sc=8) 00:30:11.498 starting I/O failed 00:30:11.498 Read completed with error (sct=0, sc=8) 00:30:11.498 starting I/O failed 00:30:11.498 Read completed with error (sct=0, sc=8) 00:30:11.498 starting I/O failed 00:30:11.498 Write completed with error (sct=0, sc=8) 00:30:11.498 starting I/O failed 00:30:11.498 Write completed with error (sct=0, sc=8) 00:30:11.498 starting I/O failed 00:30:11.498 Read completed with error (sct=0, sc=8) 00:30:11.498 starting I/O failed 00:30:11.498 Read completed with error (sct=0, sc=8) 00:30:11.498 starting I/O failed 00:30:11.498 Write completed with error (sct=0, sc=8) 00:30:11.498 starting I/O failed 00:30:11.498 Write completed with error (sct=0, sc=8) 00:30:11.498 starting I/O failed 00:30:11.498 Read completed with error (sct=0, sc=8) 00:30:11.498 starting I/O failed 00:30:11.498 Read completed with error (sct=0, sc=8) 00:30:11.498 starting I/O failed 00:30:11.498 Write completed with error (sct=0, sc=8) 00:30:11.498 starting I/O failed 00:30:11.498 Write completed with error (sct=0, sc=8) 00:30:11.498 starting I/O failed 00:30:11.498 Read completed with error (sct=0, sc=8) 00:30:11.498 starting I/O failed 00:30:11.498 Read completed with error (sct=0, sc=8) 00:30:11.498 starting I/O failed 00:30:11.498 Read completed with error (sct=0, sc=8) 00:30:11.498 starting I/O failed 00:30:11.498 Read completed with error (sct=0, sc=8) 00:30:11.498 starting I/O failed 00:30:11.498 Read completed with error (sct=0, sc=8) 00:30:11.498 starting I/O failed 00:30:11.498 Read completed with error (sct=0, sc=8) 00:30:11.498 starting I/O failed 00:30:11.498 Write completed with error (sct=0, sc=8) 00:30:11.498 starting I/O failed 00:30:11.498 Read completed with error (sct=0, sc=8) 00:30:11.498 starting I/O failed 00:30:11.498 Write completed with error (sct=0, sc=8) 00:30:11.498 starting I/O failed 00:30:11.498 Write completed with error (sct=0, sc=8) 00:30:11.498 starting I/O failed 00:30:11.498 Write completed with error (sct=0, sc=8) 00:30:11.498 starting I/O failed 00:30:11.498 Write completed with error (sct=0, sc=8) 00:30:11.498 starting I/O failed 00:30:11.498 Read completed with error (sct=0, sc=8) 00:30:11.499 starting I/O failed 00:30:11.499 Write completed with error (sct=0, sc=8) 00:30:11.499 starting I/O failed 00:30:11.499 Write completed with error (sct=0, sc=8) 00:30:11.499 starting I/O failed 00:30:11.499 Read completed with error (sct=0, sc=8) 00:30:11.499 starting I/O failed 00:30:11.499 Read completed with error (sct=0, sc=8) 00:30:11.499 starting I/O failed 00:30:11.499 Read completed with error (sct=0, sc=8) 00:30:11.499 starting I/O failed 00:30:11.499 Write completed with error (sct=0, sc=8) 00:30:11.499 starting I/O failed 00:30:11.499 [2024-04-25 03:30:45.728346] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.499 Initializing NVMe Controllers 00:30:11.499 Attaching to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:30:11.499 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:30:11.499 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:30:11.499 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:30:11.499 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:30:11.499 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:30:11.499 Initialization complete. Launching workers. 00:30:11.499 Starting thread on core 1 00:30:11.499 Starting thread on core 2 00:30:11.499 Starting thread on core 3 00:30:11.499 Starting thread on core 0 00:30:11.499 03:30:45 -- host/target_disconnect.sh@59 -- # sync 00:30:11.499 00:30:11.499 real 0m12.924s 00:30:11.499 user 0m26.854s 00:30:11.499 sys 0m3.028s 00:30:11.499 03:30:45 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:30:11.499 03:30:45 -- common/autotest_common.sh@10 -- # set +x 00:30:11.499 ************************************ 00:30:11.499 END TEST nvmf_target_disconnect_tc2 00:30:11.499 ************************************ 00:30:11.499 03:30:45 -- host/target_disconnect.sh@80 -- # '[' -n 192.168.100.9 ']' 00:30:11.499 03:30:45 -- host/target_disconnect.sh@81 -- # run_test nvmf_target_disconnect_tc3 nvmf_target_disconnect_tc3 00:30:11.499 03:30:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:11.499 03:30:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:11.499 03:30:45 -- common/autotest_common.sh@10 -- # set +x 00:30:11.499 ************************************ 00:30:11.499 START TEST nvmf_target_disconnect_tc3 00:30:11.499 ************************************ 00:30:11.499 03:30:45 -- common/autotest_common.sh@1111 -- # nvmf_target_disconnect_tc3 00:30:11.499 03:30:45 -- host/target_disconnect.sh@65 -- # reconnectpid=78722 00:30:11.499 03:30:45 -- host/target_disconnect.sh@67 -- # sleep 2 00:30:11.499 03:30:45 -- host/target_disconnect.sh@63 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 alt_traddr:192.168.100.9' 00:30:11.499 EAL: No free 2048 kB hugepages reported on node 1 00:30:14.035 03:30:47 -- host/target_disconnect.sh@68 -- # kill -9 77480 00:30:14.035 03:30:47 -- host/target_disconnect.sh@70 -- # sleep 2 00:30:14.294 [2024-04-25 03:30:48.670874] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:30:14.294 Write completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Write completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Read completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Write completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Read completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Read completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Read completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Read completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Write completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Read completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Read completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Read completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Read completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Write completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Read completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Read completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Write completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Write completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Read completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Read completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Read completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Write completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Write completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Write completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Read completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Read completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Write completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Write completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Write completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Read completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Write completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 Write completed with error (sct=0, sc=8) 00:30:14.294 starting I/O failed 00:30:14.294 [2024-04-25 03:30:48.671470] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:14.294 [2024-04-25 03:30:48.673295] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:30:14.294 [2024-04-25 03:30:48.673311] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:30:14.294 [2024-04-25 03:30:48.673317] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:30:15.230 [2024-04-25 03:30:49.676036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:15.230 qpair failed and we were unable to recover it. 00:30:15.231 [2024-04-25 03:30:49.677789] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:30:15.231 [2024-04-25 03:30:49.677803] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:30:15.231 [2024-04-25 03:30:49.677809] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:30:15.489 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 62: 77480 Killed "${NVMF_APP[@]}" "$@" 00:30:15.489 03:30:49 -- host/target_disconnect.sh@71 -- # disconnect_init 192.168.100.9 00:30:15.489 03:30:49 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:15.489 03:30:49 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:30:15.489 03:30:49 -- common/autotest_common.sh@710 -- # xtrace_disable 00:30:15.489 03:30:49 -- common/autotest_common.sh@10 -- # set +x 00:30:15.489 03:30:49 -- nvmf/common.sh@470 -- # nvmfpid=79403 00:30:15.489 03:30:49 -- nvmf/common.sh@471 -- # waitforlisten 79403 00:30:15.489 03:30:49 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:15.489 03:30:49 -- common/autotest_common.sh@817 -- # '[' -z 79403 ']' 00:30:15.489 03:30:49 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:15.489 03:30:49 -- common/autotest_common.sh@822 -- # local max_retries=100 00:30:15.489 03:30:49 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:15.489 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:15.489 03:30:49 -- common/autotest_common.sh@826 -- # xtrace_disable 00:30:15.489 03:30:49 -- common/autotest_common.sh@10 -- # set +x 00:30:15.753 [2024-04-25 03:30:50.003764] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:30:15.753 [2024-04-25 03:30:50.003812] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:15.754 EAL: No free 2048 kB hugepages reported on node 1 00:30:15.754 [2024-04-25 03:30:50.080070] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:15.754 [2024-04-25 03:30:50.153286] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:15.754 [2024-04-25 03:30:50.153326] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:15.754 [2024-04-25 03:30:50.153333] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:30:15.754 [2024-04-25 03:30:50.153338] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:30:15.754 [2024-04-25 03:30:50.153344] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:15.754 [2024-04-25 03:30:50.153459] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:15.754 [2024-04-25 03:30:50.153568] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:15.754 [2024-04-25 03:30:50.153674] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:15.754 [2024-04-25 03:30:50.153676] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:16.326 [2024-04-25 03:30:50.680523] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.326 qpair failed and we were unable to recover it. 00:30:16.326 [2024-04-25 03:30:50.682411] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:30:16.326 [2024-04-25 03:30:50.682427] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:30:16.326 [2024-04-25 03:30:50.682433] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:30:16.326 03:30:50 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:30:16.326 03:30:50 -- common/autotest_common.sh@850 -- # return 0 00:30:16.326 03:30:50 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:30:16.326 03:30:50 -- common/autotest_common.sh@716 -- # xtrace_disable 00:30:16.326 03:30:50 -- common/autotest_common.sh@10 -- # set +x 00:30:16.585 03:30:50 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:16.585 03:30:50 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:16.585 03:30:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:16.585 03:30:50 -- common/autotest_common.sh@10 -- # set +x 00:30:16.585 Malloc0 00:30:16.585 03:30:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:16.585 03:30:50 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:30:16.585 03:30:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:16.585 03:30:50 -- common/autotest_common.sh@10 -- # set +x 00:30:16.585 [2024-04-25 03:30:50.890748] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x1a4bf40/0x1a4b580) succeed. 00:30:16.585 [2024-04-25 03:30:50.900950] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x1a4d2f0/0x1a4bb00) succeed. 00:30:16.585 [2024-04-25 03:30:50.900971] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:30:16.585 03:30:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:16.585 03:30:50 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:16.585 03:30:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:16.585 03:30:50 -- common/autotest_common.sh@10 -- # set +x 00:30:16.585 03:30:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:16.585 03:30:50 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:16.585 03:30:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:16.585 03:30:50 -- common/autotest_common.sh@10 -- # set +x 00:30:16.585 03:30:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:16.585 03:30:50 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.9 -s 4420 00:30:16.585 03:30:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:16.585 03:30:50 -- common/autotest_common.sh@10 -- # set +x 00:30:16.585 [2024-04-25 03:30:50.929240] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:30:16.585 03:30:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:16.585 03:30:50 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.9 -s 4420 00:30:16.585 03:30:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:16.585 03:30:50 -- common/autotest_common.sh@10 -- # set +x 00:30:16.585 03:30:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:16.585 03:30:50 -- host/target_disconnect.sh@73 -- # wait 78722 00:30:17.521 [2024-04-25 03:30:51.685172] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:17.521 qpair failed and we were unable to recover it. 00:30:17.521 [2024-04-25 03:30:51.687020] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:30:17.521 [2024-04-25 03:30:51.687035] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:30:17.521 [2024-04-25 03:30:51.687040] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:30:18.456 [2024-04-25 03:30:52.689777] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:18.456 qpair failed and we were unable to recover it. 00:30:18.456 [2024-04-25 03:30:52.691678] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:30:18.456 [2024-04-25 03:30:52.691692] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:30:18.456 [2024-04-25 03:30:52.691697] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:30:19.392 [2024-04-25 03:30:53.694348] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:19.392 qpair failed and we were unable to recover it. 00:30:19.392 [2024-04-25 03:30:53.696175] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:30:19.392 [2024-04-25 03:30:53.696188] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:30:19.392 [2024-04-25 03:30:53.696193] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:30:20.374 [2024-04-25 03:30:54.698907] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.374 qpair failed and we were unable to recover it. 00:30:20.374 [2024-04-25 03:30:54.700723] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:30:20.374 [2024-04-25 03:30:54.700738] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:30:20.374 [2024-04-25 03:30:54.700744] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:30:21.310 [2024-04-25 03:30:55.703444] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.310 qpair failed and we were unable to recover it. 00:30:21.310 [2024-04-25 03:30:55.705239] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:30:21.310 [2024-04-25 03:30:55.705253] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:30:21.310 [2024-04-25 03:30:55.705258] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:30:22.248 [2024-04-25 03:30:56.707957] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.248 qpair failed and we were unable to recover it. 00:30:22.248 [2024-04-25 03:30:56.709836] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:30:22.248 [2024-04-25 03:30:56.709850] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:30:22.248 [2024-04-25 03:30:56.709859] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:30:23.626 [2024-04-25 03:30:57.712510] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.626 qpair failed and we were unable to recover it. 00:30:23.884 [2024-04-25 03:30:58.273865] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:30:23.884 Write completed with error (sct=0, sc=8) 00:30:23.884 starting I/O failed 00:30:23.885 Write completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Write completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Read completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Read completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Read completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Write completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Write completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Write completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Read completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Read completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Read completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Read completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Write completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Read completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Write completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Read completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Write completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Write completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Write completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Write completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Read completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Write completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Write completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Write completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Write completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Write completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Read completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Read completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Write completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Read completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 Read completed with error (sct=0, sc=8) 00:30:23.885 starting I/O failed 00:30:23.885 [2024-04-25 03:30:58.274322] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.885 [2024-04-25 03:30:58.276086] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:30:23.885 [2024-04-25 03:30:58.276099] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:30:23.885 [2024-04-25 03:30:58.276105] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000002d15c0 00:30:24.820 [2024-04-25 03:30:59.278756] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:24.820 qpair failed and we were unable to recover it. 00:30:24.820 [2024-04-25 03:30:59.280536] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:30:24.820 [2024-04-25 03:30:59.280551] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:30:24.820 [2024-04-25 03:30:59.280556] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000002d15c0 00:30:26.196 [2024-04-25 03:31:00.283236] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:26.196 qpair failed and we were unable to recover it. 00:30:26.455 [2024-04-25 03:31:00.831871] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:30:26.455 Write completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Read completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Read completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Read completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Write completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Read completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Write completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Write completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Write completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Read completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Write completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Read completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Write completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Read completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Read completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Write completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Read completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Write completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Read completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Read completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Write completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Read completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Read completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Write completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Write completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Write completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Read completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Read completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Write completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Write completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Read completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 Read completed with error (sct=0, sc=8) 00:30:26.455 starting I/O failed 00:30:26.455 [2024-04-25 03:31:00.832337] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:26.455 [2024-04-25 03:31:00.834084] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:30:26.455 [2024-04-25 03:31:00.834099] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:30:26.455 [2024-04-25 03:31:00.834105] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:30:27.393 [2024-04-25 03:31:01.836817] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:27.393 qpair failed and we were unable to recover it. 00:30:27.961 [2024-04-25 03:31:02.366869] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:30:27.961 Read completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Read completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Read completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Write completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Write completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Read completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Write completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Read completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Write completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Write completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Write completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Write completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Write completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Write completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Read completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Write completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Write completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Read completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Read completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Write completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Read completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Write completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Read completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Read completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Read completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Read completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Write completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Read completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Write completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Write completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Write completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 Read completed with error (sct=0, sc=8) 00:30:27.961 starting I/O failed 00:30:27.961 [2024-04-25 03:31:02.367370] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:27.961 [2024-04-25 03:31:02.369134] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:30:27.961 [2024-04-25 03:31:02.369149] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:30:27.961 [2024-04-25 03:31:02.369155] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:30:28.898 [2024-04-25 03:31:03.371807] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:28.898 qpair failed and we were unable to recover it. 00:30:28.898 [2024-04-25 03:31:03.373489] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:30:28.898 [2024-04-25 03:31:03.373507] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:30:28.898 [2024-04-25 03:31:03.373516] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:30:30.273 [2024-04-25 03:31:04.376176] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:30.273 qpair failed and we were unable to recover it. 00:30:30.273 [2024-04-25 03:31:04.376277] nvme_ctrlr.c:4340:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:30:30.273 A controller has encountered a failure and is being reset. 00:30:30.273 Resorting to new failover address 192.168.100.9 00:30:30.273 [2024-04-25 03:31:04.376362] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:30.273 [2024-04-25 03:31:04.376414] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:30:30.273 [2024-04-25 03:31:04.404747] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:30:30.273 Controller properly reset. 00:30:30.273 Initializing NVMe Controllers 00:30:30.273 Attaching to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:30:30.273 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:30:30.273 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:30:30.273 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:30:30.273 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:30:30.273 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:30:30.273 Initialization complete. Launching workers. 00:30:30.273 Starting thread on core 1 00:30:30.273 Starting thread on core 2 00:30:30.273 Starting thread on core 3 00:30:30.273 Starting thread on core 0 00:30:30.273 03:31:04 -- host/target_disconnect.sh@74 -- # sync 00:30:30.273 00:30:30.273 real 0m18.523s 00:30:30.273 user 0m59.916s 00:30:30.273 sys 0m4.641s 00:30:30.273 03:31:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:30:30.273 03:31:04 -- common/autotest_common.sh@10 -- # set +x 00:30:30.273 ************************************ 00:30:30.273 END TEST nvmf_target_disconnect_tc3 00:30:30.273 ************************************ 00:30:30.273 03:31:04 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:30:30.273 03:31:04 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:30:30.273 03:31:04 -- nvmf/common.sh@477 -- # nvmfcleanup 00:30:30.273 03:31:04 -- nvmf/common.sh@117 -- # sync 00:30:30.273 03:31:04 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:30:30.273 03:31:04 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:30:30.273 03:31:04 -- nvmf/common.sh@120 -- # set +e 00:30:30.273 03:31:04 -- nvmf/common.sh@121 -- # for i in {1..20} 00:30:30.273 03:31:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:30:30.273 rmmod nvme_rdma 00:30:30.273 rmmod nvme_fabrics 00:30:30.273 03:31:04 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:30:30.273 03:31:04 -- nvmf/common.sh@124 -- # set -e 00:30:30.273 03:31:04 -- nvmf/common.sh@125 -- # return 0 00:30:30.273 03:31:04 -- nvmf/common.sh@478 -- # '[' -n 79403 ']' 00:30:30.273 03:31:04 -- nvmf/common.sh@479 -- # killprocess 79403 00:30:30.273 03:31:04 -- common/autotest_common.sh@936 -- # '[' -z 79403 ']' 00:30:30.273 03:31:04 -- common/autotest_common.sh@940 -- # kill -0 79403 00:30:30.273 03:31:04 -- common/autotest_common.sh@941 -- # uname 00:30:30.273 03:31:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:30.273 03:31:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 79403 00:30:30.273 03:31:04 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:30:30.273 03:31:04 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:30:30.273 03:31:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 79403' 00:30:30.273 killing process with pid 79403 00:30:30.273 03:31:04 -- common/autotest_common.sh@955 -- # kill 79403 00:30:30.273 03:31:04 -- common/autotest_common.sh@960 -- # wait 79403 00:30:30.273 [2024-04-25 03:31:04.622183] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:30:30.532 03:31:04 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:30:30.532 03:31:04 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:30:30.532 00:30:30.532 real 0m38.894s 00:30:30.532 user 2m27.577s 00:30:30.532 sys 0m12.433s 00:30:30.532 03:31:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:30:30.532 03:31:04 -- common/autotest_common.sh@10 -- # set +x 00:30:30.532 ************************************ 00:30:30.532 END TEST nvmf_target_disconnect 00:30:30.532 ************************************ 00:30:30.532 03:31:04 -- nvmf/nvmf.sh@123 -- # timing_exit host 00:30:30.532 03:31:04 -- common/autotest_common.sh@716 -- # xtrace_disable 00:30:30.532 03:31:04 -- common/autotest_common.sh@10 -- # set +x 00:30:30.532 03:31:04 -- nvmf/nvmf.sh@125 -- # trap - SIGINT SIGTERM EXIT 00:30:30.532 00:30:30.533 real 24m6.488s 00:30:30.533 user 72m28.876s 00:30:30.533 sys 5m8.120s 00:30:30.533 03:31:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:30:30.533 03:31:04 -- common/autotest_common.sh@10 -- # set +x 00:30:30.533 ************************************ 00:30:30.533 END TEST nvmf_rdma 00:30:30.533 ************************************ 00:30:30.533 03:31:04 -- spdk/autotest.sh@283 -- # run_test spdkcli_nvmf_rdma /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=rdma 00:30:30.533 03:31:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:30.533 03:31:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:30.533 03:31:04 -- common/autotest_common.sh@10 -- # set +x 00:30:30.792 ************************************ 00:30:30.792 START TEST spdkcli_nvmf_rdma 00:30:30.792 ************************************ 00:30:30.792 03:31:05 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=rdma 00:30:30.792 * Looking for test storage... 00:30:30.792 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/spdkcli 00:30:30.792 03:31:05 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/spdkcli/common.sh 00:30:30.792 03:31:05 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:30:30.792 03:31:05 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/clear_config.py 00:30:30.792 03:31:05 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:30:30.792 03:31:05 -- nvmf/common.sh@7 -- # uname -s 00:30:30.792 03:31:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:30.792 03:31:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:30.792 03:31:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:30.792 03:31:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:30.792 03:31:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:30.792 03:31:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:30.792 03:31:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:30.792 03:31:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:30.792 03:31:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:30.792 03:31:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:30.792 03:31:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:801347e8-3fd0-e911-906e-0017a4403562 00:30:30.792 03:31:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=801347e8-3fd0-e911-906e-0017a4403562 00:30:30.792 03:31:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:30.792 03:31:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:30.792 03:31:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:30.792 03:31:05 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:30:30.792 03:31:05 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:30:30.792 03:31:05 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:30.792 03:31:05 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:30.792 03:31:05 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:30.792 03:31:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:30.792 03:31:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:30.792 03:31:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:30.792 03:31:05 -- paths/export.sh@5 -- # export PATH 00:30:30.792 03:31:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:30.792 03:31:05 -- nvmf/common.sh@47 -- # : 0 00:30:30.792 03:31:05 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:30:30.792 03:31:05 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:30:30.792 03:31:05 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:30:30.792 03:31:05 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:30.792 03:31:05 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:30.792 03:31:05 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:30:30.792 03:31:05 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:30:30.792 03:31:05 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:30:30.792 03:31:05 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:30:30.792 03:31:05 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:30:30.792 03:31:05 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:30:30.792 03:31:05 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:30:30.792 03:31:05 -- common/autotest_common.sh@710 -- # xtrace_disable 00:30:30.792 03:31:05 -- common/autotest_common.sh@10 -- # set +x 00:30:30.792 03:31:05 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:30:30.792 03:31:05 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=82002 00:30:30.792 03:31:05 -- spdkcli/common.sh@34 -- # waitforlisten 82002 00:30:30.792 03:31:05 -- common/autotest_common.sh@817 -- # '[' -z 82002 ']' 00:30:30.792 03:31:05 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:30.792 03:31:05 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:30:30.792 03:31:05 -- common/autotest_common.sh@822 -- # local max_retries=100 00:30:30.792 03:31:05 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:30.792 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:30.792 03:31:05 -- common/autotest_common.sh@826 -- # xtrace_disable 00:30:30.792 03:31:05 -- common/autotest_common.sh@10 -- # set +x 00:30:30.792 [2024-04-25 03:31:05.239151] Starting SPDK v24.05-pre git sha1 abd932d6f / DPDK 23.11.0 initialization... 00:30:30.792 [2024-04-25 03:31:05.239197] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid82002 ] 00:30:30.792 EAL: No free 2048 kB hugepages reported on node 1 00:30:31.051 [2024-04-25 03:31:05.298599] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:30:31.051 [2024-04-25 03:31:05.369743] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:31.051 [2024-04-25 03:31:05.369746] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:31.617 03:31:06 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:30:31.617 03:31:06 -- common/autotest_common.sh@850 -- # return 0 00:30:31.617 03:31:06 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:30:31.617 03:31:06 -- common/autotest_common.sh@716 -- # xtrace_disable 00:30:31.617 03:31:06 -- common/autotest_common.sh@10 -- # set +x 00:30:31.617 03:31:06 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:30:31.617 03:31:06 -- spdkcli/nvmf.sh@22 -- # [[ rdma == \r\d\m\a ]] 00:30:31.617 03:31:06 -- spdkcli/nvmf.sh@23 -- # nvmftestinit 00:30:31.617 03:31:06 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:30:31.617 03:31:06 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:31.617 03:31:06 -- nvmf/common.sh@437 -- # prepare_net_devs 00:30:31.617 03:31:06 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:30:31.617 03:31:06 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:30:31.617 03:31:06 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:31.617 03:31:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:31.617 03:31:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:31.617 03:31:06 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:30:31.617 03:31:06 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:30:31.617 03:31:06 -- nvmf/common.sh@285 -- # xtrace_disable 00:30:31.617 03:31:06 -- common/autotest_common.sh@10 -- # set +x 00:30:38.192 03:31:12 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:38.192 03:31:12 -- nvmf/common.sh@291 -- # pci_devs=() 00:30:38.192 03:31:12 -- nvmf/common.sh@291 -- # local -a pci_devs 00:30:38.192 03:31:12 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:30:38.192 03:31:12 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:30:38.192 03:31:12 -- nvmf/common.sh@293 -- # pci_drivers=() 00:30:38.192 03:31:12 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:30:38.192 03:31:12 -- nvmf/common.sh@295 -- # net_devs=() 00:30:38.192 03:31:12 -- nvmf/common.sh@295 -- # local -ga net_devs 00:30:38.192 03:31:12 -- nvmf/common.sh@296 -- # e810=() 00:30:38.192 03:31:12 -- nvmf/common.sh@296 -- # local -ga e810 00:30:38.192 03:31:12 -- nvmf/common.sh@297 -- # x722=() 00:30:38.192 03:31:12 -- nvmf/common.sh@297 -- # local -ga x722 00:30:38.192 03:31:12 -- nvmf/common.sh@298 -- # mlx=() 00:30:38.192 03:31:12 -- nvmf/common.sh@298 -- # local -ga mlx 00:30:38.192 03:31:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:38.192 03:31:12 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:38.192 03:31:12 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:38.192 03:31:12 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:38.192 03:31:12 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:38.192 03:31:12 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:38.192 03:31:12 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:38.192 03:31:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:38.192 03:31:12 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:38.192 03:31:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:38.192 03:31:12 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:38.192 03:31:12 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:30:38.192 03:31:12 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:30:38.192 03:31:12 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:30:38.192 03:31:12 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:30:38.192 03:31:12 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:30:38.192 03:31:12 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:30:38.192 03:31:12 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:30:38.192 03:31:12 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:30:38.192 03:31:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:30:38.192 03:31:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:30:38.192 Found 0000:af:00.0 (0x8086 - 0x159b) 00:30:38.192 03:31:12 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:30:38.192 03:31:12 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:30:38.192 03:31:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:38.192 03:31:12 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:38.192 03:31:12 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:30:38.192 03:31:12 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:30:38.192 03:31:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:30:38.192 03:31:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:30:38.192 Found 0000:af:00.1 (0x8086 - 0x159b) 00:30:38.192 03:31:12 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:30:38.192 03:31:12 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:30:38.192 03:31:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:38.192 03:31:12 -- nvmf/common.sh@351 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:38.192 03:31:12 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:30:38.192 03:31:12 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:30:38.192 03:31:12 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:30:38.193 03:31:12 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:30:38.193 03:31:12 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:30:38.193 03:31:12 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:30:38.193 03:31:12 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:30:38.193 03:31:12 -- nvmf/common.sh@377 -- # modinfo irdma 00:30:38.193 03:31:12 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:30:38.193 03:31:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:30:38.193 03:31:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:38.193 03:31:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:30:38.193 03:31:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:38.193 03:31:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:30:38.193 Found net devices under 0000:af:00.0: cvl_0_0 00:30:38.193 03:31:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:30:38.193 03:31:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:30:38.193 03:31:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:38.193 03:31:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:30:38.193 03:31:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:38.193 03:31:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:30:38.193 Found net devices under 0000:af:00.1: cvl_0_1 00:30:38.193 03:31:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:30:38.193 03:31:12 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:30:38.193 03:31:12 -- nvmf/common.sh@403 -- # is_hw=yes 00:30:38.193 03:31:12 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:30:38.193 03:31:12 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:30:38.193 03:31:12 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:30:38.193 03:31:12 -- nvmf/common.sh@409 -- # rdma_device_init 00:30:38.193 03:31:12 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:30:38.193 03:31:12 -- nvmf/common.sh@58 -- # uname 00:30:38.193 03:31:12 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:30:38.193 03:31:12 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:30:38.193 03:31:12 -- nvmf/common.sh@63 -- # modprobe ib_core 00:30:38.193 03:31:12 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:30:38.193 03:31:12 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:30:38.193 03:31:12 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:30:38.193 03:31:12 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:30:38.193 03:31:12 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:30:38.193 03:31:12 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:30:38.193 03:31:12 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:30:38.193 03:31:12 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:30:38.193 03:31:12 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:30:38.193 03:31:12 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:30:38.193 03:31:12 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:30:38.193 03:31:12 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:30:38.193 03:31:12 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:30:38.193 03:31:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:30:38.193 03:31:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:30:38.193 03:31:12 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:30:38.193 03:31:12 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:30:38.193 03:31:12 -- nvmf/common.sh@105 -- # continue 2 00:30:38.193 03:31:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:30:38.193 03:31:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:30:38.193 03:31:12 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:30:38.193 03:31:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:30:38.193 03:31:12 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:30:38.193 03:31:12 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:30:38.193 03:31:12 -- nvmf/common.sh@105 -- # continue 2 00:30:38.193 03:31:12 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:30:38.193 03:31:12 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:30:38.193 03:31:12 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:30:38.193 03:31:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:30:38.193 03:31:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:30:38.193 03:31:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:30:38.193 03:31:12 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:30:38.193 03:31:12 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:30:38.193 03:31:12 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:30:38.193 50: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:30:38.193 link/ether b4:96:91:a5:c8:d4 brd ff:ff:ff:ff:ff:ff 00:30:38.193 altname enp175s0f0np0 00:30:38.193 altname ens801f0np0 00:30:38.193 inet 192.168.100.8/24 scope global cvl_0_0 00:30:38.193 valid_lft forever preferred_lft forever 00:30:38.193 inet6 fe80::b696:91ff:fea5:c8d4/64 scope link proto kernel_ll 00:30:38.193 valid_lft forever preferred_lft forever 00:30:38.193 03:31:12 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:30:38.193 03:31:12 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:30:38.193 03:31:12 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:30:38.193 03:31:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:30:38.193 03:31:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:30:38.193 03:31:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:30:38.193 03:31:12 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:30:38.193 03:31:12 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:30:38.193 03:31:12 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:30:38.193 51: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:30:38.193 link/ether b4:96:91:a5:c8:d5 brd ff:ff:ff:ff:ff:ff 00:30:38.193 altname enp175s0f1np1 00:30:38.193 altname ens801f1np1 00:30:38.193 inet 192.168.100.9/24 scope global cvl_0_1 00:30:38.193 valid_lft forever preferred_lft forever 00:30:38.193 inet6 fe80::b696:91ff:fea5:c8d5/64 scope link proto kernel_ll 00:30:38.193 valid_lft forever preferred_lft forever 00:30:38.193 03:31:12 -- nvmf/common.sh@411 -- # return 0 00:30:38.193 03:31:12 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:30:38.193 03:31:12 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:30:38.193 03:31:12 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:30:38.193 03:31:12 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:30:38.193 03:31:12 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:30:38.193 03:31:12 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:30:38.193 03:31:12 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:30:38.193 03:31:12 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:30:38.193 03:31:12 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:30:38.193 03:31:12 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:30:38.193 03:31:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:30:38.193 03:31:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:30:38.193 03:31:12 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:30:38.193 03:31:12 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:30:38.193 03:31:12 -- nvmf/common.sh@105 -- # continue 2 00:30:38.193 03:31:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:30:38.193 03:31:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:30:38.193 03:31:12 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\0 ]] 00:30:38.193 03:31:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:30:38.193 03:31:12 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:30:38.193 03:31:12 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:30:38.193 03:31:12 -- nvmf/common.sh@105 -- # continue 2 00:30:38.193 03:31:12 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:30:38.193 03:31:12 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:30:38.193 03:31:12 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:30:38.193 03:31:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:30:38.193 03:31:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:30:38.193 03:31:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:30:38.193 03:31:12 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:30:38.193 03:31:12 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:30:38.193 03:31:12 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:30:38.193 03:31:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:30:38.193 03:31:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:30:38.193 03:31:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:30:38.193 03:31:12 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:30:38.193 192.168.100.9' 00:30:38.193 03:31:12 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:30:38.193 192.168.100.9' 00:30:38.193 03:31:12 -- nvmf/common.sh@446 -- # head -n 1 00:30:38.193 03:31:12 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:30:38.193 03:31:12 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:30:38.193 192.168.100.9' 00:30:38.193 03:31:12 -- nvmf/common.sh@447 -- # tail -n +2 00:30:38.193 03:31:12 -- nvmf/common.sh@447 -- # head -n 1 00:30:38.193 03:31:12 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:30:38.193 03:31:12 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:30:38.193 03:31:12 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:30:38.193 03:31:12 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:30:38.193 03:31:12 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:30:38.193 03:31:12 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:30:38.193 03:31:12 -- spdkcli/nvmf.sh@24 -- # NVMF_TARGET_IP=192.168.100.8 00:30:38.193 03:31:12 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:30:38.193 03:31:12 -- common/autotest_common.sh@710 -- # xtrace_disable 00:30:38.193 03:31:12 -- common/autotest_common.sh@10 -- # set +x 00:30:38.193 03:31:12 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:30:38.193 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:30:38.193 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:30:38.193 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:30:38.193 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:30:38.193 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:30:38.193 '\''nvmf/transport create rdma max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:30:38.193 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:38.193 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:30:38.193 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:30:38.193 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4260 IPv4'\'' '\''192.168.100.8:4260'\'' True 00:30:38.194 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:38.194 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:30:38.194 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create rdma 192.168.100.8 4260 IPv4'\'' '\''192.168.100.8:4260'\'' True 00:30:38.194 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:38.194 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:30:38.194 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4260 IPv4'\'' '\''192.168.100.8:4260'\'' True 00:30:38.194 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4261 IPv4'\'' '\''192.168.100.8:4261'\'' True 00:30:38.194 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:38.194 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:38.194 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:30:38.194 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:30:38.194 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4261 IPv4'\'' '\''192.168.100.8:4261'\'' True 00:30:38.194 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4262 IPv4'\'' '\''192.168.100.8:4262'\'' True 00:30:38.194 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:38.194 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:30:38.194 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:30:38.194 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:30:38.194 ' 00:30:38.194 [2024-04-25 03:31:12.629179] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:30:40.728 [2024-04-25 03:31:14.695080] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f0(0x22d7890/0x22d6ed0) succeed. 00:30:40.728 [2024-04-25 03:31:14.704594] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep175s0f1(0x22d8cc0/0x22d7450) succeed. 00:30:40.728 [2024-04-25 03:31:14.704617] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:30:40.728 [2024-04-25 03:31:14.706604] iobuf.c: 323:spdk_iobuf_channel_init: *ERROR*: Failed to populate 'nvmf_RDMA' iobuf large buffer cache at 1024/1535 entries. You may need to increase spdk_iobuf_opts.large_pool_count (1024) 00:30:40.728 [2024-04-25 03:31:14.706632] iobuf.c: 326:spdk_iobuf_channel_init: *ERROR*: See scripts/calc-iobuf.py for guidance on how to calculate this value. 00:30:40.728 [2024-04-25 03:31:14.707810] transport.c: 629:nvmf_transport_poll_group_create: *ERROR*: Unable to reserve the full number of buffers for the pg buffer cache. 00:30:40.728 [2024-04-25 03:31:14.709440] iobuf.c: 323:spdk_iobuf_channel_init: *ERROR*: Failed to populate 'nvmf_RDMA' iobuf large buffer cache at 1024/1535 entries. You may need to increase spdk_iobuf_opts.large_pool_count (1024) 00:30:40.728 [2024-04-25 03:31:14.709453] iobuf.c: 326:spdk_iobuf_channel_init: *ERROR*: See scripts/calc-iobuf.py for guidance on how to calculate this value. 00:30:40.728 [2024-04-25 03:31:14.710640] transport.c: 629:nvmf_transport_poll_group_create: *ERROR*: Unable to reserve the full number of buffers for the pg buffer cache. 00:30:41.711 [2024-04-25 03:31:15.882500] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4260 *** 00:30:43.615 [2024-04-25 03:31:18.045510] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4261 *** 00:30:45.519 [2024-04-25 03:31:19.903514] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4262 *** 00:30:46.899 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:30:46.899 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:30:46.899 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:30:46.899 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:30:46.899 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:30:46.899 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:30:46.899 Executing command: ['nvmf/transport create rdma max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:30:46.899 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:30:46.899 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:30:46.899 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:30:46.899 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4260 IPv4', '192.168.100.8:4260', True] 00:30:46.899 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:46.899 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:30:46.899 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create rdma 192.168.100.8 4260 IPv4', '192.168.100.8:4260', True] 00:30:46.899 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:46.899 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:30:46.899 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4260 IPv4', '192.168.100.8:4260', True] 00:30:46.899 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4261 IPv4', '192.168.100.8:4261', True] 00:30:46.899 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:30:46.899 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:46.899 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:30:46.899 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:30:46.899 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4261 IPv4', '192.168.100.8:4261', True] 00:30:46.899 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4262 IPv4', '192.168.100.8:4262', True] 00:30:46.899 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:46.899 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:30:46.899 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:30:46.899 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:30:47.158 03:31:21 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:30:47.158 03:31:21 -- common/autotest_common.sh@716 -- # xtrace_disable 00:30:47.158 03:31:21 -- common/autotest_common.sh@10 -- # set +x 00:30:47.158 03:31:21 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:30:47.158 03:31:21 -- common/autotest_common.sh@710 -- # xtrace_disable 00:30:47.158 03:31:21 -- common/autotest_common.sh@10 -- # set +x 00:30:47.158 03:31:21 -- spdkcli/nvmf.sh@69 -- # check_match 00:30:47.158 03:31:21 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:30:47.417 03:31:21 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:30:47.417 03:31:21 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:30:47.417 03:31:21 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:30:47.417 03:31:21 -- common/autotest_common.sh@716 -- # xtrace_disable 00:30:47.417 03:31:21 -- common/autotest_common.sh@10 -- # set +x 00:30:47.676 03:31:21 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:30:47.676 03:31:21 -- common/autotest_common.sh@710 -- # xtrace_disable 00:30:47.676 03:31:21 -- common/autotest_common.sh@10 -- # set +x 00:30:47.676 03:31:21 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:30:47.676 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:30:47.676 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:30:47.676 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:30:47.676 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete rdma 192.168.100.8 4262'\'' '\''192.168.100.8:4262'\'' 00:30:47.676 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''192.168.100.8:4261'\'' 00:30:47.676 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:30:47.676 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:30:47.676 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:30:47.676 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:30:47.676 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:30:47.676 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:30:47.676 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:30:47.676 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:30:47.676 ' 00:30:52.945 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:30:52.945 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:30:52.945 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:30:52.945 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:30:52.945 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete rdma 192.168.100.8 4262', '192.168.100.8:4262', False] 00:30:52.945 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '192.168.100.8:4261', False] 00:30:52.945 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:30:52.945 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:30:52.945 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:30:52.945 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:30:52.945 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:30:52.945 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:30:52.945 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:30:52.945 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:30:52.945 03:31:26 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:30:52.946 03:31:26 -- common/autotest_common.sh@716 -- # xtrace_disable 00:30:52.946 03:31:26 -- common/autotest_common.sh@10 -- # set +x 00:30:52.946 03:31:26 -- spdkcli/nvmf.sh@90 -- # killprocess 82002 00:30:52.946 03:31:26 -- common/autotest_common.sh@936 -- # '[' -z 82002 ']' 00:30:52.946 03:31:26 -- common/autotest_common.sh@940 -- # kill -0 82002 00:30:52.946 03:31:26 -- common/autotest_common.sh@941 -- # uname 00:30:52.946 03:31:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:52.946 03:31:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 82002 00:30:52.946 03:31:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:52.946 03:31:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:52.946 03:31:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 82002' 00:30:52.946 killing process with pid 82002 00:30:52.946 03:31:26 -- common/autotest_common.sh@955 -- # kill 82002 00:30:52.946 [2024-04-25 03:31:26.928716] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:30:52.946 03:31:26 -- common/autotest_common.sh@960 -- # wait 82002 00:30:52.946 [2024-04-25 03:31:26.956454] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:30:52.946 03:31:27 -- spdkcli/nvmf.sh@1 -- # nvmftestfini 00:30:52.946 03:31:27 -- nvmf/common.sh@477 -- # nvmfcleanup 00:30:52.946 03:31:27 -- nvmf/common.sh@117 -- # sync 00:30:52.946 03:31:27 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:30:52.946 03:31:27 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:30:52.946 03:31:27 -- nvmf/common.sh@120 -- # set +e 00:30:52.946 03:31:27 -- nvmf/common.sh@121 -- # for i in {1..20} 00:30:52.946 03:31:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:30:52.946 rmmod nvme_rdma 00:30:52.946 rmmod nvme_fabrics 00:30:52.946 03:31:27 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:30:52.946 03:31:27 -- nvmf/common.sh@124 -- # set -e 00:30:52.946 03:31:27 -- nvmf/common.sh@125 -- # return 0 00:30:52.946 03:31:27 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:30:52.946 03:31:27 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:30:52.946 03:31:27 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:30:52.946 00:30:52.946 real 0m22.134s 00:30:52.946 user 0m46.930s 00:30:52.946 sys 0m5.393s 00:30:52.946 03:31:27 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:30:52.946 03:31:27 -- common/autotest_common.sh@10 -- # set +x 00:30:52.946 ************************************ 00:30:52.946 END TEST spdkcli_nvmf_rdma 00:30:52.946 ************************************ 00:30:52.946 03:31:27 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:30:52.946 03:31:27 -- spdk/autotest.sh@310 -- # '[' 0 -eq 1 ']' 00:30:52.946 03:31:27 -- spdk/autotest.sh@314 -- # '[' 0 -eq 1 ']' 00:30:52.946 03:31:27 -- spdk/autotest.sh@319 -- # '[' 0 -eq 1 ']' 00:30:52.946 03:31:27 -- spdk/autotest.sh@328 -- # '[' 0 -eq 1 ']' 00:30:52.946 03:31:27 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:30:52.946 03:31:27 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:30:52.946 03:31:27 -- spdk/autotest.sh@341 -- # '[' 0 -eq 1 ']' 00:30:52.946 03:31:27 -- spdk/autotest.sh@345 -- # '[' 0 -eq 1 ']' 00:30:52.946 03:31:27 -- spdk/autotest.sh@350 -- # '[' 0 -eq 1 ']' 00:30:52.946 03:31:27 -- spdk/autotest.sh@354 -- # '[' 0 -eq 1 ']' 00:30:52.946 03:31:27 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:30:52.946 03:31:27 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:30:52.946 03:31:27 -- spdk/autotest.sh@369 -- # [[ 0 -eq 1 ]] 00:30:52.946 03:31:27 -- spdk/autotest.sh@373 -- # [[ 0 -eq 1 ]] 00:30:52.946 03:31:27 -- spdk/autotest.sh@378 -- # trap - SIGINT SIGTERM EXIT 00:30:52.946 03:31:27 -- spdk/autotest.sh@380 -- # timing_enter post_cleanup 00:30:52.946 03:31:27 -- common/autotest_common.sh@710 -- # xtrace_disable 00:30:52.946 03:31:27 -- common/autotest_common.sh@10 -- # set +x 00:30:52.946 03:31:27 -- spdk/autotest.sh@381 -- # autotest_cleanup 00:30:52.946 03:31:27 -- common/autotest_common.sh@1378 -- # local autotest_es=0 00:30:52.946 03:31:27 -- common/autotest_common.sh@1379 -- # xtrace_disable 00:30:52.946 03:31:27 -- common/autotest_common.sh@10 -- # set +x 00:30:57.138 INFO: APP EXITING 00:30:57.138 INFO: killing all VMs 00:30:57.138 INFO: killing vhost app 00:30:57.138 INFO: EXIT DONE 00:30:58.511 0000:5f:00.0 (1b96 2600): Skipping denied controller at 0000:5f:00.0 00:30:58.768 Waiting for block devices as requested 00:30:59.026 0000:5e:00.0 (8086 0a54): vfio-pci -> nvme 00:30:59.026 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:30:59.026 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:30:59.284 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:30:59.284 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:30:59.284 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:30:59.285 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:30:59.543 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:30:59.543 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:30:59.543 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:30:59.801 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:30:59.801 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:30:59.801 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:30:59.801 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:31:00.059 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:31:00.059 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:31:00.060 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:31:02.588 0000:5f:00.0 (1b96 2600): Skipping denied controller at 0000:5f:00.0 00:31:02.847 Cleaning 00:31:02.847 Removing: /var/run/dpdk/spdk0/config 00:31:02.847 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:31:02.847 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:31:02.847 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:31:02.847 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:31:02.847 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:31:02.847 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:31:02.847 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:31:02.847 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:31:02.847 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:31:02.847 Removing: /var/run/dpdk/spdk0/hugepage_info 00:31:02.847 Removing: /var/run/dpdk/spdk1/config 00:31:02.847 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:31:02.847 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:31:02.847 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:31:02.847 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:31:02.847 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:31:02.847 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:31:02.847 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:31:02.847 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:31:03.107 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:31:03.107 Removing: /var/run/dpdk/spdk1/hugepage_info 00:31:03.107 Removing: /var/run/dpdk/spdk1/mp_socket 00:31:03.107 Removing: /var/run/dpdk/spdk2/config 00:31:03.107 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:31:03.107 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:31:03.107 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:31:03.107 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:31:03.107 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:31:03.107 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:31:03.107 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:31:03.107 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:31:03.107 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:31:03.107 Removing: /var/run/dpdk/spdk2/hugepage_info 00:31:03.107 Removing: /var/run/dpdk/spdk3/config 00:31:03.107 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:31:03.107 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:31:03.107 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:31:03.107 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:31:03.107 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:31:03.107 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:31:03.107 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:31:03.107 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:31:03.107 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:31:03.107 Removing: /var/run/dpdk/spdk3/hugepage_info 00:31:03.107 Removing: /var/run/dpdk/spdk4/config 00:31:03.107 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:31:03.107 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:31:03.107 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:31:03.107 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:31:03.107 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:31:03.107 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:31:03.107 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:31:03.107 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:31:03.107 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:31:03.107 Removing: /var/run/dpdk/spdk4/hugepage_info 00:31:03.107 Removing: /dev/shm/bdevperf_trace.pid4183630 00:31:03.107 Removing: /dev/shm/bdev_svc_trace.1 00:31:03.107 Removing: /dev/shm/nvmf_trace.0 00:31:03.107 Removing: /dev/shm/spdk_tgt_trace.pid3895836 00:31:03.107 Removing: /var/run/dpdk/spdk0 00:31:03.107 Removing: /var/run/dpdk/spdk1 00:31:03.107 Removing: /var/run/dpdk/spdk2 00:31:03.107 Removing: /var/run/dpdk/spdk3 00:31:03.107 Removing: /var/run/dpdk/spdk4 00:31:03.107 Removing: /var/run/dpdk/spdk_pid14120 00:31:03.107 Removing: /var/run/dpdk/spdk_pid14580 00:31:03.107 Removing: /var/run/dpdk/spdk_pid15150 00:31:03.107 Removing: /var/run/dpdk/spdk_pid15254 00:31:03.107 Removing: /var/run/dpdk/spdk_pid1681 00:31:03.107 Removing: /var/run/dpdk/spdk_pid16856 00:31:03.107 Removing: /var/run/dpdk/spdk_pid18655 00:31:03.107 Removing: /var/run/dpdk/spdk_pid20455 00:31:03.107 Removing: /var/run/dpdk/spdk_pid22381 00:31:03.107 Removing: /var/run/dpdk/spdk_pid24569 00:31:03.107 Removing: /var/run/dpdk/spdk_pid2572 00:31:03.107 Removing: /var/run/dpdk/spdk_pid26369 00:31:03.107 Removing: /var/run/dpdk/spdk_pid32216 00:31:03.107 Removing: /var/run/dpdk/spdk_pid32781 00:31:03.107 Removing: /var/run/dpdk/spdk_pid34271 00:31:03.107 Removing: /var/run/dpdk/spdk_pid3484 00:31:03.107 Removing: /var/run/dpdk/spdk_pid35066 00:31:03.107 Removing: /var/run/dpdk/spdk_pid3893457 00:31:03.107 Removing: /var/run/dpdk/spdk_pid3894542 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3895836 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3896508 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3897451 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3897692 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3898693 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3898895 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3899244 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3904239 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3905505 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3905790 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3906241 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3906603 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3906900 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3907168 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3907419 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3907698 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3908672 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3911640 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3911986 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3912512 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3912546 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3913021 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3913247 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3914116 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3914174 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3914567 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3914634 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3914900 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3915119 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3915556 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3915827 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3916230 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3916515 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3916551 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3916852 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3917103 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3917359 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3917614 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3917872 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3918122 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3918408 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3918739 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3919094 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3919350 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3919600 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3919859 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3920111 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3920371 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3920624 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3920888 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3921217 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3921547 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3921857 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3922113 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3922365 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3922515 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3922978 00:31:03.408 Removing: /var/run/dpdk/spdk_pid3927136 00:31:03.408 Removing: /var/run/dpdk/spdk_pid4012828 00:31:03.408 Removing: /var/run/dpdk/spdk_pid4017095 00:31:03.408 Removing: /var/run/dpdk/spdk_pid4026354 00:31:03.408 Removing: /var/run/dpdk/spdk_pid4031577 00:31:03.408 Removing: /var/run/dpdk/spdk_pid4035433 00:31:03.408 Removing: /var/run/dpdk/spdk_pid4036152 00:31:03.408 Removing: /var/run/dpdk/spdk_pid4051572 00:31:03.408 Removing: /var/run/dpdk/spdk_pid4051839 00:31:03.408 Removing: /var/run/dpdk/spdk_pid40550 00:31:03.408 Removing: /var/run/dpdk/spdk_pid4056103 00:31:03.408 Removing: /var/run/dpdk/spdk_pid4062037 00:31:03.408 Removing: /var/run/dpdk/spdk_pid4064758 00:31:03.408 Removing: /var/run/dpdk/spdk_pid4074741 00:31:03.408 Removing: /var/run/dpdk/spdk_pid4099279 00:31:03.408 Removing: /var/run/dpdk/spdk_pid4103451 00:31:03.685 Removing: /var/run/dpdk/spdk_pid4108256 00:31:03.685 Removing: /var/run/dpdk/spdk_pid4140072 00:31:03.685 Removing: /var/run/dpdk/spdk_pid4155352 00:31:03.685 Removing: /var/run/dpdk/spdk_pid4181492 00:31:03.685 Removing: /var/run/dpdk/spdk_pid4182549 00:31:03.685 Removing: /var/run/dpdk/spdk_pid4183630 00:31:03.685 Removing: /var/run/dpdk/spdk_pid4187905 00:31:03.685 Removing: /var/run/dpdk/spdk_pid43267 00:31:03.685 Removing: /var/run/dpdk/spdk_pid4454 00:31:03.685 Removing: /var/run/dpdk/spdk_pid4901 00:31:03.685 Removing: /var/run/dpdk/spdk_pid50408 00:31:03.685 Removing: /var/run/dpdk/spdk_pid50413 00:31:03.685 Removing: /var/run/dpdk/spdk_pid70020 00:31:03.685 Removing: /var/run/dpdk/spdk_pid70496 00:31:03.685 Removing: /var/run/dpdk/spdk_pid76367 00:31:03.685 Removing: /var/run/dpdk/spdk_pid76858 00:31:03.685 Removing: /var/run/dpdk/spdk_pid78722 00:31:03.685 Removing: /var/run/dpdk/spdk_pid82002 00:31:03.685 Removing: /var/run/dpdk/spdk_pid9398 00:31:03.685 Removing: /var/run/dpdk/spdk_pid9477 00:31:03.685 Clean 00:31:03.685 03:31:38 -- common/autotest_common.sh@1437 -- # return 0 00:31:03.685 03:31:38 -- spdk/autotest.sh@382 -- # timing_exit post_cleanup 00:31:03.685 03:31:38 -- common/autotest_common.sh@716 -- # xtrace_disable 00:31:03.685 03:31:38 -- common/autotest_common.sh@10 -- # set +x 00:31:03.685 03:31:38 -- spdk/autotest.sh@384 -- # timing_exit autotest 00:31:03.685 03:31:38 -- common/autotest_common.sh@716 -- # xtrace_disable 00:31:03.685 03:31:38 -- common/autotest_common.sh@10 -- # set +x 00:31:03.685 03:31:38 -- spdk/autotest.sh@385 -- # chmod a+r /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/timing.txt 00:31:03.685 03:31:38 -- spdk/autotest.sh@387 -- # [[ -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/udev.log ]] 00:31:03.685 03:31:38 -- spdk/autotest.sh@387 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/udev.log 00:31:03.685 03:31:38 -- spdk/autotest.sh@389 -- # hash lcov 00:31:03.685 03:31:38 -- spdk/autotest.sh@389 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:31:03.943 03:31:38 -- spdk/autotest.sh@391 -- # hostname 00:31:03.943 03:31:38 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk -t spdk-wfp-03 -o /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_test.info 00:31:03.943 geninfo: WARNING: invalid characters removed from testname! 00:31:22.020 03:31:56 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -a /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_total.info 00:31:24.551 03:31:58 -- spdk/autotest.sh@393 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_total.info 00:31:25.928 03:32:00 -- spdk/autotest.sh@394 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_total.info '/usr/*' -o /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_total.info 00:31:27.829 03:32:01 -- spdk/autotest.sh@395 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_total.info 00:31:29.203 03:32:03 -- spdk/autotest.sh@396 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_total.info 00:31:31.105 03:32:05 -- spdk/autotest.sh@397 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_total.info 00:31:32.482 03:32:06 -- spdk/autotest.sh@398 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:31:32.482 03:32:06 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:31:32.482 03:32:06 -- scripts/common.sh@508 -- $ [[ -e /bin/wpdk_common.sh ]] 00:31:32.482 03:32:06 -- scripts/common.sh@516 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:32.482 03:32:06 -- scripts/common.sh@517 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:32.482 03:32:06 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:32.482 03:32:06 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:32.482 03:32:06 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:32.482 03:32:06 -- paths/export.sh@5 -- $ export PATH 00:31:32.482 03:32:06 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:32.482 03:32:06 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output 00:31:32.482 03:32:06 -- common/autobuild_common.sh@435 -- $ date +%s 00:31:32.482 03:32:06 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1714008726.XXXXXX 00:31:32.482 03:32:06 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1714008726.oPOZfB 00:31:32.482 03:32:06 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:31:32.482 03:32:06 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:31:32.482 03:32:06 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/' 00:31:32.482 03:32:06 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/xnvme --exclude /tmp' 00:31:32.482 03:32:06 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:31:32.482 03:32:06 -- common/autobuild_common.sh@451 -- $ get_config_params 00:31:32.482 03:32:06 -- common/autotest_common.sh@385 -- $ xtrace_disable 00:31:32.482 03:32:06 -- common/autotest_common.sh@10 -- $ set +x 00:31:32.483 03:32:06 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:31:32.483 03:32:06 -- common/autobuild_common.sh@453 -- $ start_monitor_resources 00:31:32.483 03:32:06 -- pm/common@17 -- $ local monitor 00:31:32.483 03:32:06 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:31:32.483 03:32:06 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=97317 00:31:32.483 03:32:06 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:31:32.483 03:32:06 -- pm/common@21 -- $ date +%s 00:31:32.483 03:32:06 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=97319 00:31:32.483 03:32:06 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:31:32.483 03:32:06 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=97322 00:31:32.483 03:32:06 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:31:32.483 03:32:06 -- pm/common@21 -- $ date +%s 00:31:32.483 03:32:06 -- pm/common@21 -- $ date +%s 00:31:32.483 03:32:06 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=97324 00:31:32.483 03:32:06 -- pm/common@26 -- $ sleep 1 00:31:32.483 03:32:06 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1714008726 00:31:32.483 03:32:06 -- pm/common@21 -- $ date +%s 00:31:32.483 03:32:06 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1714008726 00:31:32.483 03:32:06 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1714008726 00:31:32.483 03:32:06 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1714008726 00:31:32.483 Redirecting to /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1714008726_collect-cpu-load.pm.log 00:31:32.483 Redirecting to /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1714008726_collect-cpu-temp.pm.log 00:31:32.483 Redirecting to /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1714008726_collect-vmstat.pm.log 00:31:32.483 Redirecting to /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1714008726_collect-bmc-pm.bmc.pm.log 00:31:33.419 03:32:07 -- common/autobuild_common.sh@454 -- $ trap stop_monitor_resources EXIT 00:31:33.419 03:32:07 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j96 00:31:33.419 03:32:07 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:31:33.419 03:32:07 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:31:33.419 03:32:07 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:31:33.419 03:32:07 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:31:33.419 03:32:07 -- spdk/autopackage.sh@19 -- $ timing_finish 00:31:33.419 03:32:07 -- common/autotest_common.sh@722 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:31:33.419 03:32:07 -- common/autotest_common.sh@723 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:31:33.419 03:32:07 -- common/autotest_common.sh@725 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/timing.txt 00:31:33.678 03:32:07 -- spdk/autopackage.sh@20 -- $ exit 0 00:31:33.678 03:32:07 -- spdk/autopackage.sh@1 -- $ stop_monitor_resources 00:31:33.678 03:32:07 -- pm/common@30 -- $ signal_monitor_resources TERM 00:31:33.678 03:32:07 -- pm/common@41 -- $ local monitor pid pids signal=TERM 00:31:33.678 03:32:07 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:31:33.678 03:32:07 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/collect-cpu-load.pid ]] 00:31:33.678 03:32:07 -- pm/common@45 -- $ pid=97330 00:31:33.678 03:32:07 -- pm/common@52 -- $ sudo kill -TERM 97330 00:31:33.678 03:32:07 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:31:33.678 03:32:07 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/collect-vmstat.pid ]] 00:31:33.678 03:32:07 -- pm/common@45 -- $ pid=97341 00:31:33.678 03:32:07 -- pm/common@52 -- $ sudo kill -TERM 97341 00:31:33.678 03:32:07 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:31:33.678 03:32:07 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/collect-cpu-temp.pid ]] 00:31:33.678 03:32:07 -- pm/common@45 -- $ pid=97331 00:31:33.678 03:32:07 -- pm/common@52 -- $ sudo kill -TERM 97331 00:31:33.678 03:32:08 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:31:33.678 03:32:08 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/collect-bmc-pm.pid ]] 00:31:33.678 03:32:08 -- pm/common@45 -- $ pid=97339 00:31:33.678 03:32:08 -- pm/common@52 -- $ sudo kill -TERM 97339 00:31:33.678 + [[ -n 3785572 ]] 00:31:33.678 + sudo kill 3785572 00:31:33.687 [Pipeline] } 00:31:33.707 [Pipeline] // stage 00:31:33.713 [Pipeline] } 00:31:33.733 [Pipeline] // timeout 00:31:33.738 [Pipeline] } 00:31:33.757 [Pipeline] // catchError 00:31:33.762 [Pipeline] } 00:31:33.779 [Pipeline] // wrap 00:31:33.785 [Pipeline] } 00:31:33.800 [Pipeline] // catchError 00:31:33.809 [Pipeline] stage 00:31:33.812 [Pipeline] { (Epilogue) 00:31:33.826 [Pipeline] catchError 00:31:33.828 [Pipeline] { 00:31:33.842 [Pipeline] echo 00:31:33.844 Cleanup processes 00:31:33.851 [Pipeline] sh 00:31:34.163 + sudo pgrep -af /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:31:34.163 97441 /usr/bin/ipmitool sdr dump /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/sdr.cache 00:31:34.163 97736 sudo pgrep -af /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:31:34.178 [Pipeline] sh 00:31:34.464 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:31:34.464 ++ grep -v 'sudo pgrep' 00:31:34.464 ++ awk '{print $1}' 00:31:34.464 + sudo kill -9 97441 00:31:34.476 [Pipeline] sh 00:31:34.756 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:31:42.876 [Pipeline] sh 00:31:43.155 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:31:43.155 Artifacts sizes are good 00:31:43.168 [Pipeline] archiveArtifacts 00:31:43.175 Archiving artifacts 00:31:43.364 [Pipeline] sh 00:31:43.651 + sudo chown -R sys_sgci /var/jenkins/workspace/nvmf-cvl-phy-autotest 00:31:43.664 [Pipeline] cleanWs 00:31:43.674 [WS-CLEANUP] Deleting project workspace... 00:31:43.674 [WS-CLEANUP] Deferred wipeout is used... 00:31:43.680 [WS-CLEANUP] done 00:31:43.682 [Pipeline] } 00:31:43.700 [Pipeline] // catchError 00:31:43.712 [Pipeline] sh 00:31:43.989 + logger -p user.info -t JENKINS-CI 00:31:43.998 [Pipeline] } 00:31:44.014 [Pipeline] // stage 00:31:44.019 [Pipeline] } 00:31:44.035 [Pipeline] // node 00:31:44.041 [Pipeline] End of Pipeline 00:31:44.084 Finished: SUCCESS